Sears Russell
8bd0616f97
new concurrent buffer manager
2009-11-09 19:50:00 +00:00
Sears Russell
f5e3ab2d91
concurrent hashtable seems to be working; still need to work out atomicity primitives (eg; options to leave the bucket locked on success)
2009-10-19 21:55:25 +00:00
Sears Russell
1cf16f62f2
add optional support for gcc atomics to transaction table
2009-10-15 22:46:25 +00:00
Sears Russell
e6a718a7f9
improved concurrency for transaction table
2009-10-15 20:11:43 +00:00
Sears Russell
5df5512d91
fixed unit test bug; logWriters may now return NULL when readers attempt to read before the beginning of the log
2009-10-15 18:48:58 +00:00
Sears Russell
331f680c09
partial rewrite of transaction table to reduce thread contention
2009-10-15 02:33:08 +00:00
Sears Russell
4565aff9de
more refactoring; no more globals in transactionTable.c
2009-10-14 21:22:50 +00:00
Sears Russell
dbe3ecf0d0
refactoring transaction table; moved implementation into its own file. still need to remove globals
2009-10-14 18:57:50 +00:00
Sears Russell
20ef74b104
use pthread_rwlock instead of rwlock userspace emulation of it
2009-10-13 00:29:35 +00:00
Sears Russell
4cb618988d
improve performance of noop transactions
2009-10-12 22:29:57 +00:00
Sears Russell
0e93a577c9
use INVALID_LSN instead of hardcoded -1
2009-10-12 22:26:32 +00:00
Sears Russell
20a3fe9df5
add support for soft commits, and making prior soft commits durable
2009-10-12 19:16:41 +00:00
Sears Russell
942ba7fffc
bugfixes + support for hard limits on log size
2009-10-08 22:48:58 +00:00
Sears Russell
8c2ce5f56e
fix typo
2009-10-06 00:12:39 +00:00
Sears Russell
6a02f2f159
buffer manager implementation is now determined by an overridable factory method
2009-10-05 22:39:09 +00:00
Sears Russell
24650fa190
buffer manager refactoring; started work on new dirty page table writeback interface (to avoid circular dependencies)
2009-10-05 21:19:01 +00:00
Sears Russell
8bf64aed58
fix compiler warning
2009-10-05 20:48:04 +00:00
Sears Russell
95d0df4a36
ashok's patch - fix more realloc problems
2009-10-01 02:13:32 +00:00
Sears Russell
4689582cb5
improve log performance by disabling O_SYNC by default (and use fdatasync instead)
2009-09-12 16:20:13 +00:00
Sears Russell
e48bc7adf3
partial b-tree stuff
2009-09-10 21:02:56 +00:00
Sears Russell
6abdb3c1c1
fix deadlock in inMemoryLog
2009-08-31 00:51:45 +00:00
Sears Russell
75ed19556b
Disable NAIVE_LOCKING in lhtable. (Should never have been enabled...)
2009-08-27 15:28:01 +00:00
Sears Russell
6562d6dd53
Add parens to comparators in allocationPolicy and dirtyPageTable.
2009-08-23 00:32:50 +00:00
Sears Russell
c4e80b41b5
more include cleaning on alloc, begin cleaning of bufferHash
2009-08-22 21:29:27 +00:00
Sears Russell
1ce1496226
dependency cleanups; removed compenastions from alloc.c
2009-08-22 00:01:02 +00:00
Sears Russell
94c542f8b1
Increase dirtyPageTable concurrency
...
Add special-casing of lhtable; special case for buffer manager.
2009-08-14 06:31:13 +00:00
Sears Russell
dd0bcae074
add thread synchronization logic to ensure that only one thread is performing writeback at a time. This fixes weird I/O interleavings on some machines
2009-08-13 23:18:49 +00:00
Sears Russell
0154f7d29d
IMPORTANT API CHANGE: stasis_dirty_page_table_flush_range() no longer force writes to disk. You now need to call forcePageRange() after flush page range returns.
...
This commit should significantly improve sequential write thoughput.
I found a segfault bug this morning, but cannot reproduce. Could be a heisenbug, or could have been a hardware fault (gojira repeatedly kernel paniced, then both problems went away...)
2009-08-13 05:53:48 +00:00
Sears Russell
0cc65aefaf
Remove LRU-ordered writeback. Instead, writeback pages sequentially once some fraction of the page file is dirty. Also. further simplifies writeback code.
2009-08-11 17:23:43 +00:00
Sears Russell
0f2b2ff200
remove special write path in deinit. (instead, attempt to avoid random I/O on shutdown)
2009-08-08 16:07:20 +00:00
Sears Russell
a0f9a7bc81
Cleaned up page locking + a harmless memory bug. Add missing locks to page writeback.
2009-08-08 07:59:19 +00:00
Sears Russell
907a24b68e
dirty page table flush was pinning pages, then asserting they were not pinned; updated page writeback api to allow correct usage
2009-08-08 01:43:03 +00:00
Sears Russell
c92ee87c32
improved behavior for sequential I/O performance, fixed races during writeback
2009-08-07 18:27:52 +00:00
Sears Russell
68e947fb6d
added missing case to allocationPolicy
2009-08-07 17:26:40 +00:00
Sears Russell
a6aa8ed942
added method to access dirtyPageTable
2009-08-05 20:02:33 +00:00
Sears Russell
573cbaa98e
implemented missing api calls
2009-08-05 19:56:35 +00:00
Sears Russell
69490f1c98
implement convention that stop=0 means flush to EOF
2009-08-05 19:50:07 +00:00
Sears Russell
16c137aaf7
remove unnecessary checks
2009-08-05 19:48:59 +00:00
Sears Russell
5b10bcc63b
Reimplemented allocationPolicy.c; updated API + added more cases to the unit tests.
2009-08-05 06:35:11 +00:00
Sears Russell
c961b34903
forgot to commit b-tree source files
2009-07-29 21:04:08 +00:00
Sears Russell
ebd6b14dbf
single-page btrees are working
2009-07-29 21:03:16 +00:00
Sears Russell
0a308f035c
more header cleaning; updated INSTALL
2009-07-26 19:47:05 +00:00
Sears Russell
081c61b414
cleaned up includes, autoconf is now optional, since cmake now creates a config.h
2009-07-26 18:51:45 +00:00
Sears Russell
260310e151
Add page ops for tree implementations.
2009-07-26 06:18:54 +00:00
Sears Russell
5ca3a008fa
Code / whitespace cleanup (no logic changes)
2009-07-25 23:17:03 +00:00
Sears Russell
8c012bd1c8
Silence extraneous warning, add '--mode -1' to the slotted benchmark (-1 bypasses function dispatch when setting the records)
2009-07-25 23:02:27 +00:00
Sears Russell
7f2edd880d
New (more thorough, less frequent) tests for slotted pages. Renamed slotted methods, added microbenchmark for slotted pages.
2009-07-20 17:42:43 +00:00
Sears Russell
9ef3adf40c
- Fix compile warning + broken fcn pointer from last commit.
...
- Address crashes in Tupdate() and recovery caused by mixing segments and page oriented recovery (add loadPageForOperation() call)
2009-07-16 03:05:32 +00:00
Sears Russell
b44f8b17b3
Add getCachedPage() call. This allows dirtyPageTable to write back pages with out accidentally reading them back in from disk with loadPage(). This should improve performance and allow loadPageOfType() to be used safely.
2009-07-14 07:46:47 +00:00
Sears Russell
4493dbb88b
Added support for segment based recovery. For now, Stasis doesn't support hybrid recovery, so mixing page deallocation and segments will make recovery corrupt data / segfault.
2009-07-13 17:18:01 +00:00
