Sears Russell
b1f7d1947a
more log refactoring. safeWrites now holds a latch across reserve_entry, write_entry, and write_entry_done
2010-01-19 02:14:09 +00:00
Sears Russell
c8cc188b71
unsigned int -> uint32_t
2010-01-19 01:47:13 +00:00
Sears Russell
d71e248291
removed freeLogEntry
2010-01-11 20:41:59 +00:00
Sears Russell
c30aaa3a1a
fix compiler warning; -1 is not comparable to entry->type
2010-01-07 21:50:17 +00:00
Sears Russell
1af589dd18
remove malloc and memcpy from the in_memory_log read path
2009-12-31 23:25:56 +00:00
Sears Russell
1409a9eb27
more refactoring; log handles now manage their log entries memory
2009-12-31 23:01:37 +00:00
Sears Russell
a5788688c8
refactor getUpdateArgs; remove a bunch of casts, fix a bunch of warnings
2009-12-31 20:20:47 +00:00
Sears Russell
9aa1d9d652
pull memcpy out of allocUpdateEntry()
2009-12-31 19:30:40 +00:00
Sears Russell
32e40c949d
added log modes to sequentialThroughput benchmark, added methods for concurrent appends to log api (and stubbed them out)
2009-12-31 19:02:34 +00:00
Sears Russell
7ff80f37ef
add deferred, end of transaction callbacks. addresses issue 15
2009-12-15 06:30:37 +00:00
Sears Russell
efc6a0eabd
add missing function declaration
2009-12-10 01:53:15 +00:00
Sears Russell
cd8c63889d
clarify documentation
2009-12-09 19:55:27 +00:00
Sears Russell
83a0ec68fe
fix rose bit rot, have unintialized page clear the impl pointer (for tidyness), remove some resolved @todos.
2009-12-04 19:33:09 +00:00
Sears Russell
7d1b702239
revert part of opensolaris patch--pack recordids again
2009-11-30 01:01:30 +00:00
Sears Russell
2ff421bff0
initial opensolaris port
2009-11-29 03:22:36 +00:00
Sears Russell
2535f69fbc
switch the concurrent hash to use lru->getStaleAndRemove; fix crashes due to partial leak of thread local pages on thread shutdown
2009-11-24 01:43:36 +00:00
Sears Russell
38b999dfed
add missing stlredblack.h header
2009-11-24 01:41:55 +00:00
Sears Russell
675bdce24a
wrote some wrappers that emulate redblack; default to stl tree for now
2009-11-24 00:24:18 +00:00
Sears Russell
1b0c10b37b
clean up handling of uninitialized pages (removes some special case code)
2009-11-09 23:02:27 +00:00
Sears Russell
795e044ab9
documentation fix
2009-11-09 22:58:37 +00:00
Sears Russell
b4a0f2436b
concurrent lru implementation for new buffer manager
2009-11-09 20:53:05 +00:00
Sears Russell
8bd0616f97
new concurrent buffer manager
2009-11-09 19:50:00 +00:00
Sears Russell
f5e3ab2d91
concurrent hashtable seems to be working; still need to work out atomicity primitives (eg; options to leave the bucket locked on success)
2009-10-19 21:55:25 +00:00
Sears Russell
1cf16f62f2
add optional support for gcc atomics to transaction table
2009-10-15 22:46:25 +00:00
Sears Russell
e6a718a7f9
improved concurrency for transaction table
2009-10-15 20:11:43 +00:00
Sears Russell
331f680c09
partial rewrite of transaction table to reduce thread contention
2009-10-15 02:33:08 +00:00
Sears Russell
4565aff9de
more refactoring; no more globals in transactionTable.c
2009-10-14 21:22:50 +00:00
Sears Russell
dbe3ecf0d0
refactoring transaction table; moved implementation into its own file. still need to remove globals
2009-10-14 18:57:50 +00:00
Sears Russell
20ef74b104
use pthread_rwlock instead of rwlock userspace emulation of it
2009-10-13 00:29:35 +00:00
Sears Russell
20a3fe9df5
add support for soft commits, and making prior soft commits durable
2009-10-12 19:16:41 +00:00
Sears Russell
942ba7fffc
bugfixes + support for hard limits on log size
2009-10-08 22:48:58 +00:00
Sears Russell
6a02f2f159
buffer manager implementation is now determined by an overridable factory method
2009-10-05 22:39:09 +00:00
Sears Russell
24650fa190
buffer manager refactoring; started work on new dirty page table writeback interface (to avoid circular dependencies)
2009-10-05 21:19:01 +00:00
Sears Russell
4689582cb5
improve log performance by disabling O_SYNC by default (and use fdatasync instead)
2009-09-12 16:20:13 +00:00
Sears Russell
c4e80b41b5
more include cleaning on alloc, begin cleaning of bufferHash
2009-08-22 21:29:27 +00:00
Sears Russell
1ce1496226
dependency cleanups; removed compenastions from alloc.c
2009-08-22 00:01:02 +00:00
Sears Russell
94c542f8b1
Increase dirtyPageTable concurrency
...
Add special-casing of lhtable; special case for buffer manager.
2009-08-14 06:31:13 +00:00
Sears Russell
dd0bcae074
add thread synchronization logic to ensure that only one thread is performing writeback at a time. This fixes weird I/O interleavings on some machines
2009-08-13 23:18:49 +00:00
Sears Russell
0154f7d29d
IMPORTANT API CHANGE: stasis_dirty_page_table_flush_range() no longer force writes to disk. You now need to call forcePageRange() after flush page range returns.
...
This commit should significantly improve sequential write thoughput.
I found a segfault bug this morning, but cannot reproduce. Could be a heisenbug, or could have been a hardware fault (gojira repeatedly kernel paniced, then both problems went away...)
2009-08-13 05:53:48 +00:00
Sears Russell
0cc65aefaf
Remove LRU-ordered writeback. Instead, writeback pages sequentially once some fraction of the page file is dirty. Also. further simplifies writeback code.
2009-08-11 17:23:43 +00:00
Sears Russell
907a24b68e
dirty page table flush was pinning pages, then asserting they were not pinned; updated page writeback api to allow correct usage
2009-08-08 01:43:03 +00:00
Sears Russell
c92ee87c32
improved behavior for sequential I/O performance, fixed races during writeback
2009-08-07 18:27:52 +00:00
Sears Russell
a6aa8ed942
added method to access dirtyPageTable
2009-08-05 20:02:33 +00:00
Sears Russell
5b10bcc63b
Reimplemented allocationPolicy.c; updated API + added more cases to the unit tests.
2009-08-05 06:35:11 +00:00
Sears Russell
c961b34903
forgot to commit b-tree source files
2009-07-29 21:04:08 +00:00
Sears Russell
ebd6b14dbf
single-page btrees are working
2009-07-29 21:03:16 +00:00
Sears Russell
0a308f035c
more header cleaning; updated INSTALL
2009-07-26 19:47:05 +00:00
Sears Russell
081c61b414
cleaned up includes, autoconf is now optional, since cmake now creates a config.h
2009-07-26 18:51:45 +00:00
Sears Russell
260310e151
Add page ops for tree implementations.
2009-07-26 06:18:54 +00:00
Sears Russell
7f2edd880d
New (more thorough, less frequent) tests for slotted pages. Renamed slotted methods, added microbenchmark for slotted pages.
2009-07-20 17:42:43 +00:00
