greg/stasis-aries-wal
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
771 commits 3 branches 1 tag 14 MiB
Commit graph

161 commits

Author SHA1 Message Date
Sears Russell
d26263262b Completely new blob implementation. Slower than the old one was supposed to be, but is correct, and extremeley 
simple.  It simply writes the pre-image and post-image of each blob to the log using TpageSet.
 2006-06-21 00:45:18 +00:00
Sears Russell
3e4cac0fe3 Continued cleaning up allocation code. It seems really slow all of a sudden, so this commit probably introduced a performance bug. 2006-06-17 00:25:09 +00:00
Sears Russell
209a6916e5 Updated some comments. 2006-06-16 00:27:02 +00:00
Sears Russell
50515ffd23 More steps toward factoring page allocation out of record allocation. 2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8 half-hearted attempt to fix -Wextra warnings... 2006-06-13 23:58:04 +00:00
Sears Russell
0d09e9fb93 removed assert() heisenbug. 2006-06-13 22:38:50 +00:00
Sears Russell
e56c46b95c Moved blob_record_t into transactional.h (part of transition to using 
slot type lookup tables.)
 2006-06-13 22:37:29 +00:00
Sears Russell
8bec3d6175 Changed to use uint_64 for lsn_t 2006-06-13 22:36:03 +00:00
Sears Russell
a11fbdd9e6 Did away with slottedPreRallocFromPage. 2006-06-13 20:00:46 +00:00
Sears Russell
cef9e2c4ce Added settings for longer-running tests 2006-06-12 22:45:41 +00:00
Sears Russell
e0b34633ec Fixed broken min_rec_lsn() semantics; before, if there were not outstanding transactions / writes, 
then these calls would return flushedLSN().  The problem was that flushedLSN wasn't guaranteed to
return a pointed to the beginning of a log entry.
 2006-06-12 21:50:21 +00:00
Sears Russell
27f7df6f09 Fixed races on flushedLSN and page->dirty. 2006-06-12 20:05:28 +00:00
Sears Russell
29662b7e06 removed dead field from TransactionLog 2006-05-25 22:24:13 +00:00
Sears Russell
b5d578f4e0 Fixed remaining warnings, got rid of alTupdate 2006-05-25 20:08:12 +00:00
Sears Russell
fda416090b Fixed a bunch of 'easy' warnings 2006-05-25 00:02:46 +00:00
Sears Russell
827e0d891a The linear hashtable implementation (to replace pbl's) 2006-05-24 02:23:58 +00:00
Sears Russell
2e06cafaa8 2006-05-24 02:19:04 +00:00
Sears Russell
f06159b3cd forgot to add these... 2006-05-19 20:17:44 +00:00
Sears Russell
ef43d5e4ce Implemented log truncation. 2006-04-14 03:45:26 +00:00
Sears Russell
11c311bc91 Added support for raw pages, implemented posix_memalign workaround, and re-enabled O_DIRECT by default 2006-04-12 01:41:35 +00:00
Sears Russell
c29b16a6ed Created new module, bufferPool, and moved memory management for page structs to it. 2006-04-11 20:34:52 +00:00
Sears Russell
c1d8906d28 removed memcpy() calls from inMemoryLog; added "const" qualifier to many LogEntry pointers. 2006-04-11 02:20:21 +00:00
Sears Russell
d3d7f2c788 Implemented "LOG_TO_MEMORY", which mostly works (linear hash NTA goes into an infinite loop....) 2006-04-07 03:40:40 +00:00
Sears Russell
1c979f3052 Factored logWriter.h out of the rest of the system. The only file that directly depends on it is logger2.c, which can 
now dispatch requests to different (hardcoded) log implementations.
 2006-04-06 03:22:57 +00:00
Sears Russell
6898b2a2a6 recordid.size is now a signed 64-bit int 2006-04-04 22:31:59 +00:00
Sears Russell
ced022d0fe partial fixes 2006-03-28 20:15:31 +00:00
Sears Russell
bb37db0857 Partial port to amd64. 2006-03-20 23:11:46 +00:00
Colleen M. Lewis
345f0cde78 Added the base functionality and test case for the BTree... just a hello world method. but it has the h, c and check files. -colleen ;) 2005-05-05 21:34:12 +00:00
Sears Russell
cf58e1fb72 Transitive closure working! 2005-03-24 04:43:22 +00:00
Sears Russell
ee9eb416ea Implemented fifo pool that allocates entries out of a pool (it should be easy to extend this to avoid deadlock, while allowing it to continue to provide backpressure) 2005-03-23 08:07:53 +00:00
Sears Russell
9656ce1a55 forgot to commit this... 2005-03-21 08:56:30 +00:00
Sears Russell
97bf995022 changes for diff, commit prior to deleteing a lot of old bdb cruft 2005-03-18 23:26:25 +00:00
Sears Russell
d8eb6c9aa7 Major benchmark update; log force merging. 2005-03-17 04:38:55 +00:00
Sears Russell
bf4be359b3 Partially refactored logMemory and multiplexer into a fifo implementation. Added support to fifoPool for 
asynchronous threads running round-robin through the dirty fifos consuming entries in idle ones.
 2005-03-16 00:52:21 +00:00
Sears Russell
dffff067bb multiplexer and fifo are now working. (also added removed some timeouts from tests that were timing out) 2005-03-15 05:30:57 +00:00
Sears Russell
602608b60b Adding new files for jimmy... 2005-03-15 01:29:04 +00:00
Jimmy Kittiyachavalit
80ed16c18e Initial implementation of logMemory.c. Haven't yet done any testing, but it seems to compile. However, as of now, the current source code in the cvs repository does not build, dying on check_<somehting (I think ringbuffer.x)>, due to an a reference to an undefined symbol 'mutex'. 2005-03-14 20:54:06 +00:00
Sears Russell
7971df14bf Bugfixes (compiles now) 2005-03-14 08:47:13 +00:00
Sears Russell
9be3c4edd3 Initial upload of (untested) multiplexer implementation. 2005-03-14 00:58:47 +00:00
Sears Russell
ed49949512 This commit breaks the build so that Jimmy and I can sync. Sorry. :( 2005-03-14 00:25:29 +00:00
Sears Russell
692880f4f4 Initial version of consumer.h (accidentally uploaded an empty file last time..) 2005-03-13 20:39:32 +00:00
Sears Russell
1bfb634103 Preliminary benchmark program uploads for SEDA-style response time percentiles vs requests / second 
Also added a few cute little utilities:
  - truncate_log
  - run_recovery

Upped max # of concurrent transactions.  (Current throughput during benchmarking remains ~flat up to 32,000
threads, but past max concurrent transactions was 1,000...)
 2005-03-12 22:11:18 +00:00
Sears Russell
f28df29736 Fixed unit tests, added iterator interface, and generic (almost) iterator test harness. 2005-03-10 03:19:04 +00:00
Sears Russell
e22d4b8e59 Partial implementation of ringbuffer for in-memory long, among other things. 2005-03-08 07:53:53 +00:00
Sears Russell
c8a0aa830e Compiles on FreeBSD! 2005-03-02 05:46:29 +00:00
Sears Russell
3e5f7aea8a Bugfixes for OASYS. 2005-03-01 07:32:02 +00:00
Sears Russell
3b88909c5f Fixed compensations test; FreeBSD fix (?) for makefile. 2005-02-28 00:00:17 +00:00
Sears Russell
890a7385d0 Fixeds cht test / finished error checking within LLADD, but haven't tested error handling yet. 2005-02-24 21:12:36 +00:00
Sears Russell
29dacbe7ed Error handling for linked list. 2005-02-22 23:11:03 +00:00
Sears Russell
41fb85eef0 More error handling... 2005-02-22 03:10:54 +00:00
Sears Russell
84a20a3c96 Started adding error handling code to LLADD. 2005-02-16 04:11:14 +00:00
Sears Russell
f4484e35b5 Update for perl script; added return type handling. 2005-02-16 02:13:54 +00:00
Sears Russell
fdf5344ec3 Implemented 'compensations' for C. They're not proper compensations, but they're more flexible than pthread's mechanisms, as they allow the stack to be partially rolled up. (Although calling functions need to either check for errors and return manually, or wrap calls to error-producing callees in a begin_action{ }end_action block. 2005-02-14 02:49:59 +00:00
Sears Russell
b8a67cbfb2 Numerous lock manager fixes; more realistic test case for lock manager, added support for optional page-level locking.(Still need to report deadlocks back up to the caller.) 2005-02-10 03:51:09 +00:00
Sears Russell
6f022cc577 Some random code cleanups, and implemented a naive lock manager. (Still need to tie it into LLADD...) 2005-02-09 02:53:14 +00:00
Sears Russell
258dd5f4c4 Fixed up some return values; tests now pass with assert disabled. 2005-02-08 01:13:57 +00:00
Sears Russell
a4c13449b8 Bugfix for pageOrientedList. 2005-01-31 02:18:46 +00:00
Sears Russell
bb69197a65 Fixed blob implementation (it was impossible to distinguish between a blob and a record of length 12), removed jbhash, and ported cht to linearHashNTA. 2005-01-31 01:29:52 +00:00
Sears Russell
7cf5fdee6e Re-implemented pageOrientedListNTA from scratch. It's now more flexible, but relies on features that are not provided by Talloc/Tdealloc, so performance isn't as good as it could be. 2005-01-29 01:17:37 +00:00
Sears Russell
56d98adcbf Working, but slow and non-concurrent variable length key/value support for linear hashtable. 2005-01-28 21:28:23 +00:00
Sears Russell
17f76264aa Implemented pageOrientedList, also did some bug fixing, and added some support functions to alloc.c 2005-01-28 03:32:17 +00:00
Sears Russell
5a2d2bde31 More documentation updates. 2005-01-21 02:13:17 +00:00
Sears Russell
b04e71360f Documentation update. 2005-01-20 21:19:47 +00:00
Sears Russell
ac0d413e58 - linkedListNTA is now re-entrant. 
- linearHashNTA now uses nested top actions, is re-entrant, and supports a
  non-re-entrant iterator
- 'recursive' nested top actions allow nested top actions to be nested within each
  other.
 2005-01-15 01:45:27 +00:00
Sears Russell
7a990886d2 The linked list implementation now uses nested top actions. (Also, many bugfixes regarding nested top actions were introduced.) 2005-01-14 10:08:10 +00:00
Sears Russell
360f0d15e2 Working, non-concurrent linear hash and linked list implementations. 
The idea is to implement the non-concurrent versions, and then convert
them to concurrent versions using nested top actions.
 2005-01-14 01:52:53 +00:00
Sears Russell
6198522971 Starting to rip the old jbhash implementation out, and replace it with a 
linear hash implementation.  In particular, I've implemented (sort of) an
iterator for linear hash, and (sort of) ported libdfa to linearhash.c

I say 'sort of' since this functionality is broken with this commit.  On the other hand, CVS should build now, and the tests under lladd will pass.  libdfa's new tests don't pass at the moment.
 2005-01-10 03:02:02 +00:00
Sears Russell
72070acb67 Implemented TsetRange, fixed bug in linear hash. 2004-12-03 00:27:47 +00:00
Sears Russell
443a90ad7c Implemented TrecordType() 2004-12-01 01:26:25 +00:00
Sears Russell
ded5c92c9d Support for nested top actions, with simple unit test. (Haven't tested for thread safety yet.) 2004-11-29 21:28:13 +00:00
Sears Russell
646f9dfca9 Implemented recover_split(), which is needed by the linear hash to recover properly from crashes. It hasn't been tested at all, and is not currently called by anything. 2004-11-29 02:35:37 +00:00
Sears Russell
2c23fb8a43 Did some misc. cleanup work on linearHash 2004-11-28 01:16:48 +00:00
Sears Russell
e05286c9c5 set this back to old value. 2004-10-20 21:36:39 +00:00
Sears Russell
70b8aca134 Set some constants to values appropriate for my desktop. 2004-10-20 06:48:29 +00:00
Sears Russell
af9e7adee0 Starting work on the actual graph-generation portion of the benchmarks. :) 2004-10-20 06:21:21 +00:00
Sears Russell
ec99c0e258 Lots of optimizations; re-did on-disk layout for the linear hash table. 2004-10-19 21:16:37 +00:00
Sears Russell
6b265f28b0 Speedups, most notably in the logging subsystem. 2004-10-19 04:45:42 +00:00
Sears Russell
ec1276f26f Preliminary version of logical logging linear hash. (No latching yet, and there are some bugs re-opening a closed hash.) 2004-10-18 18:24:54 +00:00
Sears Russell
04cfc7da8e Optimized the 'naive' linear hash table, and moved to sourceforge. :) 2004-10-17 02:17:00 +00:00
Sears Russell
a078f25475 Implemented a linear hash from scratch. Concurrency hasn't been done, but it's probably correct in the single thread case. 2004-10-12 02:44:47 +00:00
Sears Russell
5064e3fac2 Implemented pages that store fixed sized records efficiently, and a java-style ArrayList data structure that efficiently supports (relatively) clustered, O(1) access time expandable arrays. (This will be used for the hash implementation...) 2004-10-06 06:08:09 +00:00
Sears Russell
96e7af92a4 Added test cases for Tprepare(), implemented some redo-only operations, and started to clean up record allocation/deallocation. 
Also, numerous bugfixes.
 2004-10-02 07:29:34 +00:00
Sears Russell
811bc5c710 Implemented a freespace manager that should safely allocate space, even in the face of crashes, and can reclaim unused space (unless an application opens more than one simultaneous transaction that performs allocations) 
Fixed some blob bugs (by adding extra fdatasync() calls).

Began factoring out the page management code so that it is an extenstion, and a less integral part of lladd.
 2004-08-21 00:03:30 +00:00
Sears Russell
b4d7883f66 Fixed regressions, major update of page / slotted interfaces in anticipation of moving LLADD towards a generic transactional page system. 2004-08-17 01:46:17 +00:00
Sears Russell
82e3fdb53a Added (untested) support for whole-page operations, lladdhash now works. 2004-08-03 02:04:56 +00:00
Sears Russell
e51759b517 Implemented indirect pages, and fixed some bugs here and there. (Still need to add transactional support for indirect pages...) 2004-07-31 00:27:55 +00:00
Sears Russell
961b63af15 Rewrote / refactored page.h. Now, it uses a freelist to reclaim slotid's within a page, and is implemented as two seperate modules. The first handles lsn's, and (will soon) check the type of each page, and then delegate work to a particular implementation of the second module. 2004-07-30 01:28:39 +00:00
Sears Russell
c649ba7504 O_DIRECT is working now. 2004-07-27 22:04:59 +00:00
Sears Russell
78eb2cbf6a O_DIRECT (sort of...) 2004-07-27 21:30:54 +00:00
Sears Russell
54ba9b0347 Refactored bufferMananger / pageCache, so that bufferMananger handles loading an unloading pages, and pageCache only implements the replacement policy. 
Also, used memprof to detect and remove all memory leaks (at least all memory leaks that are encountered by check_transactional2), and fixed a number of misuses of the pblHash.
 2004-07-27 01:04:35 +00:00
Sears Russell
8cb59f0c23 Blobs are now re-entrant. 2004-07-26 20:37:04 +00:00
Sears Russell
422198418a bufferMananger is (really!) re-entrant now, performed big refactoring to prevent deadlocks, check_transactional2 ran overnight without coring, w/ 25 threads, and 10000 allocate/write/reads per thread. (The whole test suite was run in a loop...) 2004-07-23 20:21:44 +00:00
Sears Russell
126ae31392 bufferMananger is *really* reentrant now! (I think) However, the same thread may not load a page more than once. So, LLADD has to be altered so that it never calls loadPage() more than once per operation (more efficient), and/or pin/unpin need to be implemented. An easy way to do pin/unpin is to have them pull things out of the cache replacement list, and then re-insert them. 2004-07-21 02:13:28 +00:00
Sears Russell
0ce77903fb Continuing work on multi-threading. r/w access to buffer manager getting close, but still buggy. 2004-07-20 03:40:57 +00:00
Sears Russell
490dd86c09 pageCache.c is now re-entrant. 2004-07-20 00:15:17 +00:00
Sears Russell
12fc5665ab pageCache is now re-entrant, in theory. 2004-07-15 00:42:36 +00:00
Sears Russell
9712e291e6 Moved page.h and some of the logging headers out of the public API. 2004-07-14 21:25:59 +00:00
Sears Russell
2b42451280 Cleaning up bufferManager / page for locking. Want to limit access to the Page struct. 2004-07-14 20:49:18 +00:00
Sears Russell
475b8141d3 page.c is re-entrant (mostly), and now reuses DeRalloced space properly. (For now, BufferManager still is not re-entrant, and also prevents space from being reused.) 2004-07-13 23:48:20 +00:00
Sears Russell
282d284035 Made pageWriteLSN static. 2004-07-09 22:05:33 +00:00