greg/stasis-aries-wal
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
934 commits 3 branches 1 tag 14 MiB
Commit graph

430 commits

Author SHA1 Message Date
Sears Russell
ac0d413e58 - linkedListNTA is now re-entrant. 
- linearHashNTA now uses nested top actions, is re-entrant, and supports a
  non-re-entrant iterator
- 'recursive' nested top actions allow nested top actions to be nested within each
  other.
 2005-01-15 01:45:27 +00:00
Sears Russell
7a990886d2 The linked list implementation now uses nested top actions. (Also, many bugfixes regarding nested top actions were introduced.) 2005-01-14 10:08:10 +00:00
Sears Russell
360f0d15e2 Working, non-concurrent linear hash and linked list implementations. 
The idea is to implement the non-concurrent versions, and then convert
them to concurrent versions using nested top actions.
 2005-01-14 01:52:53 +00:00
Sears Russell
6198522971 Starting to rip the old jbhash implementation out, and replace it with a 
linear hash implementation.  In particular, I've implemented (sort of) an
iterator for linear hash, and (sort of) ported libdfa to linearhash.c

I say 'sort of' since this functionality is broken with this commit.  On the other hand, CVS should build now, and the tests under lladd will pass.  libdfa's new tests don't pass at the moment.
 2005-01-10 03:02:02 +00:00
Sears Russell
c45ed9f5d5 Network configuration parser is working 2005-01-02 01:37:05 +00:00
Sears Russell
6fa948cd74 Partially implemented config file parser. Validates, but does not populate NetworkSetup object yet. 2004-12-30 23:07:47 +00:00
Gilad Arnold
f119717b5e Bugfix: identification of non-persistent objects in recursive updates 
was bogus.
 2004-12-17 02:22:36 +00:00
Gilad Arnold
79f14a1230 Added some debug traces. 2004-12-17 02:20:28 +00:00
Gilad Arnold
819522d008 Bugfix: now reading the full object before comparing with memory image, 
upon recursive update.
 2004-12-17 02:11:25 +00:00
Gilad Arnold
06dcd82a7d Bugfix: size of temporary buffer increases until it can contain the 
currently traversed object.
 2004-12-17 01:50:37 +00:00
Gilad Arnold
6358b74bac Added some debug line. 2004-12-17 01:45:09 +00:00
Gilad Arnold
635561981a Bugfix: dump type info upon set_ref, is it has been (implicitly) change. 2004-12-17 01:32:19 +00:00
Gilad Arnold
879ca42890 Support for TsetRange(), to minimize logging overhead when only portions 
of objects are known to be modified.
 2004-12-17 00:38:52 +00:00
Gilad Arnold
a7b1b70f74 Added persistified recursive updates. Should be tested. 2004-12-16 23:41:57 +00:00
Gilad Arnold
58bed5beca Some changes to pobj.c to support operations for non-persistent (transient) 
objects. Enhancement to test-list program to work with transient objects
as well. Minor fix to header file (typo).
 2004-12-16 23:04:21 +00:00
Gilad Arnold
91eb96a113 Some changes: initial support for (un)persistify, range update, pobj_memset, 
IS_PERSISTENT macro. Most are not yet tested, but compilation is okay...
 2004-12-16 16:50:15 +00:00
Gilad Arnold
6502569a02 Switched to growable (unlimited) persistent objects / static references 
repositories. Has been tested with 15K objects and appears to work. Also
done some significant chnages to auxiliary modules in libpobj, and the
trivial test program (test-list).
 2004-12-16 09:00:07 +00:00
Gilad Arnold
e30aca6138 Temporary fix to avoid a segfault during execution of pobj test 
programs, that's caused by an on-stack allocation of a very big array...
Permanent (future) fix: switch to dynamically allocated hash tables.
 2004-12-15 01:27:17 +00:00
Gilad Arnold
36a0821acf Beginning to add strict typing for objects (minor change). 2004-12-14 19:45:04 +00:00
Gilad Arnold
773df6c690 Added custom memory calls for pobj internal structures. 2004-12-14 07:38:04 +00:00
Gilad Arnold
8137a0914d Disabled some development code in pobj.c, just so it passes compilation. 2004-12-14 01:33:25 +00:00
Gilad Arnold
4329801481 Removed redundant variable from Makefile.am. 2004-12-14 01:24:34 +00:00
Gilad Arnold
fc42d83efc Added pobj library sources, header file, and test programs. Small changes were 
made to src/Makefile.am in order to include src/pobj build, but no corresponding
change was made to test/Makefile.am (will be done in the near future).
 2004-12-13 21:51:11 +00:00
Sears Russell
55b0ddf1b6 Fixed nasty bug that was causing the LLADD header to be lost (!!) 2004-12-06 01:20:48 +00:00
Sears Russell
72070acb67 Implemented TsetRange, fixed bug in linear hash. 2004-12-03 00:27:47 +00:00
Sears Russell
443a90ad7c Implemented TrecordType() 2004-12-01 01:26:25 +00:00
Sears Russell
ded5c92c9d Support for nested top actions, with simple unit test. (Haven't tested for thread safety yet.) 2004-11-29 21:28:13 +00:00
Sears Russell
646f9dfca9 Implemented recover_split(), which is needed by the linear hash to recover properly from crashes. It hasn't been tested at all, and is not currently called by anything. 2004-11-29 02:35:37 +00:00
Sears Russell
2c23fb8a43 Did some misc. cleanup work on linearHash 2004-11-28 01:16:48 +00:00
Sears Russell
164c7cfd69 Linear Hash now survives Tdeinit/Tinit cycle (but not crashes!) 2004-11-24 23:26:15 +00:00
Sears Russell
80d4af4c9b Added getRecordType() 2004-11-24 23:25:36 +00:00
Sears Russell
910649a387 Web-site update, a few minor code changes from before the Freenix deadline. 2004-10-27 01:40:09 +00:00
Sears Russell
aead6a5a83 New benchmark, fixed for PROFILE_LATCHES. 2004-10-20 21:55:00 +00:00
Sears Russell
b59ba35ed4 parameter tweak.. 2004-10-20 06:54:39 +00:00
Sears Russell
70b8aca134 Set some constants to values appropriate for my desktop. 2004-10-20 06:48:29 +00:00
Sears Russell
af9e7adee0 Starting work on the actual graph-generation portion of the benchmarks. :) 2004-10-20 06:21:21 +00:00
Sears Russell
903ba4b97b Bugfix. 2004-10-19 22:58:56 +00:00
Sears Russell
ec99c0e258 Lots of optimizations; re-did on-disk layout for the linear hash table. 2004-10-19 21:16:37 +00:00
Sears Russell
6b265f28b0 Speedups, most notably in the logging subsystem. 2004-10-19 04:45:42 +00:00
Sears Russell
c850ce3a51 The logger now calls fwrite half as often as it used to. This could be improved significantly, but some latching details internal to the logger need to be worked out first. 2004-10-18 19:19:10 +00:00
Sears Russell
ec1276f26f Preliminary version of logical logging linear hash. (No latching yet, and there are some bugs re-opening a closed hash.) 2004-10-18 18:24:54 +00:00
Sears Russell
04cfc7da8e Optimized the 'naive' linear hash table, and moved to sourceforge. :) 2004-10-17 02:17:00 +00:00
Sears Russell
a078f25475 Implemented a linear hash from scratch. Concurrency hasn't been done, but it's probably correct in the single thread case. 2004-10-12 02:44:47 +00:00
Sears Russell
5064e3fac2 Implemented pages that store fixed sized records efficiently, and a java-style ArrayList data structure that efficiently supports (relatively) clustered, O(1) access time expandable arrays. (This will be used for the hash implementation...) 2004-10-06 06:08:09 +00:00
Sears Russell
9268b1d9cf Added support for gcov, and ran gprof. Shaved 10% off the runtime of check_page by optimizing rw.c 2004-10-04 05:24:12 +00:00
Sears Russell
96e7af92a4 Added test cases for Tprepare(), implemented some redo-only operations, and started to clean up record allocation/deallocation. 
Also, numerous bugfixes.
 2004-10-02 07:29:34 +00:00
Sears Russell
811bc5c710 Implemented a freespace manager that should safely allocate space, even in the face of crashes, and can reclaim unused space (unless an application opens more than one simultaneous transaction that performs allocations) 
Fixed some blob bugs (by adding extra fdatasync() calls).

Began factoring out the page management code so that it is an extenstion, and a less integral part of lladd.
 2004-08-21 00:03:30 +00:00
Sears Russell
b4d7883f66 Fixed regressions, major update of page / slotted interfaces in anticipation of moving LLADD towards a generic transactional page system. 2004-08-17 01:46:17 +00:00
Sears Russell
82e3fdb53a Added (untested) support for whole-page operations, lladdhash now works. 2004-08-03 02:04:56 +00:00
Sears Russell
e51759b517 Implemented indirect pages, and fixed some bugs here and there. (Still need to add transactional support for indirect pages...) 2004-07-31 00:27:55 +00:00
Sears Russell
a74c499dd7 Fixed data corruption bug in the freelist implementation, and corrected lsn updates. 2004-07-30 02:07:41 +00:00
Sears Russell
961b63af15 Rewrote / refactored page.h. Now, it uses a freelist to reclaim slotid's within a page, and is implemented as two seperate modules. The first handles lsn's, and (will soon) check the type of each page, and then delegate work to a particular implementation of the second module. 2004-07-30 01:28:39 +00:00
Sears Russell
c649ba7504 O_DIRECT is working now. 2004-07-27 22:04:59 +00:00
Sears Russell
3cbe112926 Moved some utility functions into their own file. 2004-07-27 21:33:00 +00:00
Sears Russell
78eb2cbf6a O_DIRECT (sort of...) 2004-07-27 21:30:54 +00:00
Sears Russell
54ba9b0347 Refactored bufferMananger / pageCache, so that bufferMananger handles loading an unloading pages, and pageCache only implements the replacement policy. 
Also, used memprof to detect and remove all memory leaks (at least all memory leaks that are encountered by check_transactional2), and fixed a number of misuses of the pblHash.
 2004-07-27 01:04:35 +00:00
Sears Russell
e53117a1a0 Implemented (but didn't test) iterator over the records in a page. 2004-07-26 22:01:09 +00:00
Sears Russell
8cb59f0c23 Blobs are now re-entrant. 2004-07-26 20:37:04 +00:00
Sears Russell
422198418a bufferMananger is (really!) re-entrant now, performed big refactoring to prevent deadlocks, check_transactional2 ran overnight without coring, w/ 25 threads, and 10000 allocate/write/reads per thread. (The whole test suite was run in a loop...) 2004-07-23 20:21:44 +00:00
Sears Russell
38ae73c146 Just committing some documentation updates before big refactoring. 2004-07-22 17:48:36 +00:00
Sears Russell
126ae31392 bufferMananger is *really* reentrant now! (I think) However, the same thread may not load a page more than once. So, LLADD has to be altered so that it never calls loadPage() more than once per operation (more efficient), and/or pin/unpin need to be implemented. An easy way to do pin/unpin is to have them pull things out of the cache replacement list, and then re-insert them. 2004-07-21 02:13:28 +00:00
Sears Russell
0ce77903fb Continuing work on multi-threading. r/w access to buffer manager getting close, but still buggy. 2004-07-20 03:40:57 +00:00
Sears Russell
490dd86c09 pageCache.c is now re-entrant. 2004-07-20 00:15:17 +00:00
Sears Russell
12fc5665ab pageCache is now re-entrant, in theory. 2004-07-15 00:42:36 +00:00
Sears Russell
9712e291e6 Moved page.h and some of the logging headers out of the public API. 2004-07-14 21:25:59 +00:00
Sears Russell
2b42451280 Cleaning up bufferManager / page for locking. Want to limit access to the Page struct. 2004-07-14 20:49:18 +00:00
Sears Russell
475b8141d3 page.c is re-entrant (mostly), and now reuses DeRalloced space properly. (For now, BufferManager still is not re-entrant, and also prevents space from being reused.) 2004-07-13 23:48:20 +00:00
Sears Russell
282d284035 Made pageWriteLSN static. 2004-07-09 22:05:33 +00:00
Sears Russell
d564b9ded6 More documentation fixes. 2004-07-06 21:41:33 +00:00
Sears Russell
370ad33210 Fixed groupings for LLADD API docs. 2004-07-06 20:59:36 +00:00
Sears Russell
e1d3bf7a0c Ported LLADD to Fedora, cleaned up autoconf setup, and numerouse #includes that were problematic. 2004-07-06 01:22:18 +00:00
Sears Russell
f8015a5687 Documentation update, added latch profiling tools. 2004-07-04 00:46:49 +00:00
Sears Russell
3349dbc6dc Log truncation. (But no checkpoints, so it doesn't get called... it does pass testing though. :) 2004-07-01 00:53:36 +00:00
Sears Russell
af152bd08e Logwriter can now handler partial log entries correctly (it ignores them) 
Buffer Mananger no longer steals pages pre-maturely
Alloc is an operation, and correct.
Caching broken out into a new module
Wrote a utility to translate a log file into human-readable ascii.
 2004-06-30 01:09:57 +00:00
Sears Russell
c4fac084b8 Cleaned out old cruft, such as commented out code, dead data structures, and dead files. sloccount went from $75,000 to $50,000 on src/lladd. ;) 2004-06-28 22:48:02 +00:00
Sears Russell
fab0e6cbbd Bugfixes ; blobs pass regression. Next stop: Delete old cruft. 2004-06-28 21:10:10 +00:00
Sears Russell
7e2f1fc5b2 Wrote blobmanager, didn't compile it yet. 2004-06-26 02:05:24 +00:00
Sears Russell
0f4dc72e18 blob manager commit. 2004-06-25 18:59:24 +00:00
Sears Russell
e083a333b7 Preliminary implementation of blobManager 2004-06-25 18:56:43 +00:00
Sears Russell
d1f76f0b4a Initial revision 2004-06-24 21:10:31 +00:00