Sears Russell
ee9eb416ea
Implemented fifo pool that allocates entries out of a pool (it should be easy to extend this to avoid deadlock, while allowing it to continue to provide backpressure)
2005-03-23 08:07:53 +00:00
Sears Russell
ef3c30b190
Benchmark updates.
2005-03-20 05:17:25 +00:00
Sears Russell
d8eb6c9aa7
Major benchmark update; log force merging.
2005-03-17 04:38:55 +00:00
Sears Russell
3812f36e6b
now spawns multipler cleaner threads, and checks both for duplicated log entries and dropped log entries.
2005-03-16 00:59:38 +00:00
Sears Russell
dffff067bb
multiplexer and fifo are now working. (also added removed some timeouts from tests that were timing out)
2005-03-15 05:30:57 +00:00
Sears Russell
ed9b978bda
Another commit on behalf of jimmy. (Fixing the build is hard!)
2005-03-15 01:57:43 +00:00
Sears Russell
f5ff26b233
Added commit() call to inner while loop of linearHashNTAWriteRequests.c
2005-03-14 20:04:44 +00:00
Sears Russell
6547cadfc6
Test case for multiplexer (may not work..)
2005-03-14 08:49:35 +00:00
Sears Russell
7971df14bf
Bugfixes (compiles now)
2005-03-14 08:47:13 +00:00
Sears Russell
34bfccb439
Portability fixes for FreeBSD and Mac OS. Check broke compatibility w/
...
old versions; added #ifdef so that both versions of check will work.
2005-03-13 02:24:01 +00:00
Sears Russell
f28df29736
Fixed unit tests, added iterator interface, and generic (almost) iterator test harness.
2005-03-10 03:19:04 +00:00
Sears Russell
935de3aeb5
minor changes
2005-03-09 03:24:36 +00:00
Sears Russell
a3112ee81c
Fixes for freebsd.
2005-03-02 05:47:38 +00:00
Sears Russell
9471b92e1b
forgot to add this earlier...
2005-03-02 05:14:59 +00:00
Sears Russell
3e5f7aea8a
Bugfixes for OASYS.
2005-03-01 07:32:02 +00:00
Sears Russell
3b88909c5f
Fixed compensations test; FreeBSD fix (?) for makefile.
2005-02-28 00:00:17 +00:00
Sears Russell
890a7385d0
Fixeds cht test / finished error checking within LLADD, but haven't tested error handling yet.
2005-02-24 21:12:36 +00:00
Sears Russell
41fb85eef0
More error handling...
2005-02-22 03:10:54 +00:00
Sears Russell
84a20a3c96
Started adding error handling code to LLADD.
2005-02-16 04:11:14 +00:00
Sears Russell
fdf5344ec3
Implemented 'compensations' for C. They're not proper compensations, but they're more flexible than pthread's mechanisms, as they allow the stack to be partially rolled up. (Although calling functions need to either check for errors and return manually, or wrap calls to error-producing callees in a begin_action{ }end_action block.
2005-02-14 02:49:59 +00:00
Sears Russell
2ac1302062
Recovery now supports the lock manager. (And vice-versa ;)
2005-02-10 21:56:32 +00:00
Sears Russell
b8a67cbfb2
Numerous lock manager fixes; more realistic test case for lock manager, added support for optional page-level locking.(Still need to report deadlocks back up to the caller.)
2005-02-10 03:51:09 +00:00
Sears Russell
6f022cc577
Some random code cleanups, and implemented a naive lock manager. (Still need to tie it into LLADD...)
2005-02-09 02:53:14 +00:00
Gilad Arnold
815942ed4c
- some further API improvements (?).
2005-02-08 23:56:47 +00:00
Gilad Arnold
b2b0e8a9d4
- test_list2.c now issues a secondary init/shutdown sequence, just to make
...
sure that repeated init/shutdown works correctly.
2005-02-08 08:05:24 +00:00
Sears Russell
258dd5f4c4
Fixed up some return values; tests now pass with assert disabled.
2005-02-08 01:13:57 +00:00
Sears Russell
e33319175f
Fixed some cht bugs. Abort is flakey.
2005-02-06 03:48:12 +00:00
Sears Russell
a27787b2fa
Cluster hash table now allows transactions to contain multiple requests.
2005-02-03 02:01:23 +00:00
Sears Russell
24b644162f
Shortened test because it was painfully slow.
2005-02-02 02:10:17 +00:00
Sears Russell
a4c13449b8
Bugfix for pageOrientedList.
2005-01-31 02:18:46 +00:00
Sears Russell
1260710a27
Got rid of another broken hash implementation...
2005-01-31 01:34:29 +00:00
Sears Russell
bb69197a65
Fixed blob implementation (it was impossible to distinguish between a blob and a record of length 12), removed jbhash, and ported cht to linearHashNTA.
2005-01-31 01:29:52 +00:00
Sears Russell
7cf5fdee6e
Re-implemented pageOrientedListNTA from scratch. It's now more flexible, but relies on features that are not provided by Talloc/Tdealloc, so performance isn't as good as it could be.
2005-01-29 01:17:37 +00:00
Sears Russell
56d98adcbf
Working, but slow and non-concurrent variable length key/value support for linear hashtable.
2005-01-28 21:28:23 +00:00
Sears Russell
17f76264aa
Implemented pageOrientedList, also did some bug fixing, and added some support functions to alloc.c
2005-01-28 03:32:17 +00:00
Sears Russell
eed439d53a
CHT cleanup; integrated cht tests into make check.
2005-01-20 23:58:29 +00:00
Sears Russell
23539f446a
More-or-less working version of CHT. Needs a lot of performance/stability/code cleanup work.
2005-01-19 00:51:54 +00:00
Sears Russell
d7b846d370
CHT is starting to work.
2005-01-19 00:47:55 +00:00
Sears Russell
894e30085c
libdfa ported to new hash table implementation. (Uses nested top actions.)
2005-01-15 23:55:49 +00:00
Sears Russell
ac0d413e58
- linkedListNTA is now re-entrant.
...
- linearHashNTA now uses nested top actions, is re-entrant, and supports a
non-re-entrant iterator
- 'recursive' nested top actions allow nested top actions to be nested within each
other.
2005-01-15 01:45:27 +00:00
Sears Russell
7a990886d2
The linked list implementation now uses nested top actions. (Also, many bugfixes regarding nested top actions were introduced.)
2005-01-14 10:08:10 +00:00
Sears Russell
360f0d15e2
Working, non-concurrent linear hash and linked list implementations.
...
The idea is to implement the non-concurrent versions, and then convert
them to concurrent versions using nested top actions.
2005-01-14 01:52:53 +00:00
Sears Russell
6198522971
Starting to rip the old jbhash implementation out, and replace it with a
...
linear hash implementation. In particular, I've implemented (sort of) an
iterator for linear hash, and (sort of) ported libdfa to linearhash.c
I say 'sort of' since this functionality is broken with this commit. On the other hand, CVS should build now, and the tests under lladd will pass. libdfa's new tests don't pass at the moment.
2005-01-10 03:02:02 +00:00
Sears Russell
c45ed9f5d5
Network configuration parser is working
2005-01-02 01:37:05 +00:00
Sears Russell
6fa948cd74
Partially implemented config file parser. Validates, but does not populate NetworkSetup object yet.
2004-12-30 23:07:47 +00:00
Gilad Arnold
1627d00635
Added new test program + changes to make system. Tests recusive persisitifying
...
updates.
2004-12-16 23:51:21 +00:00
Gilad Arnold
d401010e27
Minor changes to test correct handling of non-persistent objects.
2004-12-16 23:12:23 +00:00
Gilad Arnold
d98c13de6d
Minor change to test-multilist to work with new POBJ_UPDATE macro.
2004-12-16 23:06:14 +00:00
Gilad Arnold
58bed5beca
Some changes to pobj.c to support operations for non-persistent (transient)
...
objects. Enhancement to test-list program to work with transient objects
as well. Minor fix to header file (typo).
2004-12-16 23:04:21 +00:00
Gilad Arnold
6502569a02
Switched to growable (unlimited) persistent objects / static references
...
repositories. Has been tested with 15K objects and appears to work. Also
done some significant chnages to auxiliary modules in libpobj, and the
trivial test program (test-list).
2004-12-16 09:00:07 +00:00
Gilad Arnold
3e720695a6
Minor fix to pobj test programs to comply with new init function.
2004-12-14 20:28:18 +00:00
A. Kamil Tanrikulu
99f85eb9c4
Added pobj test files.
2004-12-14 06:19:09 +00:00
Gilad Arnold
d69a1878b9
Last change to make test/pobj be built with the project.
2004-12-14 01:51:25 +00:00
Gilad Arnold
bcf99ae693
Small change to library list order (pobj depends on lladd).
2004-12-14 01:39:12 +00:00
Gilad Arnold
87403264f5
Minor changes due to pobj file location changes.
2004-12-14 01:36:48 +00:00
Gilad Arnold
88ec078368
Added Makefile.am for test/pobj.
2004-12-14 01:20:01 +00:00
Gilad Arnold
fc42d83efc
Added pobj library sources, header file, and test programs. Small changes were
...
made to src/Makefile.am in order to include src/pobj build, but no corresponding
change was made to test/Makefile.am (will be done in the near future).
2004-12-13 21:51:11 +00:00
Sears Russell
0b5aae7128
Test case for lost header fix.
2004-12-06 01:24:04 +00:00
Sears Russell
55b0ddf1b6
Fixed nasty bug that was causing the LLADD header to be lost (!!)
2004-12-06 01:20:48 +00:00
Sears Russell
72070acb67
Implemented TsetRange, fixed bug in linear hash.
2004-12-03 00:27:47 +00:00
Sears Russell
443a90ad7c
Implemented TrecordType()
2004-12-01 01:26:25 +00:00
Sears Russell
ded5c92c9d
Support for nested top actions, with simple unit test. (Haven't tested for thread safety yet.)
2004-11-29 21:28:13 +00:00
Sears Russell
d2864afa6f
Fixed indentation, added #define to allow number of iterations to be changed easily
2004-11-28 00:04:14 +00:00
Sears Russell
164c7cfd69
Linear Hash now survives Tdeinit/Tinit cycle (but not crashes!)
2004-11-24 23:26:15 +00:00
Sears Russell
f0dfa98b8e
Test case for new code that checks page type.
2004-11-24 23:23:01 +00:00
Sears Russell
910649a387
Web-site update, a few minor code changes from before the Freenix deadline.
2004-10-27 01:40:09 +00:00
Sears Russell
ec99c0e258
Lots of optimizations; re-did on-disk layout for the linear hash table.
2004-10-19 21:16:37 +00:00
Sears Russell
ec1276f26f
Preliminary version of logical logging linear hash. (No latching yet, and there are some bugs re-opening a closed hash.)
2004-10-18 18:24:54 +00:00
Sears Russell
a078f25475
Implemented a linear hash from scratch. Concurrency hasn't been done, but it's probably correct in the single thread case.
2004-10-12 02:44:47 +00:00
Sears Russell
5064e3fac2
Implemented pages that store fixed sized records efficiently, and a java-style ArrayList data structure that efficiently supports (relatively) clustered, O(1) access time expandable arrays. (This will be used for the hash implementation...)
2004-10-06 06:08:09 +00:00
Sears Russell
9268b1d9cf
Added support for gcov, and ran gprof. Shaved 10% off the runtime of check_page by optimizing rw.c
2004-10-04 05:24:12 +00:00
Sears Russell
96e7af92a4
Added test cases for Tprepare(), implemented some redo-only operations, and started to clean up record allocation/deallocation.
...
Also, numerous bugfixes.
2004-10-02 07:29:34 +00:00
Sears Russell
811bc5c710
Implemented a freespace manager that should safely allocate space, even in the face of crashes, and can reclaim unused space (unless an application opens more than one simultaneous transaction that performs allocations)
...
Fixed some blob bugs (by adding extra fdatasync() calls).
Began factoring out the page management code so that it is an extenstion, and a less integral part of lladd.
2004-08-21 00:03:30 +00:00
Sears Russell
b4d7883f66
Fixed regressions, major update of page / slotted interfaces in anticipation of moving LLADD towards a generic transactional page system.
2004-08-17 01:46:17 +00:00
Sears Russell
82e3fdb53a
Added (untested) support for whole-page operations, lladdhash now works.
2004-08-03 02:04:56 +00:00
Sears Russell
20e78dd0db
Test cases for indirect blocks.
2004-07-31 00:28:45 +00:00
Sears Russell
e51759b517
Implemented indirect pages, and fixed some bugs here and there. (Still need to add transactional support for indirect pages...)
2004-07-31 00:27:55 +00:00
Sears Russell
a74c499dd7
Fixed data corruption bug in the freelist implementation, and corrected lsn updates.
2004-07-30 02:07:41 +00:00
Sears Russell
961b63af15
Rewrote / refactored page.h. Now, it uses a freelist to reclaim slotid's within a page, and is implemented as two seperate modules. The first handles lsn's, and (will soon) check the type of each page, and then delegate work to a particular implementation of the second module.
2004-07-30 01:28:39 +00:00
Sears Russell
78eb2cbf6a
O_DIRECT (sort of...)
2004-07-27 21:30:54 +00:00
Sears Russell
54ba9b0347
Refactored bufferMananger / pageCache, so that bufferMananger handles loading an unloading pages, and pageCache only implements the replacement policy.
...
Also, used memprof to detect and remove all memory leaks (at least all memory leaks that are encountered by check_transactional2), and fixed a number of misuses of the pblHash.
2004-07-27 01:04:35 +00:00
Sears Russell
476cb7f1ca
Re-enabled non-blob tests.
2004-07-26 20:37:59 +00:00
Sears Russell
8cb59f0c23
Blobs are now re-entrant.
2004-07-26 20:37:04 +00:00
Sears Russell
422198418a
bufferMananger is (really!) re-entrant now, performed big refactoring to prevent deadlocks, check_transactional2 ran overnight without coring, w/ 25 threads, and 10000 allocate/write/reads per thread. (The whole test suite was run in a loop...)
2004-07-23 20:21:44 +00:00
Sears Russell
126ae31392
bufferMananger is *really* reentrant now! (I think) However, the same thread may not load a page more than once. So, LLADD has to be altered so that it never calls loadPage() more than once per operation (more efficient), and/or pin/unpin need to be implemented. An easy way to do pin/unpin is to have them pull things out of the cache replacement list, and then re-insert them.
2004-07-21 02:13:28 +00:00
Sears Russell
0ce77903fb
Continuing work on multi-threading. r/w access to buffer manager getting close, but still buggy.
2004-07-20 03:40:57 +00:00
Sears Russell
490dd86c09
pageCache.c is now re-entrant.
2004-07-20 00:15:17 +00:00
Sears Russell
12fc5665ab
pageCache is now re-entrant, in theory.
2004-07-15 00:42:36 +00:00
Sears Russell
9712e291e6
Moved page.h and some of the logging headers out of the public API.
2004-07-14 21:25:59 +00:00
Sears Russell
2b42451280
Cleaning up bufferManager / page for locking. Want to limit access to the Page struct.
2004-07-14 20:49:18 +00:00
Sears Russell
475b8141d3
page.c is re-entrant (mostly), and now reuses DeRalloced space properly. (For now, BufferManager still is not re-entrant, and also prevents space from being reused.)
2004-07-13 23:48:20 +00:00
Sears Russell
e1d3bf7a0c
Ported LLADD to Fedora, cleaned up autoconf setup, and numerouse #includes that were problematic.
2004-07-06 01:22:18 +00:00
Sears Russell
f8015a5687
Documentation update, added latch profiling tools.
2004-07-04 00:46:49 +00:00
Sears Russell
3349dbc6dc
Log truncation. (But no checkpoints, so it doesn't get called... it does pass testing though. :)
2004-07-01 00:53:36 +00:00
Sears Russell
af152bd08e
Logwriter can now handler partial log entries correctly (it ignores them)
...
Buffer Mananger no longer steals pages pre-maturely
Alloc is an operation, and correct.
Caching broken out into a new module
Wrote a utility to translate a log file into human-readable ascii.
2004-06-30 01:09:57 +00:00
Sears Russell
fab0e6cbbd
Bugfixes ; blobs pass regression. Next stop: Delete old cruft.
2004-06-28 21:10:10 +00:00
Sears Russell
7e2f1fc5b2
Wrote blobmanager, didn't compile it yet.
2004-06-26 02:05:24 +00:00
Sears Russell
e083a333b7
Preliminary implementation of blobManager
2004-06-25 18:56:43 +00:00
Sears Russell
d1f76f0b4a
Initial revision
2004-06-24 21:10:31 +00:00
