Commit graph

276 commits

Author SHA1 Message Date
Sears Russell
c86688884a Updates for 32-bit x86. There are still real 32-bit bugs being emitted as compiler warnings. 2006-11-07 20:36:59 +00:00
Sears Russell
8481e9cdd6 non_blocking is closer to working (it now flushes writes out in the background). This required some api changes. It still passes unit tests, but it's losing data on close()... 2006-10-28 03:33:02 +00:00
Sears Russell
faf55911df Added non-blocking io implementation. It doesn't actually work yet, but it passes the unit tests. ;) 2006-10-26 05:48:30 +00:00
Sears Russell
10b77729f5 Simple (blocking, poor truncation performance) file handle implementation. 2006-10-18 00:57:36 +00:00
Sears Russell
f2e7a6b3a8 Fixed bug (assert was calling a handle method with an outstanding read buffer). 2006-10-17 03:28:24 +00:00
Sears Russell
45ef627c49 Updated to build check_io.c 2006-10-13 09:03:32 +00:00
Sears Russell
80a4148543 First cut at a new io API, with an in-memory reference implementation + test case. 2006-10-13 04:39:03 +00:00
Sears Russell
e81bf95553 Added a 10 minute timeout. 2006-10-07 00:26:18 +00:00
Sears Russell
1575d97a6b Fixed recovery bug. TregionDealloc was being called during redo(), causing an assert to fail. Without the
assert, would have gone into infinite recursion.
2006-10-05 22:08:42 +00:00
Sears Russell
a3e3ad2453 Added a 20 minute timeout to prevent deadlocks and other problems from blocking the test. 2006-10-05 01:00:10 +00:00
Sears Russell
8092fcb5a5 Made test longer again. (The group commit signal strangeness was preventing it from terminating...) 2006-10-05 00:52:41 +00:00
Sears Russell
fce66d97f5 Less output for short tests; removed obsolete "rm blob[01]_file.txt" 2006-10-04 04:44:49 +00:00
Sears Russell
61c6c6ec2c Fixed compile warning. 2006-10-04 04:43:17 +00:00
Sears Russell
6e222e6259 Cleaned comments, output. 2006-10-04 04:34:23 +00:00
Sears Russell
58c99d52ba cleaned comments, output 2006-10-04 04:29:57 +00:00
Sears Russell
9169bfc075 Cleaned up comments and output. 2006-10-04 04:27:24 +00:00
Sears Russell
963b0d2b30 Updated for new logger API. 2006-10-04 04:22:31 +00:00
Sears Russell
8d93f9d7a9 More thorough multithreading, and truncation, re-opening tests. 2006-10-04 04:21:53 +00:00
Sears Russell
20060a099c Quieter output. 2006-10-04 03:48:08 +00:00
Sears Russell
f9eb6657b9 Simplistic checks to make sure log closes and reopens correctly. 2006-10-03 01:51:14 +00:00
Sears Russell
36157b5a51 Fixes for inMemoryLog 2006-09-27 20:37:56 +00:00
Sears Russell
17b21aedfa updates for new logger API. 2006-09-27 20:35:30 +00:00
Sears Russell
3dc35ff20d removed mysterious LSN = 0 lines. 2006-09-27 20:35:08 +00:00
Sears Russell
25d415decb Another attempt to avoid running out of space... 2006-09-26 20:22:20 +00:00
Sears Russell
fc4c22ec8a Fixed compile warning. 2006-09-25 22:33:52 +00:00
Sears Russell
986ee57020 More fixes to prevent tardis from running out of disk space. 2006-09-25 22:27:13 +00:00
Sears Russell
e434c35203 shortened test so that tardis will stop running out of space... 2006-09-13 19:53:45 +00:00
Sears Russell
32d21cd398 Fixed compiler warning... 2006-08-11 19:36:46 +00:00
Sears Russell
b615f0bc3e Towards 64-bit pageids. bufferManager can handle 64-bit offsets, but recordid.page is still 32 bit... 2006-08-11 19:31:42 +00:00
Sears Russell
33ca0d3254 Fix memory leak; initialize p.lockCount (for debugging) 2006-08-11 00:02:16 +00:00
Sears Russell
f74df8a0fe Test is more stringent now; it runs in roughly the same amount of time
becase pageFile.c is no longer using O_DIRECT.
2006-08-10 23:35:21 +00:00
Sears Russell
c413203ec8 Talloc() now reuses space when possible. It still needs to call slottedCompact() intelligentally. Also, allocationPolicy should support an extra tier
of pages, so it doesn't suggest ones that aren't already in the buffer pool unless it has to.
2006-07-29 00:56:54 +00:00
Sears Russell
78f7b5a12e Added tests for concurrent transactions + aborts(). Still doesn't test
latching, as it is single threaded.
2006-07-27 00:16:24 +00:00
Sears Russell
62abe94bf5 added fsckRegions(), and call it from the unit tests. 2006-07-25 22:23:15 +00:00
Sears Russell
89b45da869 Fixed a bunch of gcc type punned pointer warnings. 2006-07-25 21:14:33 +00:00
Sears Russell
35b0978859 Removed some debugging output. 2006-07-22 00:00:19 +00:00
Sears Russell
715f9c4395 Shorter runs for interactive unit testing. 2006-07-21 23:58:32 +00:00
Sears Russell
0725af91be Fixed page leak in Talloc(). 2006-07-21 01:07:09 +00:00
Sears Russell
3d8a5dbcd2 Unit test for region allocator. 2006-07-20 21:54:32 +00:00
Sears Russell
ffd3bd960b switched to region allocator, but TpageAlloc currently grabs its own region... 2006-07-20 01:29:39 +00:00
Sears Russell
eabb8010f4 minor change to aid in debugging 2006-06-21 00:41:47 +00:00
Sears Russell
c8c9b7af19 the logger understands special record types. (At least partially...); shortened blob tests, since the blob
implementation is fundamentally broken, and slow
2006-06-20 23:02:27 +00:00
Sears Russell
0c6c0ec50b Removed pbl header; fixed makefile bugs and the compilation warnings
they obscured.
2006-06-20 22:05:45 +00:00
Sears Russell
6485a4aae9 No more PBL. 2006-06-20 21:44:17 +00:00
Sears Russell
bbe16e3a59 Allow blob count to be set independently of record count 2006-06-20 21:41:39 +00:00
Sears Russell
5de8c9fc6e Changed test case output to avoid spurious errors in flamebox 2006-06-20 20:48:28 +00:00
Sears Russell
e14877821f Fixed blob bug. The reason it's so slow is that it's logging a preimage + postimage of each blob and then synchronously writing to a second copy each time the blob is
written to(!!!)
2006-06-20 00:03:38 +00:00
Sears Russell
dc8a3e5d60 Eliminated slottedPreRalloc 2006-06-16 00:05:44 +00:00
Sears Russell
ffac2d6362 minor changes to check_mutliplexer. It still doesn't work on multicore. 2006-06-15 22:30:27 +00:00
Sears Russell
50515ffd23 More steps toward factoring page allocation out of record allocation. 2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8 half-hearted attempt to fix -Wextra warnings... 2006-06-13 23:58:04 +00:00
Sears Russell
a3678aad5c Now AM_CFLAGS can be set by modifying GLOBAL_CFLAGS in the root
Makefile.am
2006-06-13 22:48:50 +00:00
Sears Russell
f53a46e788 removed heisenbug 2006-06-13 22:47:38 +00:00
Sears Russell
014c1e3e75 removed derefereneced void* 2006-06-13 22:47:04 +00:00
Sears Russell
164f84a533 fixed compiler warning. 2006-06-12 22:51:14 +00:00
Sears Russell
cef9e2c4ce Added settings for longer-running tests 2006-06-12 22:45:41 +00:00
Sears Russell
fd19036843 Added more complete hashtable test; fixed incorrect return value in LH_ENTRY(find) 2006-05-31 00:37:56 +00:00
Sears Russell
6138c77306 Documentation fix 2006-05-31 00:37:23 +00:00
Sears Russell
1d9f7b314f Added -fno-strict-aliasing to the CFLAGS for the unit tests... This is
easier than making all this code -O2 clean...  (The rest of lladd now
compiles without warning under -O2, so this seems like a good
tradeoff...)
2006-05-25 22:50:28 +00:00
Sears Russell
c45b384b3b was passing unitialized pointer into pthread_join... 2006-05-25 22:49:19 +00:00
Sears Russell
fda416090b Fixed a bunch of 'easy' warnings 2006-05-25 00:02:46 +00:00
Sears Russell
229a296f54 Disabled timeout; fixed compilation warning. 2006-05-24 23:25:01 +00:00
Sears Russell
03b5c12fdd test file for linear hash 2006-05-24 02:26:54 +00:00
Sears Russell
2e06cafaa8 2006-05-24 02:19:04 +00:00
Sears Russell
4c168d8fb2 Fixed truncation bugs, and a minor test case bug. 2006-05-22 23:59:02 +00:00
Sears Russell
ef43d5e4ce Implemented log truncation. 2006-04-14 03:45:26 +00:00
Sears Russell
c1d8906d28 removed memcpy() calls from inMemoryLog; added "const" qualifier to many LogEntry pointers. 2006-04-11 02:20:21 +00:00
Sears Russell
7decae7172 All tests that pass with LOG_TO_FILE now pass with LOG_TO_MEMORY, but LOG_TO_MEMORY is slow, and seems to be
killing malloc's performance for some reason.  (linearHashNTA spends many seconds in free() between unit
tests...)
2006-04-08 00:05:09 +00:00
Sears Russell
d3d7f2c788 Implemented "LOG_TO_MEMORY", which mostly works (linear hash NTA goes into an infinite loop....) 2006-04-07 03:40:40 +00:00
Sears Russell
91381bffc2 Switched from mixture of int and lsn_t to lsn_t 2006-04-04 23:00:08 +00:00
Sears Russell
ced022d0fe partial fixes 2006-03-28 20:15:31 +00:00
Sears Russell
0250ee4a0a Intialization bug 2006-03-28 20:14:04 +00:00
Sears Russell
bb37db0857 Partial port to amd64. 2006-03-20 23:11:46 +00:00
Colleen M. Lewis
a579da0a58 Insert method added to check_bTree.c 2005-11-08 20:55:18 +00:00
Colleen M. Lewis
497790ca9b Problem with FixedPageRecordSize shown in test file 2005-10-30 00:39:25 +00:00
Colleen M. Lewis
345f0cde78 Added the base functionality and test case for the BTree... just a hello world method. but it has the h, c and check files. -colleen ;) 2005-05-05 21:34:12 +00:00
Colleen M. Lewis
9fb39c14ce added bTree.c 2005-05-05 21:26:40 +00:00
Sears Russell
ee9eb416ea Implemented fifo pool that allocates entries out of a pool (it should be easy to extend this to avoid deadlock, while allowing it to continue to provide backpressure) 2005-03-23 08:07:53 +00:00
Sears Russell
ef3c30b190 Benchmark updates. 2005-03-20 05:17:25 +00:00
Sears Russell
d8eb6c9aa7 Major benchmark update; log force merging. 2005-03-17 04:38:55 +00:00
Sears Russell
3812f36e6b now spawns multipler cleaner threads, and checks both for duplicated log entries and dropped log entries. 2005-03-16 00:59:38 +00:00
Sears Russell
dffff067bb multiplexer and fifo are now working. (also added removed some timeouts from tests that were timing out) 2005-03-15 05:30:57 +00:00
Sears Russell
ed9b978bda Another commit on behalf of jimmy. (Fixing the build is hard!) 2005-03-15 01:57:43 +00:00
Sears Russell
f5ff26b233 Added commit() call to inner while loop of linearHashNTAWriteRequests.c 2005-03-14 20:04:44 +00:00
Sears Russell
6547cadfc6 Test case for multiplexer (may not work..) 2005-03-14 08:49:35 +00:00
Sears Russell
7971df14bf Bugfixes (compiles now) 2005-03-14 08:47:13 +00:00
Sears Russell
34bfccb439 Portability fixes for FreeBSD and Mac OS. Check broke compatibility w/
old versions; added #ifdef so that both versions of check will work.
2005-03-13 02:24:01 +00:00
Sears Russell
f28df29736 Fixed unit tests, added iterator interface, and generic (almost) iterator test harness. 2005-03-10 03:19:04 +00:00
Sears Russell
935de3aeb5 minor changes 2005-03-09 03:24:36 +00:00
Sears Russell
a3112ee81c Fixes for freebsd. 2005-03-02 05:47:38 +00:00
Sears Russell
9471b92e1b forgot to add this earlier... 2005-03-02 05:14:59 +00:00
Sears Russell
3e5f7aea8a Bugfixes for OASYS. 2005-03-01 07:32:02 +00:00
Sears Russell
3b88909c5f Fixed compensations test; FreeBSD fix (?) for makefile. 2005-02-28 00:00:17 +00:00
Sears Russell
890a7385d0 Fixeds cht test / finished error checking within LLADD, but haven't tested error handling yet. 2005-02-24 21:12:36 +00:00
Sears Russell
41fb85eef0 More error handling... 2005-02-22 03:10:54 +00:00
Sears Russell
84a20a3c96 Started adding error handling code to LLADD. 2005-02-16 04:11:14 +00:00
Sears Russell
fdf5344ec3 Implemented 'compensations' for C. They're not proper compensations, but they're more flexible than pthread's mechanisms, as they allow the stack to be partially rolled up. (Although calling functions need to either check for errors and return manually, or wrap calls to error-producing callees in a begin_action{ }end_action block. 2005-02-14 02:49:59 +00:00
Sears Russell
2ac1302062 Recovery now supports the lock manager. (And vice-versa ;) 2005-02-10 21:56:32 +00:00
Sears Russell
b8a67cbfb2 Numerous lock manager fixes; more realistic test case for lock manager, added support for optional page-level locking.(Still need to report deadlocks back up to the caller.) 2005-02-10 03:51:09 +00:00
Sears Russell
6f022cc577 Some random code cleanups, and implemented a naive lock manager. (Still need to tie it into LLADD...) 2005-02-09 02:53:14 +00:00
Gilad Arnold
815942ed4c - some further API improvements (?). 2005-02-08 23:56:47 +00:00
Gilad Arnold
b2b0e8a9d4 - test_list2.c now issues a secondary init/shutdown sequence, just to make
sure that repeated init/shutdown works correctly.
2005-02-08 08:05:24 +00:00
Sears Russell
258dd5f4c4 Fixed up some return values; tests now pass with assert disabled. 2005-02-08 01:13:57 +00:00
Sears Russell
e33319175f Fixed some cht bugs. Abort is flakey. 2005-02-06 03:48:12 +00:00
Sears Russell
a27787b2fa Cluster hash table now allows transactions to contain multiple requests. 2005-02-03 02:01:23 +00:00
Sears Russell
24b644162f Shortened test because it was painfully slow. 2005-02-02 02:10:17 +00:00
Sears Russell
a4c13449b8 Bugfix for pageOrientedList. 2005-01-31 02:18:46 +00:00
Sears Russell
1260710a27 Got rid of another broken hash implementation... 2005-01-31 01:34:29 +00:00
Sears Russell
bb69197a65 Fixed blob implementation (it was impossible to distinguish between a blob and a record of length 12), removed jbhash, and ported cht to linearHashNTA. 2005-01-31 01:29:52 +00:00
Sears Russell
7cf5fdee6e Re-implemented pageOrientedListNTA from scratch. It's now more flexible, but relies on features that are not provided by Talloc/Tdealloc, so performance isn't as good as it could be. 2005-01-29 01:17:37 +00:00
Sears Russell
56d98adcbf Working, but slow and non-concurrent variable length key/value support for linear hashtable. 2005-01-28 21:28:23 +00:00
Sears Russell
17f76264aa Implemented pageOrientedList, also did some bug fixing, and added some support functions to alloc.c 2005-01-28 03:32:17 +00:00
Sears Russell
eed439d53a CHT cleanup; integrated cht tests into make check. 2005-01-20 23:58:29 +00:00
Sears Russell
23539f446a More-or-less working version of CHT. Needs a lot of performance/stability/code cleanup work. 2005-01-19 00:51:54 +00:00
Sears Russell
d7b846d370 CHT is starting to work. 2005-01-19 00:47:55 +00:00
Sears Russell
894e30085c libdfa ported to new hash table implementation. (Uses nested top actions.) 2005-01-15 23:55:49 +00:00
Sears Russell
ac0d413e58 - linkedListNTA is now re-entrant.
- linearHashNTA now uses nested top actions, is re-entrant, and supports a
  non-re-entrant iterator
- 'recursive' nested top actions allow nested top actions to be nested within each
  other.
2005-01-15 01:45:27 +00:00
Sears Russell
7a990886d2 The linked list implementation now uses nested top actions. (Also, many bugfixes regarding nested top actions were introduced.) 2005-01-14 10:08:10 +00:00
Sears Russell
360f0d15e2 Working, non-concurrent linear hash and linked list implementations.
The idea is to implement the non-concurrent versions, and then convert
them to concurrent versions using nested top actions.
2005-01-14 01:52:53 +00:00
Sears Russell
6198522971 Starting to rip the old jbhash implementation out, and replace it with a
linear hash implementation.  In particular, I've implemented (sort of) an
iterator for linear hash, and (sort of) ported libdfa to linearhash.c

I say 'sort of' since this functionality is broken with this commit.  On the other hand, CVS should build now, and the tests under lladd will pass.  libdfa's new tests don't pass at the moment.
2005-01-10 03:02:02 +00:00
Sears Russell
c45ed9f5d5 Network configuration parser is working 2005-01-02 01:37:05 +00:00
Sears Russell
6fa948cd74 Partially implemented config file parser. Validates, but does not populate NetworkSetup object yet. 2004-12-30 23:07:47 +00:00
Gilad Arnold
1627d00635 Added new test program + changes to make system. Tests recusive persisitifying
updates.
2004-12-16 23:51:21 +00:00
Gilad Arnold
d401010e27 Minor changes to test correct handling of non-persistent objects. 2004-12-16 23:12:23 +00:00
Gilad Arnold
d98c13de6d Minor change to test-multilist to work with new POBJ_UPDATE macro. 2004-12-16 23:06:14 +00:00
Gilad Arnold
58bed5beca Some changes to pobj.c to support operations for non-persistent (transient)
objects. Enhancement to test-list program to work with transient objects
as well. Minor fix to header file (typo).
2004-12-16 23:04:21 +00:00
Gilad Arnold
6502569a02 Switched to growable (unlimited) persistent objects / static references
repositories. Has been tested with 15K objects and appears to work. Also
done some significant chnages to auxiliary modules in libpobj, and the
trivial test program (test-list).
2004-12-16 09:00:07 +00:00
Gilad Arnold
3e720695a6 Minor fix to pobj test programs to comply with new init function. 2004-12-14 20:28:18 +00:00
A. Kamil Tanrikulu
99f85eb9c4 Added pobj test files. 2004-12-14 06:19:09 +00:00
Gilad Arnold
d69a1878b9 Last change to make test/pobj be built with the project. 2004-12-14 01:51:25 +00:00
Gilad Arnold
bcf99ae693 Small change to library list order (pobj depends on lladd). 2004-12-14 01:39:12 +00:00
Gilad Arnold
87403264f5 Minor changes due to pobj file location changes. 2004-12-14 01:36:48 +00:00
Gilad Arnold
88ec078368 Added Makefile.am for test/pobj. 2004-12-14 01:20:01 +00:00
Gilad Arnold
fc42d83efc Added pobj library sources, header file, and test programs. Small changes were
made to src/Makefile.am in order to include src/pobj build, but no corresponding
change was made to test/Makefile.am (will be done in the near future).
2004-12-13 21:51:11 +00:00
Sears Russell
0b5aae7128 Test case for lost header fix. 2004-12-06 01:24:04 +00:00
Sears Russell
55b0ddf1b6 Fixed nasty bug that was causing the LLADD header to be lost (!!) 2004-12-06 01:20:48 +00:00
Sears Russell
72070acb67 Implemented TsetRange, fixed bug in linear hash. 2004-12-03 00:27:47 +00:00
Sears Russell
443a90ad7c Implemented TrecordType() 2004-12-01 01:26:25 +00:00
Sears Russell
ded5c92c9d Support for nested top actions, with simple unit test. (Haven't tested for thread safety yet.) 2004-11-29 21:28:13 +00:00
Sears Russell
d2864afa6f Fixed indentation, added #define to allow number of iterations to be changed easily 2004-11-28 00:04:14 +00:00
Sears Russell
164c7cfd69 Linear Hash now survives Tdeinit/Tinit cycle (but not crashes!) 2004-11-24 23:26:15 +00:00
Sears Russell
f0dfa98b8e Test case for new code that checks page type. 2004-11-24 23:23:01 +00:00
Sears Russell
910649a387 Web-site update, a few minor code changes from before the Freenix deadline. 2004-10-27 01:40:09 +00:00
Sears Russell
ec99c0e258 Lots of optimizations; re-did on-disk layout for the linear hash table. 2004-10-19 21:16:37 +00:00
Sears Russell
ec1276f26f Preliminary version of logical logging linear hash. (No latching yet, and there are some bugs re-opening a closed hash.) 2004-10-18 18:24:54 +00:00
Sears Russell
a078f25475 Implemented a linear hash from scratch. Concurrency hasn't been done, but it's probably correct in the single thread case. 2004-10-12 02:44:47 +00:00
Sears Russell
5064e3fac2 Implemented pages that store fixed sized records efficiently, and a java-style ArrayList data structure that efficiently supports (relatively) clustered, O(1) access time expandable arrays. (This will be used for the hash implementation...) 2004-10-06 06:08:09 +00:00
Sears Russell
9268b1d9cf Added support for gcov, and ran gprof. Shaved 10% off the runtime of check_page by optimizing rw.c 2004-10-04 05:24:12 +00:00
Sears Russell
96e7af92a4 Added test cases for Tprepare(), implemented some redo-only operations, and started to clean up record allocation/deallocation.
Also, numerous bugfixes.
2004-10-02 07:29:34 +00:00
Sears Russell
811bc5c710 Implemented a freespace manager that should safely allocate space, even in the face of crashes, and can reclaim unused space (unless an application opens more than one simultaneous transaction that performs allocations)
Fixed some blob bugs (by adding extra fdatasync() calls).

Began factoring out the page management code so that it is an extenstion, and a less integral part of lladd.
2004-08-21 00:03:30 +00:00