Commit graph

286 commits

Author SHA1 Message Date
Sears Russell
8aad1b896a pthread.h | rw.h -> latches.h (Otherwise, -DPROFILE_LATCHES doesn't work. 2006-07-25 01:06:01 +00:00
Sears Russell
45a5996215 Documented subtle hack; TallocPage() really needs a way to set page type at recovery. Currently, this just doesn't happen, since page types are lazily set.
Perhaps Talloc() could handle it?
2006-07-25 01:05:02 +00:00
Sears Russell
8485cc7fe1 Added missing releasePage(). 2006-07-25 01:03:57 +00:00
Sears Russell
745975112f Removed an assert that assumed pages aren't reused. 2006-07-25 01:03:07 +00:00
Sears Russell
747bc9cdc9 Removed #defines for broken ptrheads stuff. 2006-07-25 01:02:27 +00:00
Sears Russell
9721e86133 Commented out (currently broken) pthreads instrumentation, added readLock tracking to the latch instrumentation. 2006-07-25 01:01:46 +00:00
Sears Russell
2a9cb788a6 if LONG_TEST is defined, check for pinned pages on exit.
This test is currently implemented inefficiently, otherwise it would always be enabled.
2006-07-25 01:00:46 +00:00
Sears Russell
a5a234635e readBlob() no longer writes the blob contents to the log. ;) 2006-07-25 00:58:28 +00:00
Sears Russell
0f45b97eda regions now make use of nested top actions, so they're almost correct. (Still need to lock freed regions until end of transaction.) 2006-07-25 00:56:50 +00:00
Sears Russell
86fab6a22b Turn on paranoid slotted page consistency checks for long running tests. 2006-07-22 00:05:40 +00:00
Sears Russell
2af892709f Rewrote slottedCompact; added fsckSlottedPage 2006-07-22 00:01:42 +00:00
Sears Russell
0725af91be Fixed page leak in Talloc(). 2006-07-21 01:07:09 +00:00
Sears Russell
eb13531c0f Partial handling of incomplete log entries. (It detects when the log file does not end at the right byte, but doesn't checksum, or otherwise look for
sectors that didn't make it to disk.)
2006-07-21 01:06:35 +00:00
Sears Russell
1ff1d4c128 Re-enabled truncation (accidentally disabled it before...) 2006-07-20 01:30:58 +00:00
Sears Russell
ffd3bd960b switched to region allocator, but TpageAlloc currently grabs its own region... 2006-07-20 01:29:39 +00:00
Sears Russell
7bc60c3ac4 fixed the fixedPageAlloc hack. 2006-07-20 00:49:28 +00:00
Sears Russell
8ed909e79d Fixed the fixedPageAlloc hack. 2006-07-20 00:48:42 +00:00
Sears Russell
1ac3dc6779 More progress on boundary tags. (Still not tested/working yet...) 2006-07-18 23:59:00 +00:00
Sears Russell
bf98e32c73 fixed build 2006-06-22 23:31:42 +00:00
Sears Russell
93e7e96ea3 Started implementing the region allocator 2006-06-22 19:10:02 +00:00
Sears Russell
d26263262b Completely new blob implementation. Slower than the old one was supposed to be, but is correct, and extremeley
simple.  It simply writes the pre-image and post-image of each blob to the log using TpageSet.
2006-06-21 00:45:18 +00:00
Sears Russell
c8c9b7af19 the logger understands special record types. (At least partially...); shortened blob tests, since the blob
implementation is fundamentally broken, and slow
2006-06-20 23:02:27 +00:00
Sears Russell
6485a4aae9 No more PBL. 2006-06-20 21:44:17 +00:00
Sears Russell
4d79c0a466 Simplified allocation 2006-06-20 21:40:21 +00:00
Sears Russell
e14877821f Fixed blob bug. The reason it's so slow is that it's logging a preimage + postimage of each blob and then synchronously writing to a second copy each time the blob is
written to(!!!)
2006-06-20 00:03:38 +00:00
Sears Russell
3e4cac0fe3 Continued cleaning up allocation code. It seems really slow all of a sudden, so this commit probably introduced a performance bug. 2006-06-17 00:25:09 +00:00
Sears Russell
209a6916e5 Updated some comments. 2006-06-16 00:27:02 +00:00
Sears Russell
dc8a3e5d60 Eliminated slottedPreRalloc 2006-06-16 00:05:44 +00:00
Sears Russell
245db32c23 Two programs to create and quickly query a read-only on disk hash table 2006-06-15 22:28:39 +00:00
Sears Russell
50515ffd23 More steps toward factoring page allocation out of record allocation. 2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8 half-hearted attempt to fix -Wextra warnings... 2006-06-13 23:58:04 +00:00
Sears Russell
a3678aad5c Now AM_CFLAGS can be set by modifying GLOBAL_CFLAGS in the root
Makefile.am
2006-06-13 22:48:50 +00:00
Sears Russell
f53a46e788 removed heisenbug 2006-06-13 22:47:38 +00:00
Sears Russell
1b3a08d434 added some todos 2006-06-13 22:46:11 +00:00
Sears Russell
1cf3119eb7 renamed __really_do_ralloc to really_do_ralloc 2006-06-13 22:45:30 +00:00
Sears Russell
66ae3b9763 Made it more obvious that a suspicious looking assert is commented out 2006-06-13 22:44:40 +00:00
Sears Russell
24a5da9648 Fixed deprecated volatile static declaration (-> static volatile) 2006-06-13 22:43:58 +00:00
Sears Russell
33af9805ad printf -> fprintf(stderr, and assert(0) -> abort() 2006-06-13 22:43:20 +00:00
Sears Russell
f77e8b240d It was improperly tracking the log's global offset. (Hopefully)
fixed offset tracking, made it optional, and disabled it.
2006-06-13 22:42:15 +00:00
Sears Russell
c5add15bd3 assert(0) -> abort 2006-06-13 22:40:53 +00:00
Sears Russell
eab6385ca5 Moved #defines below definition of Page_s. 2006-06-13 22:40:24 +00:00
Sears Russell
f89903d529 moved stdio.h include out of header file. 2006-06-13 22:38:25 +00:00
Sears Russell
e56c46b95c Moved blob_record_t into transactional.h (part of transition to using
slot type lookup tables.)
2006-06-13 22:37:29 +00:00
Sears Russell
a11fbdd9e6 Did away with slottedPreRallocFromPage. 2006-06-13 20:00:46 +00:00
Sears Russell
cef9e2c4ce Added settings for longer-running tests 2006-06-12 22:45:41 +00:00
Sears Russell
e0b34633ec Fixed broken min_rec_lsn() semantics; before, if there were not outstanding transactions / writes,
then these calls would return flushedLSN().  The problem was that flushedLSN wasn't guaranteed to
return a pointed to the beginning of a log entry.
2006-06-12 21:50:21 +00:00
Sears Russell
7bb0ce0d17 Fixed truncation bug (truncation is more aggressive now), and added more debugging info. 2006-06-12 20:55:49 +00:00
Sears Russell
27f7df6f09 Fixed races on flushedLSN and page->dirty. 2006-06-12 20:05:28 +00:00
Sears Russell
35a5e80871 removed bogus .deps files. 2006-06-01 22:18:50 +00:00
Sears Russell
fd19036843 Added more complete hashtable test; fixed incorrect return value in LH_ENTRY(find) 2006-05-31 00:37:56 +00:00
Sears Russell
0649f179b3 Got rid of the ~1 second delay on exit. 2006-05-30 22:59:22 +00:00
Sears Russell
68dcc2067e No more warnings with -O2. 2006-05-25 22:50:52 +00:00
Sears Russell
8ce9e6127f Fixed return value in removeFromLinkedList 2006-05-25 22:48:15 +00:00
Sears Russell
b5d578f4e0 Fixed remaining warnings, got rid of alTupdate 2006-05-25 20:08:12 +00:00
Sears Russell
fda416090b Fixed a bunch of 'easy' warnings 2006-05-25 00:02:46 +00:00
Sears Russell
cb3a4ae20d Bucket list extension working. 2006-05-24 23:24:31 +00:00
Sears Russell
8b54b0d265 No longer attempts to truncate when long transactions prevent it from
being useful...
2006-05-24 23:21:33 +00:00
Sears Russell
827e0d891a The linear hashtable implementation (to replace pbl's) 2006-05-24 02:23:58 +00:00
Sears Russell
2e06cafaa8 2006-05-24 02:19:04 +00:00
Sears Russell
4c168d8fb2 Fixed truncation bugs, and a minor test case bug. 2006-05-22 23:59:02 +00:00
Sears Russell
f06159b3cd forgot to add these... 2006-05-19 20:17:44 +00:00
Sears Russell
ef43d5e4ce Implemented log truncation. 2006-04-14 03:45:26 +00:00
Sears Russell
11c311bc91 Added support for raw pages, implemented posix_memalign workaround, and re-enabled O_DIRECT by default 2006-04-12 01:41:35 +00:00
Sears Russell
33cbbb0e2d In memory logging implementation 2006-04-12 01:40:47 +00:00
Sears Russell
ab541b7dc8 Created bufferPool, moved memory management for page structs to it 2006-04-11 20:35:21 +00:00
Sears Russell
c29b16a6ed Created new module, bufferPool, and moved memory management for page structs to it. 2006-04-11 20:34:52 +00:00
Sears Russell
c1d8906d28 removed memcpy() calls from inMemoryLog; added "const" qualifier to many LogEntry pointers. 2006-04-11 02:20:21 +00:00
Sears Russell
7decae7172 All tests that pass with LOG_TO_FILE now pass with LOG_TO_MEMORY, but LOG_TO_MEMORY is slow, and seems to be
killing malloc's performance for some reason.  (linearHashNTA spends many seconds in free() between unit
tests...)
2006-04-08 00:05:09 +00:00
Sears Russell
d3d7f2c788 Implemented "LOG_TO_MEMORY", which mostly works (linear hash NTA goes into an infinite loop....) 2006-04-07 03:40:40 +00:00
Sears Russell
1c979f3052 Factored logWriter.h out of the rest of the system. The only file that directly depends on it is logger2.c, which can
now dispatch requests to different (hardcoded) log implementations.
2006-04-06 03:22:57 +00:00
Sears Russell
10e7434d32 corrected slottedFrespace()'s declaration (it was returning an int, but needed to return a size_t 2006-04-05 02:54:14 +00:00
Sears Russell
d9f1df0476 Fixed behavior when __really_do_ralloc() is called, but the record's slot is greater than numslots_ptr().
Optimized slotted_compact and __really_do_ralloc() so that they try to put lower numbered slots earlier in the freelist.
2006-04-05 02:52:40 +00:00
Sears Russell
d896155b82 Fixed freespace measurement during recovery/abort by adding slottedFreespaceForSlot()
(This version is still broken, because __really_do_ralloc() does not properly increment numslots_ptr
2006-04-05 00:38:11 +00:00
Sears Russell
041bfce736 The bucket list entries for variable lenth hash tables were too long, causing memory corruption, and wasting space+log bandwidth 2006-04-04 22:34:35 +00:00
Sears Russell
959233566c changed type of lsn variables to "lsn_t" 2006-04-04 22:33:30 +00:00
Sears Russell
8e0bd2ecd2 Extra check for end of iterator. 2006-04-04 22:32:48 +00:00
Sears Russell
2250b7a6c7 More freespace troubles... Should be correct now. 2006-03-28 21:27:10 +00:00
Sears Russell
3c55daede9 The freespace calculations were double counting the new slot's header. 2006-03-28 21:21:47 +00:00
Sears Russell
ced022d0fe partial fixes 2006-03-28 20:15:31 +00:00
Sears Russell
bb37db0857 Partial port to amd64. 2006-03-20 23:11:46 +00:00
Colleen M. Lewis
5bfcbdb076 Bug fixed: TfixedPageAlloc calls fixedPageInitialize with the wrong arguments. 2005-10-31 23:21:18 +00:00
Colleen M. Lewis
345f0cde78 Added the base functionality and test case for the BTree... just a hello world method. but it has the h, c and check files. -colleen ;) 2005-05-05 21:34:12 +00:00
Sears Russell
6b95cefc62 Fixed logWriter abort performance bug, also cleaned up the file, simplified locking, etc. 2005-04-14 04:23:22 +00:00
Sears Russell
a053b19757 removed extraneous abort 2005-04-14 01:43:14 +00:00
Sears Russell
3844b641a3 final transclos benchmark 2005-03-25 16:33:36 +00:00
Sears Russell
08ceca11ce Enabled compactPage in TallocFromPage() 2005-03-24 11:04:06 +00:00
Sears Russell
4c1ca194d0 Major edits throughout the paper. 2005-03-24 10:00:08 +00:00
Sears Russell
cf58e1fb72 Transitive closure working! 2005-03-24 04:43:22 +00:00
Sears Russell
2f99ed4664 Generic consumer wrapper functions, and implementation registrations. 2005-03-23 08:10:30 +00:00
Sears Russell
ee9eb416ea Implemented fifo pool that allocates entries out of a pool (it should be easy to extend this to avoid deadlock, while allowing it to continue to provide backpressure) 2005-03-23 08:07:53 +00:00
Sears Russell
6228931e58 A simple script that interprets the CI data, and allows basic calculations to be performed using command line arguments. 2005-03-21 22:32:28 +00:00
Sears Russell
b38db5b52b Added figures to paper. 2005-03-21 22:31:43 +00:00
Sears Russell
6d4216bc2a Preliminary (broken) transitive closure implementation. 2005-03-21 08:04:29 +00:00
Mike Demmer
c1997d8350 misc fixes to the script 2005-03-20 06:39:44 +00:00
Sears Russell
ef3c30b190 Benchmark updates. 2005-03-20 05:17:25 +00:00
Sears Russell
26d50f19e3 Cleaned up berkeley db tests / lladd logger optimizations + bug fix. 2005-03-19 20:28:30 +00:00
Sears Russell
97bf995022 changes for diff, commit prior to deleteing a lot of old bdb cruft 2005-03-18 23:26:25 +00:00
Sears Russell
d8eb6c9aa7 Major benchmark update; log force merging. 2005-03-17 04:38:55 +00:00
Sears Russell
bf4be359b3 Partially refactored logMemory and multiplexer into a fifo implementation. Added support to fifoPool for
asynchronous threads running round-robin through the dirty fifos consuming entries in idle ones.
2005-03-16 00:52:21 +00:00
Sears Russell
dffff067bb multiplexer and fifo are now working. (also added removed some timeouts from tests that were timing out) 2005-03-15 05:30:57 +00:00