Commit graph

218 commits

Author SHA1 Message Date
Sears Russell
8a95f5859d fixes Issue 8: When passed a prefix of an existing key, pageOrientedList will no longer treat the prefix and the existing key interchangably 2009-05-21 04:13:50 +00:00
Sears Russell
9de2e515f8 eclipse whitespacifaction 2009-05-21 04:10:41 +00:00
Sears Russell
7db06197ca refactored truncation + dirty page table, fixed doxygen warnings. 2009-05-20 21:23:51 +00:00
Sears Russell
73c4b4fb71 Fix for Issue 1. Reworked log format so that nested top actions do not need to look up old entries during forward operation. This saves log bandwidth and avoids the bug that caused the performance regression 2009-05-14 21:28:09 +00:00
Sears Russell
3ff75ff568 made pass over log documentation 2009-05-13 22:06:58 +00:00
Sears Russell
87218ad929 yet another refactoring; broke groupForce into its own module, removed more static variables and namespace violations 2009-05-13 18:04:53 +00:00
Sears Russell
bc554efc85 renamed some functions to match naming convention 2009-05-08 06:53:30 +00:00
Sears Russell
651a1a22e5 more refactoring; removed static variables from pageHandle.c 2009-05-08 04:56:34 +00:00
Sears Russell
221b2e4acb remove static variables, fix filehandle leak 2009-05-07 09:56:36 +00:00
Sears Russell
7b4cf40221 refactored/created stasis_buffer_manager_open and stasis_handle_open 2009-05-07 08:52:06 +00:00
Sears Russell
b5b414490a fix config.h error for installed copies of stasis 2009-04-29 21:31:39 +00:00
Sears Russell
f947a2b417 add make install target 2009-04-29 20:22:41 +00:00
Sears Russell
55c43358b6 fix recovery bug due to interactions between truncation and the old CLR format. check_faultInjection should now pass. 2009-04-22 22:03:38 +00:00
Sears Russell
731da7456a more eclipse refactoring; cleaned up some names, whitespace and documentation 2009-04-13 22:50:12 +00:00
Sears Russell
7db35ecd39 removed static variables from bufferPool.c; renamed methods, moved Page typedef to common.h 2009-04-13 21:55:08 +00:00
Sears Russell
4b07b538a6 Renamed some methods; fixed bug that caused recovery to create potentially unbounded numbers of concurrent, active transactions.
(Note: this commit contains quite a few instances of auto-cleaned whitespace....)
2009-04-11 17:17:42 +00:00
Sears Russell
dacc33642e silence cast warnings on 32-bit linux 2009-04-09 15:17:38 +00:00
Sears Russell
05077b62fd nested top action cleanup and bugfix; subsequent recovery calls could undo logical undos in some circumstances 2009-04-03 22:01:37 +00:00
Sears Russell
83a982d0bf fail earlier if record_type and record_size apis are abused 2009-04-01 21:12:50 +00:00
Sears Russell
564dfe426b Renamed / refactored operation implementation + registration functions. Added support for third party operations 2009-03-31 05:02:54 +00:00
Sears Russell
83ad15b6d0 more benchmarks; transactions can now be multithreaded 2009-03-20 11:36:27 +00:00
Sears Russell
d413bb27f3 support for lsn-free writeback; partial benchmark code for submission 2009-03-19 03:36:13 +00:00
Sears Russell
b1f44ab005 added simplistic support for log reordering 2009-03-16 08:11:49 +00:00
Sears Russell
45a2410a25 add support for lsn-free set (but not alloc, etc...) 2009-03-15 07:21:37 +00:00
Sears Russell
bd2015443f expose nextAvailableLSN for lsn-free pages 2009-03-15 02:43:09 +00:00
Sears Russell
9e54ad60d5 renamed hash() to avoid linker collisions; inlined some hash functions 2009-02-20 23:42:54 +00:00
Sears Russell
4ce4491097 avoid extra calls to gettimeofday() when the log is not durable; set group commit to wait for 10msec, not 100... 2009-02-03 05:36:33 +00:00
Sears Russell
95e9158847 checkin partially implemented log based on file pool so that svn will compile 2009-01-05 21:57:33 +00:00
Sears Russell
93885a3ab4 removed static variables from logWriter.c 2008-12-29 23:05:13 +00:00
Sears Russell
5ba41bb3cb renamed logWriter.[ch] to safeWrites.[ch] 2008-12-29 20:01:37 +00:00
Sears Russell
6f809b00e2 renamed open/deleteLogWriter 2008-12-29 19:46:51 +00:00
Sears Russell
97ab7670db fixes major correctness/performance regression; test for when to force log to maintain WAL was reversed 2008-12-12 00:05:42 +00:00
Sears Russell
32950b2b98 fixed memory leaks and pointer aliasing bugs in lsmTree_iterator. 2008-12-05 00:08:46 +00:00
Sears Russell
32fae6795b Fix memory leak in lruFast.c during Tdeinit(). 2008-12-04 23:07:07 +00:00
Sears Russell
79d1512a5e fixed problem in lsm tree recovery; it was not updating the lsm tree header when passing C1 into C2's merger thread. Then C2 freed C1, and C1 pointed to uninitialized data. 2008-12-04 09:22:17 +00:00
Sears Russell
e4341e10b9 partially fixed rose recovery; clean shutdowns now work 2008-12-04 04:12:47 +00:00
Sears Russell
c6564e67c7 documentation update; eliminated some dead code 2008-12-02 19:39:20 +00:00
Sears Russell
1383a42206 documentation update; made slottedFlush, etc.. static 2008-12-02 19:38:49 +00:00
Sears Russell
ddc93caeae do not use group commit with non-durable transactions 2008-12-01 23:22:38 +00:00
Sears Russell
2dcc6598d2 added support for softcommit, and for compile / runtime configuration of stasis log + storefile locations 2008-12-01 22:45:32 +00:00
Sears Russell
17d4bb3ed4 log refactoring 2008-12-01 19:48:59 +00:00
Sears Russell
77b24a991d - Arrange for buffer manager writback to use group commit
- Only call correct log force when log_to_mem is enabled.
2008-12-01 04:28:46 +00:00
Sears Russell
1cddd8ab8c remove ancient obsolete file 2008-12-01 04:24:24 +00:00
Sears Russell
e22c35a1b5 fix lsm iterator data corruption bug 2008-11-26 22:39:48 +00:00
Sears Russell
6a5e7f5589 Fix two problems in lsmTree:
- rewrite lookup() to be simpler, and fixed a few bugs
 - was keeping node records around after pages were released
2008-11-26 07:01:43 +00:00
Sears Russell
15a097a100 sort of compiles under macos now 2008-11-25 01:19:36 +00:00
Sears Russell
11082997d8 revert accidentally committed files 2008-11-24 23:43:26 +00:00
Sears Russell
a321ba6e4e handle null lsmIiterator_ gracefully 2008-11-24 23:41:11 +00:00
Sears Russell
09641257ad fixed memory leak 2008-11-24 07:35:59 +00:00
Sears Russell
2b63991014 preliminary (and largely untested) support for opening LSM-tree iterators starting at a given tuple 2008-11-24 01:32:35 +00:00
Sears Russell
cafd05f9bd moved legacy buffer manager into its own directory 2008-11-13 20:08:37 +00:00
Sears Russell
53a7982f47 fixes numerous blob bugs, allowing linearHashNTA to store arbitrary length key,value pairs. 2008-11-13 04:18:50 +00:00
Sears Russell
46fbfa3c35 Implement blob deallocation; add test case 2008-11-13 00:13:11 +00:00
Sears Russell
e2f604175b move hash iterator code around, update documentation 2008-11-13 00:12:19 +00:00
Sears Russell
f5d1229941 Recovery now maintains XactionTable's state in the same way as forward operation.
Internal transactional2.c state is now declared static.
2008-11-13 00:06:35 +00:00
Sears Russell
9bf242f1a5 Add check for invalid transaction xids to Tupdate(). 2008-11-12 19:00:09 +00:00
Sears Russell
fc5b5a2b29 do away with librw 2008-11-07 03:44:41 +00:00
Sears Russell
2c2c603dd2 all naive linear hash methods now start with TnaiveHash; removed references to ThashAlloc from documentation 2008-11-03 21:42:42 +00:00
Sears Russell
5c5b6d0c67 allow callers to truncateNow() to (safely) override normal truncation policy 2008-10-27 23:24:21 +00:00
Sears Russell
23548354a4 fixes over-zealous assert due to partial log read 2008-10-27 23:22:38 +00:00
Sears Russell
71cc9d6df7 transactions now can check with allocation policy before allocating to pages of their own choosing 2008-10-27 23:20:31 +00:00
Sears Russell
fa18df2424 ignore size field of hashHeader argument 2008-10-23 20:27:55 +00:00
Sears Russell
c76f22fd4f reduce the risk that broken calls to Tset() will create unrecoverable logs 2008-10-23 20:27:08 +00:00
Sears Russell
db4f26b48c Fix crash in recovery; 'initted' was false during undo. undo calls Tupdate(), which checks the status of 'initted' 2008-10-23 19:56:21 +00:00
Sears Russell
0940c59d96 fail fast if Tbegin() called before Tinit() 2008-10-22 21:05:49 +00:00
Sears Russell
6f717c351a update comment 2008-10-22 21:05:12 +00:00
Sears Russell
edb51e5789 Fix buffer manager page leak. 2008-10-09 20:14:55 +00:00
Sears Russell
ad65a806a5 removed old #include 2008-10-07 19:19:58 +00:00
Sears Russell
474cabdb99 removed workaround code for old arraylist bug 2008-10-04 16:09:34 +00:00
Sears Russell
82ec112788 Fixed overly specific assertion. 2008-10-04 15:53:19 +00:00
Sears Russell
a6a83b98a1 Removed handling/warning related to old kludge. 2008-10-04 07:27:53 +00:00
Sears Russell
a20d28d369 removed dead code; added additional check for TpagedListInsert() 2008-10-04 07:18:25 +00:00
Sears Russell
132a567533 removed dead/unnecessary code; private methods are now static 2008-10-04 07:08:35 +00:00
Sears Russell
d43e64a41f remove bTree stuff from build systems 2008-10-04 01:35:56 +00:00
Sears Russell
ef487c4dc8 remove btree stub files 2008-10-04 00:53:11 +00:00
Sears Russell
6354fe8a2f use pageid instead of int; Tupdate now takes a pageid instead of a recordid 2008-10-03 02:42:25 +00:00
Sears Russell
220c33cc31 Fixed two buffer manager performance problems (Markos, Vinayak, thanks for pointing these out!):
- No longer hold global mutex during page writeback
 
 - Don't reserve 90% of the buffer pool for the free list.  Now the freelist reserves 1% of the buffer pool + 6 pages, and expands if it runs out of space.
2008-10-01 20:43:58 +00:00
Sears Russell
ff5ef752f3 fix compiler warning 2008-10-01 15:50:24 +00:00
Sears Russell
db1d79efcd Removed Tinstant* and broken logical hash stuff 2008-09-30 15:34:42 +00:00
Sears Russell
5dcf3bd1a4 check_bufferManager should pass now(!!!) bufferManager was crashing with "assert(victim)
failed" if the application pinned so many pages that the writeback tasks could not write back 
pages in order to maintain the free page list.

 - Instead of crashing, issue warning the first time this happens.

 - Add diagnostic message explaining that all pages have been pinned before crashing 
   due to a failed loadPage() request.
2008-09-29 04:35:08 +00:00
Sears Russell
ff0887624c Simplified the page locking conventions.
Added paranoid calls to assertlock() to page.c

Fixed race in abort():

 - pick CLR LSN

 - release page lock

 - someone else updates page

 - lock page

 - apply undo
2008-09-28 05:50:59 +00:00
Sears Russell
6d17442380 Major refactoring:
- Changed operations to take only two arguments
     - No more hacks regarding log argument sizes

     - Set pageid = INVALID_PAGE if you want a logical operation

  - Ported operation implementations to new api; exposed + fixed a number of concurrency bugs

  - More fixes to prepare

  - Fixed to nested top actions

  - More coherent operations api / recovery implmentation

  - TnaiveHash* and Tinstant* are (and were already) broken, and are set for removal

  - Removed some instances of fail_unless

  - Fixed design flaws in blob implementation.

  - New naming convention for operation callback functions.
2008-09-28 03:11:24 +00:00
Sears Russell
7867100b8b change default io handle to pfile (was non_blocking) 2008-09-28 01:44:18 +00:00
Sears Russell
b6c3f60126 removed unneccessary local variable 2008-09-28 01:02:36 +00:00
Sears Russell
41cd975e91 fixed new const warnings from gcc 2008-09-24 06:40:34 +00:00
Sears Russell
944c7e984f fixes / cleanups of Tprepare() 2008-09-24 03:08:32 +00:00
Sears Russell
fb4e91debe removed deferred operation stubs 2008-09-12 23:08:41 +00:00
Sears Russell
75419290c4 Added asserts to help narrow down unit test failures 2008-09-12 22:55:23 +00:00
Sears Russell
e6ec2cb9fc Added "loadUninitializedPage()", which returns an uninitialized page instead of reading preimages from disk. 2008-06-09 01:13:02 +00:00
Sears Russell
2863487991 Documentation update; added more sections under modules, reduced amount of cruft generated by doxygen. 2008-04-23 01:41:57 +00:00
Sears Russell
2929394b31 Fixed some documentation warnings, and clarified a few points. 2008-04-17 06:29:34 +00:00
Sears Russell
afbd89e3ff All headers now live in the header directory. (stasis/, not src/stasis) 2008-04-13 04:02:57 +00:00
Sears Russell
b1bfe7979f Questionable attempts to appease valgrind. 2008-03-14 03:09:29 +00:00
Sears Russell
3b70dfaab7 nearly ready to run experiments... 2008-03-14 03:06:52 +00:00
Sears Russell
0c7d45f788 Added support for tombstones and rudimentary versioning.
workload 2 is broken at the moment.
2008-03-13 01:16:37 +00:00
Sears Russell
fbf5544853 Chose more appropriate data sizes. 2008-03-13 01:13:52 +00:00
Sears Russell
5ea1f630d7 Fixed memory leaks. 2008-03-11 23:17:15 +00:00
Sears Russell
474670092e Fixed exceptional value handling. 2008-03-11 08:47:12 +00:00
Sears Russell
0f27d30d22 Fixed overrun handling (nop wasn't using it; the multicolumn page implementations were broken...)
Updated for to use 8 bit deltas (nop provides alternative to 16 bit deltas in many cases...)
2008-03-10 08:19:23 +00:00
Sears Russell
893c1afee9 Added "no-op" compressor (to allow compression to be disabled...) 2008-03-08 07:43:53 +00:00