greg/stasis-aries-wal
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1541 commits 3 branches 1 tag 14 MiB
Commit graph

846 commits

Author SHA1 Message Date
Sears Russell
cafd05f9bd moved legacy buffer manager into its own directory 2008-11-13 20:08:37 +00:00
Sears Russell
53a7982f47 fixes numerous blob bugs, allowing linearHashNTA to store arbitrary length key,value pairs. 2008-11-13 04:18:50 +00:00
Sears Russell
46fbfa3c35 Implement blob deallocation; add test case 2008-11-13 00:13:11 +00:00
Sears Russell
e2f604175b move hash iterator code around, update documentation 2008-11-13 00:12:19 +00:00
Sears Russell
f5d1229941 Recovery now maintains XactionTable's state in the same way as forward operation. 
Internal transactional2.c state is now declared static.
 2008-11-13 00:06:35 +00:00
Sears Russell
9bf242f1a5 Add check for invalid transaction xids to Tupdate(). 2008-11-12 19:00:09 +00:00
Sears Russell
484cd7fd38 fix new gcc compiler warnings 2008-11-11 01:15:25 +00:00
Sears Russell
8b0251ae4b Fix conditional compilation for flex / bison 2008-11-07 08:18:46 +00:00
Sears Russell
fc5b5a2b29 do away with librw 2008-11-07 03:44:41 +00:00
Sears Russell
3c8f2caa10 added more fuse functions 2008-11-06 07:19:14 +00:00
Sears Russell
b01a053664 conditional compilation for fuse stuff; added readOnlyHash to cmake (and fixed automake build problem) 2008-11-05 22:33:09 +00:00
Sears Russell
c51c51dc13 Enable building fuse by default 2008-11-05 22:24:13 +00:00
Sears Russell
00f5037f79 first cut at fuse filesystem; files > 4K do not work yet; nor do deletion, and other things. 2008-11-05 22:18:11 +00:00
Sears Russell
2c2c603dd2 all naive linear hash methods now start with TnaiveHash; removed references to ThashAlloc from documentation 2008-11-03 21:42:42 +00:00
Sears Russell
3c4c4f0916 Initial import of stiki, the STasis wIKI. 2008-10-28 04:34:05 +00:00
Sears Russell
5c5b6d0c67 allow callers to truncateNow() to (safely) override normal truncation policy 2008-10-27 23:24:21 +00:00
Sears Russell
23548354a4 fixes over-zealous assert due to partial log read 2008-10-27 23:22:38 +00:00
Sears Russell
71cc9d6df7 transactions now can check with allocation policy before allocating to pages of their own choosing 2008-10-27 23:20:31 +00:00
Sears Russell
fa18df2424 ignore size field of hashHeader argument 2008-10-23 20:27:55 +00:00
Sears Russell
c76f22fd4f reduce the risk that broken calls to Tset() will create unrecoverable logs 2008-10-23 20:27:08 +00:00
Sears Russell
db4f26b48c Fix crash in recovery; 'initted' was false during undo. undo calls Tupdate(), which checks the status of 'initted' 2008-10-23 19:56:21 +00:00
Sears Russell
0940c59d96 fail fast if Tbegin() called before Tinit() 2008-10-22 21:05:49 +00:00
Sears Russell
6f717c351a update comment 2008-10-22 21:05:12 +00:00
Sears Russell
edb51e5789 Fix buffer manager page leak. 2008-10-09 20:14:55 +00:00
Sears Russell
97dfdb8f95 Fix conditional compilation for libcheck and libconfuse 2008-10-09 18:59:45 +00:00
Sears Russell
ad65a806a5 removed old #include 2008-10-07 19:19:58 +00:00
Sears Russell
474cabdb99 removed workaround code for old arraylist bug 2008-10-04 16:09:34 +00:00
Sears Russell
82ec112788 Fixed overly specific assertion. 2008-10-04 15:53:19 +00:00
Sears Russell
a6a83b98a1 Removed handling/warning related to old kludge. 2008-10-04 07:27:53 +00:00
Sears Russell
a20d28d369 removed dead code; added additional check for TpagedListInsert() 2008-10-04 07:18:25 +00:00
Sears Russell
132a567533 removed dead/unnecessary code; private methods are now static 2008-10-04 07:08:35 +00:00
Sears Russell
d43e64a41f remove bTree stuff from build systems 2008-10-04 01:35:56 +00:00
Sears Russell
ef487c4dc8 remove btree stub files 2008-10-04 00:53:11 +00:00
Sears Russell
6354fe8a2f use pageid instead of int; Tupdate now takes a pageid instead of a recordid 2008-10-03 02:42:25 +00:00
Sears Russell
18fd6009fe cosmetic change 2008-10-02 20:40:43 +00:00
Sears Russell
220c33cc31 Fixed two buffer manager performance problems (Markos, Vinayak, thanks for pointing these out!): 
- No longer hold global mutex during page writeback
 
 - Don't reserve 90% of the buffer pool for the free list.  Now the freelist reserves 1% of the buffer pool + 6 pages, and expands if it runs out of space.
 2008-10-01 20:43:58 +00:00
Sears Russell
65a3c94421 Fix libdfa warnings, add libdfa to CMake. 2008-10-01 20:03:15 +00:00
Sears Russell
348783398a port pobj to c99, add to build system 2008-10-01 20:02:09 +00:00
Sears Russell
ff5ef752f3 fix compiler warning 2008-10-01 15:50:24 +00:00
Sears Russell
db1d79efcd Removed Tinstant* and broken logical hash stuff 2008-09-30 15:34:42 +00:00
Sears Russell
5dcf3bd1a4 check_bufferManager should pass now(!!!) bufferManager was crashing with "assert(victim) 
failed" if the application pinned so many pages that the writeback tasks could not write back 
pages in order to maintain the free page list.

 - Instead of crashing, issue warning the first time this happens.

 - Add diagnostic message explaining that all pages have been pinned before crashing 
   due to a failed loadPage() request.
 2008-09-29 04:35:08 +00:00
Sears Russell
a7e8751f2f Remove hardcoded path from parser; tell automake not to bother with swig or parser 2008-09-28 07:35:20 +00:00
Sears Russell
e96b4d1c05 check in lex/yacc based relational algebra primitives 2008-09-28 06:39:45 +00:00
Sears Russell
ff0887624c Simplified the page locking conventions. 
Added paranoid calls to assertlock() to page.c

Fixed race in abort():

 - pick CLR LSN

 - release page lock

 - someone else updates page

 - lock page

 - apply undo
 2008-09-28 05:50:59 +00:00
Sears Russell
6d17442380 Major refactoring: 
- Changed operations to take only two arguments
     - No more hacks regarding log argument sizes

     - Set pageid = INVALID_PAGE if you want a logical operation

  - Ported operation implementations to new api; exposed + fixed a number of concurrency bugs

  - More fixes to prepare

  - Fixed to nested top actions

  - More coherent operations api / recovery implmentation

  - TnaiveHash* and Tinstant* are (and were already) broken, and are set for removal

  - Removed some instances of fail_unless

  - Fixed design flaws in blob implementation.

  - New naming convention for operation callback functions.
 2008-09-28 03:11:24 +00:00
Sears Russell
7867100b8b change default io handle to pfile (was non_blocking) 2008-09-28 01:44:18 +00:00
Sears Russell
b6c3f60126 removed unneccessary local variable 2008-09-28 01:02:36 +00:00
Sears Russell
7e54d72f18 fixed compilation warning 2008-09-28 01:01:38 +00:00
Sears Russell
41cd975e91 fixed new const warnings from gcc 2008-09-24 06:40:34 +00:00
Sears Russell
944c7e984f fixes / cleanups of Tprepare() 2008-09-24 03:08:32 +00:00
Sears Russell
fb4e91debe removed deferred operation stubs 2008-09-12 23:08:41 +00:00
Sears Russell
75419290c4 Added asserts to help narrow down unit test failures 2008-09-12 22:55:23 +00:00
Sears Russell
e6ec2cb9fc Added "loadUninitializedPage()", which returns an uninitialized page instead of reading preimages from disk. 2008-06-09 01:13:02 +00:00
Sears Russell
2863487991 Documentation update; added more sections under modules, reduced amount of cruft generated by doxygen. 2008-04-23 01:41:57 +00:00
Sears Russell
2929394b31 Fixed some documentation warnings, and clarified a few points. 2008-04-17 06:29:34 +00:00
Sears Russell
afbd89e3ff All headers now live in the header directory. (stasis/, not src/stasis) 2008-04-13 04:02:57 +00:00
Sears Russell
b1bfe7979f Questionable attempts to appease valgrind. 2008-03-14 03:09:29 +00:00
Sears Russell
3b70dfaab7 nearly ready to run experiments... 2008-03-14 03:06:52 +00:00
Sears Russell
0c7d45f788 Added support for tombstones and rudimentary versioning. 
workload 2 is broken at the moment.
 2008-03-13 01:16:37 +00:00
Sears Russell
fbf5544853 Chose more appropriate data sizes. 2008-03-13 01:13:52 +00:00
Sears Russell
5ea1f630d7 Fixed memory leaks. 2008-03-11 23:17:15 +00:00
Sears Russell
474670092e Fixed exceptional value handling. 2008-03-11 08:47:12 +00:00
Sears Russell
0f27d30d22 Fixed overrun handling (nop wasn't using it; the multicolumn page implementations were broken...) 
Updated for to use 8 bit deltas (nop provides alternative to 16 bit deltas in many cases...)
 2008-03-10 08:19:23 +00:00
Sears Russell
893c1afee9 Added "no-op" compressor (to allow compression to be disabled...) 2008-03-08 07:43:53 +00:00
Sears Russell
e8490c8b8a Fixed compiler warnings 2008-03-08 07:36:47 +00:00
Sears Russell
567c2b51b9 Fixed bug in recordFind. It was finding values outside of the requested range. 2008-03-08 07:33:44 +00:00
Sears Russell
50c5123548 Added new dynamic version of multicolumn, and pagelayouts, etc to support it. 2008-03-08 03:16:08 +00:00
Sears Russell
922669bde4 fix compiler warning 2008-03-08 03:04:16 +00:00
Sears Russell
8da9a5e8ad Added "interests" to survey. 2008-03-05 20:21:06 +00:00
Sears Russell
c5a75a9102 Fixed some parsing / tokenization problems (added support for more characters / whitespace within tuples. 
Implemented perl driver (and sample .cgi) for toplevel.c's network server.
 2008-03-05 02:31:58 +00:00
Sears Russell
54055cd3e7 Initial checkin of relational algebra implementation. 2008-03-02 23:43:38 +00:00
Sears Russell
034343737b Preliminary cmake build system (just enough for unit testing; misses lots of old code and benchmarks...) 2008-03-02 23:25:31 +00:00
Sears Russell
e49d51cb7e Clean up includes for new cmake build system. 2008-03-02 23:21:39 +00:00
Sears Russell
3b74523a53 Fix memory leak. 2008-03-01 20:40:31 +00:00
Sears Russell
4104de06ff fixed double free (was freeing iterator in next() and close()...) 2008-03-01 20:30:48 +00:00
Sears Russell
146563ca45 Allow third parties to register new iterator types. (made iterator registration non-static; moved constants into constants.h) 2008-03-01 19:34:12 +00:00
Sears Russell
f05b0233a3 Fixed memory leaks on iterator open/close Also zero out some memory defensively. 2008-03-01 19:32:34 +00:00
Sears Russell
4c83e1c373 Fixed memory leak during analysis phase. 2008-03-01 19:27:31 +00:00
Sears Russell
673f6b55d3 Allocation bugfixes 2008-02-29 18:03:32 +00:00
Sears Russell
043b9a7a01 Regions are 1 offset;iterator was totally broken. 2008-02-20 22:56:52 +00:00
Sears Russell
17d4f95d03 Fix bookkeeping, get rid of aborts during recovery of partially flushed log. 2008-02-20 22:51:52 +00:00
Sears Russell
a823255227 Added interface to let other stasis modules find regions' boundary tags 2008-02-19 22:07:13 +00:00
Sears Russell
1846340251 Zero out memory at initilization 2008-02-19 21:29:46 +00:00
Sears Russell
175b7e281e Zero out memory and dirty bit at initialization. 2008-02-19 21:27:34 +00:00
Sears Russell
19949af99d More sanity checking. 2008-02-19 21:26:31 +00:00
Sears Russell
178ef7dc47 Fixes errors/warnings revealed by 32-bit x86. 2007-12-19 03:23:31 +00:00
Sears Russell
71451f0c93 Bugfixes for experimental repeatability 2007-12-14 19:08:09 +00:00
Sears Russell
ab4fb0df6c Fix linker namespace collision with libz 2007-12-06 21:52:37 +00:00
Sears Russell
5d62e0c0df Filled in paper info about the data set; minor tweaks to R setting code. 2007-11-15 16:57:25 +00:00
Sears Russell
2bb6fce574 Code is ready(?) for experiments (version before this was solid despite (now) known bugs; I saw some crashes with these diffs, but think they've all been 
addressed.)
 2007-11-15 01:33:39 +00:00
Sears Russell
58e0466339 roseTable csv parser. updated rose.cpp for benchmarking 2007-11-13 23:40:21 +00:00
Sears Russell
5ad137164f Fixed compiler warnings. 2007-11-12 16:40:50 +00:00
Sears Russell
5384d1efc5 indirect.c creates a scratch page with malloc. It wasn't setting the scratch page's type to UNINITIALIZED_PAGE, leading to segfaults. 2007-11-12 16:32:00 +00:00
Sears Russell
799c7498cd Essentially leak free (mem and disk) after a few hours of roseTable 2007-11-12 07:27:49 +00:00
Sears Russell
ecc2392066 No (?) significant disk space leaks. 2007-11-12 01:40:12 +00:00
Sears Russell
9bb6984c23 force_range is now being called after compressData() 2007-11-12 00:49:00 +00:00
Sears Russell
f51148e686 More fixes for machines without file_sync_range 2007-11-11 23:38:10 +00:00
Sears Russell
863586135e Fixed compilation for machines without sync_file_range() 2007-11-11 23:33:23 +00:00
Sears Russell
87a70f29bc Preliminary force_range implementation; lsmTable leaks significantly less space now. 2007-11-11 23:22:21 +00:00
Sears Russell
07a6cd29e3 Forgot ; new abort() statement... 2007-11-11 17:24:44 +00:00
Sears Russell
48cdffe4d4 Stopgap (inefficient, but possibly correct) fix for the arraylist kludgieness. 2007-11-11 17:18:57 +00:00
Sears Russell
c34617fa16 Got versioning iterator to work. 2007-11-11 00:46:10 +00:00
Sears Russell
f2df518338 Implemented TlsmTableFind(); fixed quite a few bugs in merge, comparators, etc... 2007-11-06 02:27:04 +00:00
Sears Russell
d03a4e0c1f Static dispatch, multiple column types per page. 2007-11-04 21:25:08 +00:00
Sears Russell
e46dcce461 No more leaks; "fixed" RB tree memory usage estimates. 2007-11-04 01:51:37 +00:00
Sears Russell
5a6ba6ed94 Fixed memory leak. 2007-11-03 22:21:46 +00:00
Sears Russell
3a88e43e9b Fixed statistics reporting. 2007-11-02 21:56:17 +00:00
Sears Russell
75cbb20e6d Tuple insertion now works (modulo storage leakage, hard coded tree sizes (not even ratios), and many other problems...) 2007-11-02 21:20:30 +00:00
Sears Russell
f101919244 LSM table is now able to spawn threads, then exit. 2007-11-02 15:00:47 +00:00
Sears Russell
7e2c37534e Partial implementation of a collection oriented interface for ROSE. (Checking in to create version to diff against.) 2007-11-01 20:09:55 +00:00
Sears Russell
2c25c3a393 Statically typed tuples. 2007-10-30 23:32:37 +00:00
Sears Russell
b167b98085 * Remove spurious warnings messages from tests that intentionally crash stasis. 
* Move and rename lladd_autoTruncation flag to stasis_truncation_automatic in flags.c
 2007-10-23 23:16:58 +00:00
Sears Russell
9b8fefe68d Added force() to the handle API. It is now called from tests, and by the buffer manager 2007-10-23 01:51:03 +00:00
Sears Russell
d7e56fc96f Added more buffer manager flags (allow programs to bypass non_blocking). 2007-10-22 20:50:00 +00:00
Sears Russell
44a766a7f6 * Fixed a race condition. Pages that were merged during writeback were 
set clean and unpinned while the slow handle was writing them back.
This allowed other threads to come in, and read the old version of the
page from disk.

* Fixed performance bug: When considering pages for writeback, start
  after the end of the last flushed page (not the first flushed page)

* Honor "max_fast_handles".
 2007-10-22 20:45:48 +00:00
Sears Russell
1c408dd2f1 Initial refactoring of rose.cpp into reusable components. (Just shuffles the code around.) 2007-10-18 18:52:12 +00:00
Sears Russell
cd5ec5f70c Initial ROSE check in. 2007-10-15 17:46:44 +00:00
Sears Russell
0239743b03 More updates to svn:ignore (and removing .deps directory that doesn't belong in svn...) 2007-10-03 01:59:21 +00:00
Sears Russell
22c89bb3fe Renamed physical_slot_length 2007-10-03 01:53:51 +00:00
Sears Russell
7fb4fd4c1a Updated svn:ignore. 2007-10-03 01:52:41 +00:00
Sears Russell
c9bbf3af94 Converted page.h to follow new naming convention; documented new page api; begun stasis documentation cleanup. 2007-10-02 00:18:33 +00:00
Sears Russell
5f954eb239 Final commit from google. 2007-08-24 23:01:08 +00:00
Sears Russell
5bd2138a8b Fixes a number of memory leaks; adds pageCleanup() callback, and allows callers to use custom allocators with LSM trees 2007-08-20 21:58:20 +00:00
Sears Russell
9c1c284406 Implemented range scans; lsmTree now supports keys that are stored as fixed length byte arrays. 2007-08-20 16:53:16 +00:00
Sears Russell
519bd515f4 New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes. 2007-08-20 16:25:08 +00:00
Sears Russell
90f011b049 New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes. 2007-08-20 16:23:57 +00:00
Sears Russell
8963d6d381 Fixed recordNext(), add unit test for recordNext() on slotted and fixed pages. 2007-08-20 16:04:44 +00:00
Sears Russell
8367dfe9a3 releasePage() is now a function, not a function pointer. releasePageImpl is the name of the new function pointer. 2007-08-14 01:20:08 +00:00
Sears Russell
9745d62887 Preliminary LSM tree implementation (hardcodes keys as ints for now) 2007-08-14 01:17:31 +00:00
Sears Russell
a773c4d8b7 Bugfixes and improved error handling for recovery tests and registerPageType() 2007-07-19 23:47:06 +00:00
Sears Russell
f539011e9f Implemented simulateBufferManagerCrash. 2007-07-19 16:36:17 +00:00
Sears Russell
3d84412cea It is now possible to register page types before Tinit() is called, so that they may be used by recovery. 2007-07-19 16:35:11 +00:00
Sears Russell
7ca0619db0 Adds a void * to Page_s so that page implementations can store information with the pages they manage. 2007-07-18 20:10:10 +00:00
Sears Russell
9fd91cffb8 Updated page api to handle page types that need to grab resources on record read/ write, or that perform callbacks when read / written to disk. 2007-07-18 20:09:14 +00:00
Sears Russell
356387eafe support "make install", and use libtool to generate .so, .a files. 2007-06-25 15:47:28 +00:00
no author
d0274c3304 Renamed 'lladd' directories and python module to 'stasis' 2007-06-11 21:36:57 +00:00
Sears Russell
4998e57566 Updated for the new page API 2007-06-07 21:53:09 +00:00
Sears Russell
2f7da41663 Whitespace; restoring lost call to checkRid 2007-06-01 22:20:25 +00:00
Sears Russell
5e1445777f Should have gone in with the rest of the nowarn patch 2007-06-01 22:16:42 +00:00
Sears Russell
dd7c6b857d Added assertlock() and call it when page implementations assume a page has already been latched. (Fixed 
associated bugs as well)
 2007-06-01 21:32:33 +00:00
Sears Russell
d1aeba8a82 Cleaned up obsolete @todo's; fixed inconsistent page file initialization 2007-06-01 21:06:18 +00:00
Sears Russell
951a897040 Add casts to prevent warnings on (upcoming changes to) recordRead, recordWrite 2007-05-31 22:40:19 +00:00
Sears Russell
bff22716a7 Updated page.h's interface to make it more consistent. 2007-05-31 01:15:12 +00:00
Mark Callaghan
12c7f6a1c5 Simple SWIG interface 2007-05-30 23:48:36 +00:00
Sears Russell
a3885944a0 Messed with documentation to try to make doxygen happy and more likely to see this file. 2007-05-26 01:03:57 +00:00
Sears Russell
22dfd5a117 Fixed use after free. 2007-04-21 07:51:33 +00:00
Sears Russell
05ad97b37b Was releasing log_read_mutex without obtaining it first... 2007-04-20 07:13:18 +00:00
Sears Russell
362b1036de Changed CLR log format so that it is identical to update entries. The old format pointed back to an earlier 
entry in the log, complicating truncation significantly.  The new format copies log entries into their CLRs,
and is somewhat redundant, as redo and undo information is stored in the CLR, but the undo information will
never be used...
 2007-04-03 09:18:45 +00:00
Sears Russell
4f47613fe5 Fixed typo (print -> printf) 2007-03-30 09:20:03 +00:00
Sears Russell
8275eb71be Cleanup and refactoring for deferred updates. CLR's were broken; Tdefer requires them, so it is 
only partially implemented.
 2007-03-30 09:16:21 +00:00
Sears Russell
06de4dca0a Readability cleanups; fixed debug message. 2007-03-30 07:41:31 +00:00
Sears Russell
4c8466555c Cleaned up Tupdate() by adding TupdateRaw(); removed *_RAW and updated linear hash accordingly. 2007-03-28 09:21:07 +00:00
Sears Russell
cd352a6341 Removed out-of-date comments. 2007-03-19 21:55:47 +00:00
Sears Russell
6b60c10864 include config.h for 64-bit file support on 32-bit architectures 2007-03-13 09:19:32 +00:00
Sears Russell
d05cdfd357 Fixes compilation warning. 2007-03-13 08:53:54 +00:00
Sears Russell
4e6330492c Adaptor between the pageFile interface and stasis_handle_t 2007-03-13 08:40:31 +00:00
Sears Russell
6e749b93a4 bufferHash now seems to be correct, and makes use of the stasis_handle_t 
interface.
 2007-03-13 08:39:29 +00:00
Sears Russell
2e0ad972fd Bugfix. (lru->remove() wasn't removing node mapping.) 2007-03-13 08:32:04 +00:00
Sears Russell
11da78e46b Port for compatiblity with new API. 2007-03-13 08:31:15 +00:00
Sears Russell
2c6e674ab3 Streamlined bufferHash implementation, with new test-cases. 2007-03-11 07:55:00 +00:00
Sears Russell
17845a59ed A O(1) lru implementation. 2007-03-11 07:45:17 +00:00
Sears Russell
8145e8db6f A doubly linked list implementation. All operations are O(1), including the ability to remove things from 
within the list, assuming you already have an appropriate pointer to it.
 2007-03-11 07:37:20 +00:00
Sears Russell
15e77da1d4 more tests / bugfixes for buffermanager. 2007-03-10 01:29:43 +00:00
Sears Russell
d88aef1520 Replacement policy for new buffer manager 2007-03-08 07:58:24 +00:00
Sears Russell
61249c29a7 New "default" buffer manager that aims to replace the current one, but 
without deadlocks.  Still need to track down a memory corruption bug
that this introduces, or exercises.
 2007-03-08 07:56:53 +00:00
Sears Russell
5972fcc549 Sets p->dirty and p->LSN appropriately; checks their consistency. 2007-03-08 07:44:13 +00:00
Sears Russell
918fb9d375 Adds consistency checking for page lsn's. 2007-03-08 07:39:22 +00:00
Sears Russell
76cd6b5114 Added tryreadlock() and trywritelock(). 2007-03-08 07:36:02 +00:00
Sears Russell
8f3d503ea8 Added TdurabilityLevel(). 
Test cases now pass with LOG_TO_MEMORY and BUFFER_MANAGER_MEM_ARRAY
 2007-03-07 06:45:28 +00:00
Sears Russell
237bbe0fbe Added ability to override default bufferManager implementation with 
-DUSE_BUFFER_MANAGER
 2007-03-06 00:00:26 +00:00
Sears Russell
44aef7e8ea Added ability to override default logging implementation with 
-DUSE_LOGGER
 2007-03-05 23:56:38 +00:00
Sears Russell
8c633f633e un-dirty pages during releasePage 2007-03-04 02:52:31 +00:00
Sears Russell
c1bf2ba7ac New buffer manager implementation (very simple; just stores pages in memory, addressed via an array of pointers) 2007-03-04 02:46:23 +00:00
Sears Russell
e49e8c004e dirtyPages_deinit was broken. (Was excercised by new pageArray bufferManager...) 2007-03-04 02:44:19 +00:00
Sears Russell
5650953c4f Added .cvsignore files. 2007-03-04 00:40:15 +00:00
Sears Russell
26e5aa3069 truncation.c no longer includes on pageFile.h 2007-03-04 00:36:45 +00:00
Sears Russell
2d3fc4ba47 Changed malloc() to calloc() to prevent unpacked structs from leaking 
bytes to log
 2007-03-03 23:24:00 +00:00
Sears Russell
ca57875007 Fixed TisActiveTransaction, cleaned up Tinit(), Tdeinit(). 2007-03-03 22:51:07 +00:00
Sears Russell
078b45dbcc Removed and/or flagged #include dependencies on pageFile.h (in the process of further factoring bufferManager implementation out of Stasis.) 2007-03-03 02:26:17 +00:00
Sears Russell
73788eb910 Reworked intialization code, includes to isolate bufferManager 
implementation from the rest of Stasis.
 2007-03-03 01:52:03 +00:00
Sears Russell
b3152261b4 Xid -1 leads to illegal memory accesses. Added checks for it; fixed 
problematic unit test.
 2007-03-03 01:48:58 +00:00
Sears Russell
86a6c3ff77 Removed comment that warns about a solved problem 2007-03-03 01:46:44 +00:00
Sears Russell
006cd1e621 Moved roundUp/Down to 'static inline' in header; completed unit test's checks. 2007-02-12 07:54:32 +00:00
Sears Russell
4ae4ad54d7 deleted dead code / unnecessary comments. 2007-02-07 03:06:35 +00:00
Sears Russell
d2d631ff30 Rewrote pinnedRanges. 2007-02-07 03:04:19 +00:00
Sears Russell
fe30fbbd74 RangeTracker seems to be working; still need to write unit tests for its return value. 2007-02-06 02:32:01 +00:00
Sears Russell
3b1135ea2f Miscellaneous cleanups, slightly more conservative latching. 2007-01-30 18:26:59 +00:00
Sears Russell
99bcf8acd9 Randomized test; bugfixes 2007-01-25 22:38:22 +00:00
Sears Russell
05275bbe5a Tracks ranges in O(m log n) time. 2007-01-24 18:25:38 +00:00
Sears Russell
c2fa9913b1 Added partial implementation of range tracking for pinning arbitrary 
regions.  Currently, tracks regions, and is O(m log(n)) for each
operation, where m is the number of transition points per range, and n
is the number of transition points in the system.  A transition point is
a place in memory where the pincount changes.
 2007-01-24 01:03:52 +00:00
Sears Russell
f6ccaadc35 Updated slotted api to match fixed api; cleaned up dead code. 2007-01-22 20:55:25 +00:00
Sears Russell
9b49787931 typo in getSetRaw() 2007-01-22 20:54:04 +00:00
Sears Russell
346fe97161 Fixed race (wasn't grabbing lock); typo in getInstantSet 2007-01-22 20:53:26 +00:00
Sears Russell
3aa83e7a48 Added link to test.c from main API page, and doxygenified the test.c comments. 2006-12-18 01:12:30 +00:00
Eric Brewer
fcb0a33da9 New directory for testing application code 2006-12-18 00:48:18 +00:00
Sears Russell
5b56370980 Fixed append. (It wasn't calling updateEOF, as it should have been. Also, updateEOF assumed start_pos was zero) 2006-11-22 05:04:48 +00:00
Sears Russell
802eeb33e7 New non-blocking implementation, with backpressure. Still doesn't handle overlapping writes. (Multiple writes to the same region is OK though.) 2006-11-21 06:50:12 +00:00
Sears Russell
1dbf1145ca Update to detect changes in file size (to support multiple file handles...) 2006-11-21 06:47:35 +00:00
Sears Russell
b8d0ccce79 Modularized the build; made berkeleydb and confuse optional. No longer build as many things by default. 2006-11-09 23:00:50 +00:00
Sears Russell
9294f89277 Fix for fallback posix_memalign implementation. (Inserted missing 
casts)
 2006-11-08 07:22:42 +00:00
Sears Russell
450261f3c5 Fixed 32bit bug. 2006-11-07 22:37:05 +00:00
Sears Russell
c86688884a Updates for 32-bit x86. There are still real 32-bit bugs being emitted as compiler warnings. 2006-11-07 20:36:59 +00:00
Sears Russell
8481e9cdd6 non_blocking is closer to working (it now flushes writes out in the background). This required some api changes. It still passes unit tests, but it's losing data on close()... 2006-10-28 03:33:02 +00:00
Sears Russell
bb9e339823 changed to deal with new LinkedList api. 2006-10-28 03:31:27 +00:00
Sears Russell
aa445bdfe5 slightly more general purpose; deals with longs instead of ints. 2006-10-28 03:30:45 +00:00
Sears Russell
faf55911df Added non-blocking io implementation. It doesn't actually work yet, but it passes the unit tests. ;) 2006-10-26 05:48:30 +00:00
Sears Russell
10b77729f5 Simple (blocking, poor truncation performance) file handle implementation. 2006-10-18 00:57:36 +00:00
Sears Russell
b948e72518 Removed the rwl* code; no longer includes assert.h 2006-10-17 03:27:17 +00:00
Sears Russell
32347b12e4 Added a "debug" handle dumps a trace of requests passed to it, and passes the requests through to another handle implementation. 2006-10-17 03:26:01 +00:00
Sears Russell
80a4148543 First cut at a new io API, with an in-memory reference implementation + test case. 2006-10-13 04:39:03 +00:00
Sears Russell
e961a2bdb8 Fixed compile warning. 2006-10-07 20:05:54 +00:00
Sears Russell
1575d97a6b Fixed recovery bug. TregionDealloc was being called during redo(), causing an assert to fail. Without the 
assert, would have gone into infinite recursion.
 2006-10-05 22:08:42 +00:00
Sears Russell
71f51d11bc Fixed a performance bug that was causing logical operations to unnecessarily pin pages. 2006-10-05 22:05:50 +00:00
Sears Russell
f0612e7353 Documentation Fix 2006-10-05 00:51:24 +00:00
Sears Russell
3054256c6e Documentation fix 2006-10-05 00:51:01 +00:00
Sears Russell
6a9d81c78f Removed unneeded #includes. 2006-10-05 00:50:46 +00:00
Sears Russell
836d2d097d Fixed initialization bugs on pendingCommits and syncLogCount. Group commit used to hang with 100% CPU if a signal interrputed it. Now it ignores the signal. (Don't know why it's receiving a singal, so it warns when this happens...) 2006-10-05 00:50:21 +00:00
Sears Russell
2d136695ff Documentation Fix; FILE_PERM is now in constants.h 2006-10-05 00:47:05 +00:00
Sears Russell
84dcdf228f Documentation Fix 2006-10-05 00:46:18 +00:00
Sears Russell
212e3c4626 No longer compile page/header.c 2006-10-05 00:45:32 +00:00
Sears Russell
b06e3daf1b Should now be silent during normal operation. 2006-10-04 04:41:53 +00:00
Sears Russell
92a1ac3ee5 Recovery now ignores INTERNALLOG entries 2006-10-04 04:41:19 +00:00
Sears Russell
524ece3fa4 Limited "Leaking iterators" warning to once per run. 2006-10-04 04:40:38 +00:00
Sears Russell
6bb126debf Made "GetPage is stuck!" less obtrusive. 2006-10-04 04:39:58 +00:00
Sears Russell
4bd93ee66a Added support for computing size of internal log entries. 2006-10-04 04:38:21 +00:00
Sears Russell
fd7f4074af Added CRC's to log format. 2006-10-04 04:37:03 +00:00
Sears Russell
f01cff0d5b Cleaned up logger API, added truncation support to inMemoryLog.c 2006-09-27 20:30:12 +00:00
Sears Russell
fcf01f5d71 Cleaned up some old comments. 2006-09-27 20:28:44 +00:00
Sears Russell
f620aaedd6 Removed some dead code. 2006-09-27 20:27:49 +00:00
Sears Russell
986ee57020 More fixes to prevent tardis from running out of disk space. 2006-09-25 22:27:13 +00:00
Sears Russell
b615f0bc3e Towards 64-bit pageids. bufferManager can handle 64-bit offsets, but recordid.page is still 32 bit... 2006-08-11 19:31:42 +00:00
Sears Russell
8faf045e7d Fixed numerous bugs in allocationPolicy.c and alloc.c 
allocationPolicy.c was not handling deallocations correctly
Tdealloc() was not calling interpretRid() on its input before passing it into the allocationPolicy
Added locking support for TallocFromPage()
 2006-08-11 02:56:41 +00:00
Sears Russell
ef43a8d54f Added missing declaration of forcePageFile() 2006-08-11 02:42:17 +00:00
Sears Russell
b44551b941 fixed mutex checks 2006-08-11 02:25:17 +00:00
Sears Russell
7dada65a13 Addded "interpretRid" which knows how to call the "dereference*" functions. 2006-08-11 02:24:01 +00:00
Sears Russell
51c5b60047 Fix race in TallocFromPage() 2006-08-11 00:01:12 +00:00
Sears Russell
73436d0d6c Disables fsckSlottedPage() by default. 2006-08-10 23:59:13 +00:00
Sears Russell
7ba91533fe Added assertions to make sure that the region mutex is held when 
appropriate.
 2006-08-10 23:57:49 +00:00
Sears Russell
af175896cb Added logWriter_isDurable. If = 0, then the log will never be forced. 2006-08-10 23:54:46 +00:00
Sears Russell
1b6c828bd2 Added logWriter_isDurable. If set to zero, the log will never be forced 
to disk.
 2006-08-10 23:53:51 +00:00
Sears Russell
3a43450477 Force in-flight page file writes to disk before truncating. (Needed if 
O_DIRECT isn't in use.)

Changed diagnostic messages to go to stderr.
 2006-08-10 23:52:48 +00:00
Sears Russell
f93b2acf69 Now, you can set pageFile_isDurable=0 to disable forcing data to the 
page file.

Also, -DPAGE_FILE_O_DIRECT switches the page file from using a normal
file handle and fdatasync to use O_DIRECT with no fdatasync.
 2006-08-10 23:51:15 +00:00
Sears Russell
6f9c6af99c memoized loadPage() (per thread) 
no longer requires pbl compatibility wrappers
 2006-08-10 23:45:25 +00:00
Sears Russell
7847331771 Minor cleanup, added ability to calculate the global average number of 
buckets traversed per find().  Added a warning for code that actually
relies upon PBL's way of interpreting insert.
 2006-08-10 23:43:53 +00:00
Sears Russell
d3f87b5af4 Added support for locking on deallocation. 2006-08-10 23:39:36 +00:00
Sears Russell
6fcaf34bb5 Needed to protect a linked list with a mutex. It's suprising that this hasn't come up before. 2006-08-08 01:41:45 +00:00
Sears Russell
8a390c40d2 Improved latch profiling, especially for loadPage. 2006-08-04 23:45:27 +00:00
Sears Russell
c413203ec8 Talloc() now reuses space when possible. It still needs to call slottedCompact() intelligentally. Also, allocationPolicy should support an extra tier 
of pages, so it doesn't suggest ones that aren't already in the buffer pool unless it has to.
 2006-07-29 00:56:54 +00:00
Sears Russell
783d1d6ffd Removed the fixed page initialization operations, which weren't being used, and were a slow hack anyway. There is now a more-general (and efficient) 
implementation in alloc.c
 2006-07-29 00:54:01 +00:00
Sears Russell
cdd44a2f2d Initial import of redblack implementation. 2006-07-28 00:01:57 +00:00
Sears Russell
3725cc9b8e Added a function that returns the number of allocated entries in the list 2006-07-28 00:00:32 +00:00
Sears Russell
165b91cf76 compensations_init() was being called too late. 2006-07-27 23:59:21 +00:00
Sears Russell
a3d0f6f6f5 Added support for concurrent transactions (by using nested top actions). 2006-07-27 00:15:29 +00:00
Sears Russell
1988cf297d The "WARNING: Tdeinit() is aborting transaction %d" runtime message now 
lists the xid of the transaction it's aborting instead of "-1".

TisActiveTransaction(xid) now returns 0 for INVALID_XID.  Before the
output was undefined.
 2006-07-27 00:13:20 +00:00
Sears Russell
d1da4e59c0 Fixed segmentation fault when a CLR with a NULLRID is encountered. I 
don't understand why this bug wasn't triggered by linearHashNTA or
linkedListNTA, but is triggered by the new region implementation.
 2006-07-27 00:10:21 +00:00
Sears Russell
7888d647ed Removed unused abort/commit callbacks. 2006-07-26 17:48:36 +00:00
Sears Russell
62abe94bf5 added fsckRegions(), and call it from the unit tests. 2006-07-25 22:23:15 +00:00
Sears Russell
aec9148b83 added call to get the page type. 2006-07-25 22:22:49 +00:00
Sears Russell
41528ef066 Fixed lockManager. lhtable's iterators do not support concurrent modifications. 2006-07-25 19:12:53 +00:00
Sears Russell
8e419845be removed assert() that checks to make sure that Tupdate() didn't pass a page pointer in. 2006-07-25 01:24:49 +00:00
Sears Russell
8aad1b896a pthread.h | rw.h -> latches.h (Otherwise, -DPROFILE_LATCHES doesn't work. 2006-07-25 01:06:01 +00:00
Sears Russell
45a5996215 Documented subtle hack; TallocPage() really needs a way to set page type at recovery. Currently, this just doesn't happen, since page types are lazily set. 
Perhaps Talloc() could handle it?
 2006-07-25 01:05:02 +00:00
Sears Russell
8485cc7fe1 Added missing releasePage(). 2006-07-25 01:03:57 +00:00
Sears Russell
745975112f Removed an assert that assumed pages aren't reused. 2006-07-25 01:03:07 +00:00
Sears Russell
747bc9cdc9 Removed #defines for broken ptrheads stuff. 2006-07-25 01:02:27 +00:00
Sears Russell
9721e86133 Commented out (currently broken) pthreads instrumentation, added readLock tracking to the latch instrumentation. 2006-07-25 01:01:46 +00:00
Sears Russell
2a9cb788a6 if LONG_TEST is defined, check for pinned pages on exit. 
This test is currently implemented inefficiently, otherwise it would always be enabled.
 2006-07-25 01:00:46 +00:00
Sears Russell
a5a234635e readBlob() no longer writes the blob contents to the log. ;) 2006-07-25 00:58:28 +00:00
Sears Russell
0f45b97eda regions now make use of nested top actions, so they're almost correct. (Still need to lock freed regions until end of transaction.) 2006-07-25 00:56:50 +00:00
Sears Russell
86fab6a22b Turn on paranoid slotted page consistency checks for long running tests. 2006-07-22 00:05:40 +00:00
Sears Russell
2af892709f Rewrote slottedCompact; added fsckSlottedPage 2006-07-22 00:01:42 +00:00
Sears Russell
0725af91be Fixed page leak in Talloc(). 2006-07-21 01:07:09 +00:00
Sears Russell
eb13531c0f Partial handling of incomplete log entries. (It detects when the log file does not end at the right byte, but doesn't checksum, or otherwise look for 
sectors that didn't make it to disk.)
 2006-07-21 01:06:35 +00:00
Sears Russell
1ff1d4c128 Re-enabled truncation (accidentally disabled it before...) 2006-07-20 01:30:58 +00:00
Sears Russell
ffd3bd960b switched to region allocator, but TpageAlloc currently grabs its own region... 2006-07-20 01:29:39 +00:00
Sears Russell
7bc60c3ac4 fixed the fixedPageAlloc hack. 2006-07-20 00:49:28 +00:00
Sears Russell
8ed909e79d Fixed the fixedPageAlloc hack. 2006-07-20 00:48:42 +00:00
Sears Russell
1ac3dc6779 More progress on boundary tags. (Still not tested/working yet...) 2006-07-18 23:59:00 +00:00
Sears Russell
bf98e32c73 fixed build 2006-06-22 23:31:42 +00:00
Sears Russell
93e7e96ea3 Started implementing the region allocator 2006-06-22 19:10:02 +00:00
Sears Russell
d26263262b Completely new blob implementation. Slower than the old one was supposed to be, but is correct, and extremeley 
simple.  It simply writes the pre-image and post-image of each blob to the log using TpageSet.
 2006-06-21 00:45:18 +00:00
Sears Russell
c8c9b7af19 the logger understands special record types. (At least partially...); shortened blob tests, since the blob 
implementation is fundamentally broken, and slow
 2006-06-20 23:02:27 +00:00
Sears Russell
6485a4aae9 No more PBL. 2006-06-20 21:44:17 +00:00
Sears Russell
4d79c0a466 Simplified allocation 2006-06-20 21:40:21 +00:00
Sears Russell
e14877821f Fixed blob bug. The reason it's so slow is that it's logging a preimage + postimage of each blob and then synchronously writing to a second copy each time the blob is 
written to(!!!)
 2006-06-20 00:03:38 +00:00
Sears Russell
3e4cac0fe3 Continued cleaning up allocation code. It seems really slow all of a sudden, so this commit probably introduced a performance bug. 2006-06-17 00:25:09 +00:00
Sears Russell
209a6916e5 Updated some comments. 2006-06-16 00:27:02 +00:00
Sears Russell
dc8a3e5d60 Eliminated slottedPreRalloc 2006-06-16 00:05:44 +00:00
Sears Russell
245db32c23 Two programs to create and quickly query a read-only on disk hash table 2006-06-15 22:28:39 +00:00
Sears Russell
50515ffd23 More steps toward factoring page allocation out of record allocation. 2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8 half-hearted attempt to fix -Wextra warnings... 2006-06-13 23:58:04 +00:00
Sears Russell
a3678aad5c Now AM_CFLAGS can be set by modifying GLOBAL_CFLAGS in the root 
Makefile.am
 2006-06-13 22:48:50 +00:00
Sears Russell
f53a46e788 removed heisenbug 2006-06-13 22:47:38 +00:00
Sears Russell
1b3a08d434 added some todos 2006-06-13 22:46:11 +00:00
Sears Russell
1cf3119eb7 renamed __really_do_ralloc to really_do_ralloc 2006-06-13 22:45:30 +00:00
Sears Russell
66ae3b9763 Made it more obvious that a suspicious looking assert is commented out 2006-06-13 22:44:40 +00:00
Sears Russell
24a5da9648 Fixed deprecated volatile static declaration (-> static volatile) 2006-06-13 22:43:58 +00:00
Sears Russell
33af9805ad printf -> fprintf(stderr, and assert(0) -> abort() 2006-06-13 22:43:20 +00:00
Sears Russell
f77e8b240d It was improperly tracking the log's global offset. (Hopefully) 
fixed offset tracking, made it optional, and disabled it.
 2006-06-13 22:42:15 +00:00
Sears Russell
c5add15bd3 assert(0) -> abort 2006-06-13 22:40:53 +00:00
Sears Russell
eab6385ca5 Moved #defines below definition of Page_s. 2006-06-13 22:40:24 +00:00
Sears Russell
f89903d529 moved stdio.h include out of header file. 2006-06-13 22:38:25 +00:00
Sears Russell
e56c46b95c Moved blob_record_t into transactional.h (part of transition to using 
slot type lookup tables.)
 2006-06-13 22:37:29 +00:00
Sears Russell
a11fbdd9e6 Did away with slottedPreRallocFromPage. 2006-06-13 20:00:46 +00:00
Sears Russell
cef9e2c4ce Added settings for longer-running tests 2006-06-12 22:45:41 +00:00
Sears Russell
e0b34633ec Fixed broken min_rec_lsn() semantics; before, if there were not outstanding transactions / writes, 
then these calls would return flushedLSN().  The problem was that flushedLSN wasn't guaranteed to
return a pointed to the beginning of a log entry.
 2006-06-12 21:50:21 +00:00
Sears Russell
7bb0ce0d17 Fixed truncation bug (truncation is more aggressive now), and added more debugging info. 2006-06-12 20:55:49 +00:00
Sears Russell
27f7df6f09 Fixed races on flushedLSN and page->dirty. 2006-06-12 20:05:28 +00:00
Sears Russell
35a5e80871 removed bogus .deps files. 2006-06-01 22:18:50 +00:00
Sears Russell
fd19036843 Added more complete hashtable test; fixed incorrect return value in LH_ENTRY(find) 2006-05-31 00:37:56 +00:00
Sears Russell
0649f179b3 Got rid of the ~1 second delay on exit. 2006-05-30 22:59:22 +00:00
Sears Russell
68dcc2067e No more warnings with -O2. 2006-05-25 22:50:52 +00:00
Sears Russell
8ce9e6127f Fixed return value in removeFromLinkedList 2006-05-25 22:48:15 +00:00
Sears Russell
b5d578f4e0 Fixed remaining warnings, got rid of alTupdate 2006-05-25 20:08:12 +00:00
Sears Russell
fda416090b Fixed a bunch of 'easy' warnings 2006-05-25 00:02:46 +00:00
Sears Russell
cb3a4ae20d Bucket list extension working. 2006-05-24 23:24:31 +00:00
Sears Russell
8b54b0d265 No longer attempts to truncate when long transactions prevent it from 
being useful...
 2006-05-24 23:21:33 +00:00
Sears Russell
827e0d891a The linear hashtable implementation (to replace pbl's) 2006-05-24 02:23:58 +00:00
Sears Russell
2e06cafaa8 2006-05-24 02:19:04 +00:00
Sears Russell
4c168d8fb2 Fixed truncation bugs, and a minor test case bug. 2006-05-22 23:59:02 +00:00
Sears Russell
f06159b3cd forgot to add these... 2006-05-19 20:17:44 +00:00
Sears Russell
ef43d5e4ce Implemented log truncation. 2006-04-14 03:45:26 +00:00
Sears Russell
11c311bc91 Added support for raw pages, implemented posix_memalign workaround, and re-enabled O_DIRECT by default 2006-04-12 01:41:35 +00:00
Sears Russell
33cbbb0e2d In memory logging implementation 2006-04-12 01:40:47 +00:00
Sears Russell
ab541b7dc8 Created bufferPool, moved memory management for page structs to it 2006-04-11 20:35:21 +00:00
Sears Russell
c29b16a6ed Created new module, bufferPool, and moved memory management for page structs to it. 2006-04-11 20:34:52 +00:00
Sears Russell
c1d8906d28 removed memcpy() calls from inMemoryLog; added "const" qualifier to many LogEntry pointers. 2006-04-11 02:20:21 +00:00
Sears Russell
7decae7172 All tests that pass with LOG_TO_FILE now pass with LOG_TO_MEMORY, but LOG_TO_MEMORY is slow, and seems to be 
killing malloc's performance for some reason.  (linearHashNTA spends many seconds in free() between unit
tests...)
 2006-04-08 00:05:09 +00:00
Sears Russell
d3d7f2c788 Implemented "LOG_TO_MEMORY", which mostly works (linear hash NTA goes into an infinite loop....) 2006-04-07 03:40:40 +00:00
Sears Russell
1c979f3052 Factored logWriter.h out of the rest of the system. The only file that directly depends on it is logger2.c, which can 
now dispatch requests to different (hardcoded) log implementations.
 2006-04-06 03:22:57 +00:00
Sears Russell
10e7434d32 corrected slottedFrespace()'s declaration (it was returning an int, but needed to return a size_t 2006-04-05 02:54:14 +00:00
Sears Russell
d9f1df0476 Fixed behavior when __really_do_ralloc() is called, but the record's slot is greater than numslots_ptr(). 
Optimized slotted_compact and __really_do_ralloc() so that they try to put lower numbered slots earlier in the freelist.
 2006-04-05 02:52:40 +00:00
Sears Russell
d896155b82 Fixed freespace measurement during recovery/abort by adding slottedFreespaceForSlot() 
(This version is still broken, because __really_do_ralloc() does not properly increment numslots_ptr
 2006-04-05 00:38:11 +00:00
Sears Russell
041bfce736 The bucket list entries for variable lenth hash tables were too long, causing memory corruption, and wasting space+log bandwidth 2006-04-04 22:34:35 +00:00
Sears Russell
959233566c changed type of lsn variables to "lsn_t" 2006-04-04 22:33:30 +00:00
Sears Russell
8e0bd2ecd2 Extra check for end of iterator. 2006-04-04 22:32:48 +00:00
Sears Russell
2250b7a6c7 More freespace troubles... Should be correct now. 2006-03-28 21:27:10 +00:00
Sears Russell
3c55daede9 The freespace calculations were double counting the new slot's header. 2006-03-28 21:21:47 +00:00
Sears Russell
ced022d0fe partial fixes 2006-03-28 20:15:31 +00:00
Sears Russell
bb37db0857 Partial port to amd64. 2006-03-20 23:11:46 +00:00
Colleen M. Lewis
5bfcbdb076 Bug fixed: TfixedPageAlloc calls fixedPageInitialize with the wrong arguments. 2005-10-31 23:21:18 +00:00
Colleen M. Lewis
345f0cde78 Added the base functionality and test case for the BTree... just a hello world method. but it has the h, c and check files. -colleen ;) 2005-05-05 21:34:12 +00:00
Sears Russell
6b95cefc62 Fixed logWriter abort performance bug, also cleaned up the file, simplified locking, etc. 2005-04-14 04:23:22 +00:00
Sears Russell
a053b19757 removed extraneous abort 2005-04-14 01:43:14 +00:00
Sears Russell
3844b641a3 final transclos benchmark 2005-03-25 16:33:36 +00:00
Sears Russell
08ceca11ce Enabled compactPage in TallocFromPage() 2005-03-24 11:04:06 +00:00
Sears Russell
4c1ca194d0 Major edits throughout the paper. 2005-03-24 10:00:08 +00:00
Sears Russell
cf58e1fb72 Transitive closure working! 2005-03-24 04:43:22 +00:00
Sears Russell
2f99ed4664 Generic consumer wrapper functions, and implementation registrations. 2005-03-23 08:10:30 +00:00
Sears Russell
ee9eb416ea Implemented fifo pool that allocates entries out of a pool (it should be easy to extend this to avoid deadlock, while allowing it to continue to provide backpressure) 2005-03-23 08:07:53 +00:00
Sears Russell
6228931e58 A simple script that interprets the CI data, and allows basic calculations to be performed using command line arguments. 2005-03-21 22:32:28 +00:00
Sears Russell
b38db5b52b Added figures to paper. 2005-03-21 22:31:43 +00:00
Sears Russell
6d4216bc2a Preliminary (broken) transitive closure implementation. 2005-03-21 08:04:29 +00:00
Mike Demmer
c1997d8350 misc fixes to the script 2005-03-20 06:39:44 +00:00
Sears Russell
ef3c30b190 Benchmark updates. 2005-03-20 05:17:25 +00:00
Sears Russell
26d50f19e3 Cleaned up berkeley db tests / lladd logger optimizations + bug fix. 2005-03-19 20:28:30 +00:00
Sears Russell
97bf995022 changes for diff, commit prior to deleteing a lot of old bdb cruft 2005-03-18 23:26:25 +00:00
Sears Russell
d8eb6c9aa7 Major benchmark update; log force merging. 2005-03-17 04:38:55 +00:00
Sears Russell
bf4be359b3 Partially refactored logMemory and multiplexer into a fifo implementation. Added support to fifoPool for 
asynchronous threads running round-robin through the dirty fifos consuming entries in idle ones.
 2005-03-16 00:52:21 +00:00
Sears Russell
dffff067bb multiplexer and fifo are now working. (also added removed some timeouts from tests that were timing out) 2005-03-15 05:30:57 +00:00
Sears Russell
ed9b978bda Another commit on behalf of jimmy. (Fixing the build is hard!) 2005-03-15 01:57:43 +00:00
Sears Russell
602608b60b Adding new files for jimmy... 2005-03-15 01:29:04 +00:00
Jimmy Kittiyachavalit
80ed16c18e Initial implementation of logMemory.c. Haven't yet done any testing, but it seems to compile. However, as of now, the current source code in the cvs repository does not build, dying on check_<somehting (I think ringbuffer.x)>, due to an a reference to an undefined symbol 'mutex'. 2005-03-14 20:54:06 +00:00
Sears Russell
7971df14bf Bugfixes (compiles now) 2005-03-14 08:47:13 +00:00
Sears Russell
9be3c4edd3 Initial upload of (untested) multiplexer implementation. 2005-03-14 00:58:47 +00:00
Sears Russell
ed49949512 This commit breaks the build so that Jimmy and I can sync. Sorry. :( 2005-03-14 00:25:29 +00:00
Sears Russell
1bfb634103 Preliminary benchmark program uploads for SEDA-style response time percentiles vs requests / second 
Also added a few cute little utilities:
  - truncate_log
  - run_recovery

Upped max # of concurrent transactions.  (Current throughput during benchmarking remains ~flat up to 32,000
threads, but past max concurrent transactions was 1,000...)
 2005-03-12 22:11:18 +00:00
Sears Russell
18c772234d new benchmarks revealed that inserts for linkedList, pageOrientedList were taking O(n) time, yielding O(n^2) 
time to build a list, since the lists could not contain duplicate keys.  These operations are now O(1), and
the lists can contain duplicates.
 2005-03-10 20:10:49 +00:00
Sears Russell
f28df29736 Fixed unit tests, added iterator interface, and generic (almost) iterator test harness. 2005-03-10 03:19:04 +00:00
Sears Russell
935de3aeb5 minor changes 2005-03-09 03:24:36 +00:00
Sears Russell
e22d4b8e59 Partial implementation of ringbuffer for in-memory long, among other things. 2005-03-08 07:53:53 +00:00
Sears Russell
a3112ee81c Fixes for freebsd. 2005-03-02 05:47:38 +00:00
Sears Russell
c8a0aa830e Compiles on FreeBSD! 2005-03-02 05:46:29 +00:00
Sears Russell
7833177f05 Fixed the support for more than MAX_TRANSACTION total transactions. 2005-03-02 03:28:00 +00:00
Sears Russell
3e5f7aea8a Bugfixes for OASYS. 2005-03-01 07:32:02 +00:00
Sears Russell
3b88909c5f Fixed compensations test; FreeBSD fix (?) for makefile. 2005-02-28 00:00:17 +00:00
Sears Russell
890a7385d0 Fixeds cht test / finished error checking within LLADD, but haven't tested error handling yet. 2005-02-24 21:12:36 +00:00
Sears Russell
29dacbe7ed Error handling for linked list. 2005-02-22 23:11:03 +00:00
Sears Russell
41fb85eef0 More error handling... 2005-02-22 03:10:54 +00:00
Sears Russell
84a20a3c96 Started adding error handling code to LLADD. 2005-02-16 04:11:14 +00:00
Sears Russell
f4484e35b5 Update for perl script; added return type handling. 2005-02-16 02:13:54 +00:00
Sears Russell
fdf5344ec3 Implemented 'compensations' for C. They're not proper compensations, but they're more flexible than pthread's mechanisms, as they allow the stack to be partially rolled up. (Although calling functions need to either check for errors and return manually, or wrap calls to error-producing callees in a begin_action{ }end_action block. 2005-02-14 02:49:59 +00:00
Sears Russell
2ac1302062 Recovery now supports the lock manager. (And vice-versa ;) 2005-02-10 21:56:32 +00:00
Sears Russell
8bf6ea29ff Added @todo that details requirements for next version of alloc. 2005-02-10 21:55:35 +00:00
Sears Russell
b8a67cbfb2 Numerous lock manager fixes; more realistic test case for lock manager, added support for optional page-level locking.(Still need to report deadlocks back up to the caller.) 2005-02-10 03:51:09 +00:00
Sears Russell
6f022cc577 Some random code cleanups, and implemented a naive lock manager. (Still need to tie it into LLADD...) 2005-02-09 02:53:14 +00:00
Gilad Arnold
815942ed4c - some further API improvements (?). 2005-02-08 23:56:47 +00:00
Gilad Arnold
307f268fdc - working with flags instead of Boolean arguments; replaced some specialized 
function calls with header-file macros.
 2005-02-08 22:06:24 +00:00
Gilad Arnold
b0a9265d1a - enhanced init/shutdown semantics: init may now be re-issued, following a 
predecessing shutdown; note that shutdown does not deallocate objects (either
  persistent or non-persistent), hence re-init would use the same objects as in
  the previous run (assuming they are all intact).
 2005-02-08 08:04:35 +00:00
Sears Russell
258dd5f4c4 Fixed up some return values; tests now pass with assert disabled. 2005-02-08 01:13:57 +00:00
Gilad Arnold
eec80a0e38 - improvement to error handling in pobj: now properly handles resource 
allocation errors (at least most cases...?), including hash/queue
  library calls.
 2005-02-08 00:54:30 +00:00
Gilad Arnold
c94bee33a3 - cosmetic changes to debug logging. 2005-02-07 07:59:40 +00:00
Gilad Arnold
037c164728 - cosmetic fixes in hash module 
- new debug facility to show context-based (stack) debugging messages; turned on
  by corresponding compile switch (HAVE_DEBUG_CONTEXTS, currently hard-coded in
  debug.h)

- added use of dedicated queue module (supporting dynamic allocation and
  growable buffers).

- improvement w.r.t. full error handling in pobj.c: tackled some error cases
  with library calls (malloc, hash module calls, etc) -- but still there's a way
  to go.
 2005-02-07 07:11:52 +00:00
Sears Russell
e33319175f Fixed some cht bugs. Abort is flakey. 2005-02-06 03:48:12 +00:00
Gilad Arnold
f96061a1bd - implementation of growable queues; to replace fix-sized queues used 
in recursive traversal functions.
 2005-02-03 21:22:14 +00:00
Gilad Arnold
91f2c7c382 - moved pobj header internals back into the .c file (sorry Amir) 
- added pobj_is_persistent() call to replace the formerly used macro

- minor rearragement of common contants/macros

- minor fix to makefile
 2005-02-03 21:05:48 +00:00
Gilad Arnold
1fd827a59e - cosmetic: changes all shorthand for 'repository' from 'rep' to 'repo'... 
- handling error return value of hash_insert in two cases (still two other left)
 2005-02-03 20:43:15 +00:00
Gilad Arnold
570dc16f70 - minor: hash_insert returns an error in case of memory allocation failure 2005-02-03 20:40:31 +00:00
Gilad Arnold
c3229723ab - removed std99 and pedantic flags for GCC (caused annoying warnings 
with variable argumented macros).
 2005-02-03 20:39:11 +00:00
Sears Russell
a27787b2fa Cluster hash table now allows transactions to contain multiple requests. 2005-02-03 02:01:23 +00:00