Commit graph

427 commits

Author SHA1 Message Date
Sears Russell
7fb4fd4c1a Updated svn:ignore. 2007-10-03 01:52:41 +00:00
Sears Russell
c9bbf3af94 Converted page.h to follow new naming convention; documented new page api; begun stasis documentation cleanup. 2007-10-02 00:18:33 +00:00
Sears Russell
5f954eb239 Final commit from google. 2007-08-24 23:01:08 +00:00
Sears Russell
5bd2138a8b Fixes a number of memory leaks; adds pageCleanup() callback, and allows callers to use custom allocators with LSM trees 2007-08-20 21:58:20 +00:00
Sears Russell
9c1c284406 Implemented range scans; lsmTree now supports keys that are stored as fixed length byte arrays. 2007-08-20 16:53:16 +00:00
Sears Russell
519bd515f4 New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes. 2007-08-20 16:25:08 +00:00
Sears Russell
90f011b049 New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes. 2007-08-20 16:23:57 +00:00
Sears Russell
8963d6d381 Fixed recordNext(), add unit test for recordNext() on slotted and fixed pages. 2007-08-20 16:04:44 +00:00
Sears Russell
8367dfe9a3 releasePage() is now a function, not a function pointer. releasePageImpl is the name of the new function pointer. 2007-08-14 01:20:08 +00:00
Sears Russell
9745d62887 Preliminary LSM tree implementation (hardcodes keys as ints for now) 2007-08-14 01:17:31 +00:00
Sears Russell
a773c4d8b7 Bugfixes and improved error handling for recovery tests and registerPageType() 2007-07-19 23:47:06 +00:00
Sears Russell
f539011e9f Implemented simulateBufferManagerCrash. 2007-07-19 16:36:17 +00:00
Sears Russell
3d84412cea It is now possible to register page types before Tinit() is called, so that they may be used by recovery. 2007-07-19 16:35:11 +00:00
Sears Russell
7ca0619db0 Adds a void * to Page_s so that page implementations can store information with the pages they manage. 2007-07-18 20:10:10 +00:00
Sears Russell
9fd91cffb8 Updated page api to handle page types that need to grab resources on record read/ write, or that perform callbacks when read / written to disk. 2007-07-18 20:09:14 +00:00
Sears Russell
356387eafe support "make install", and use libtool to generate .so, .a files. 2007-06-25 15:47:28 +00:00
no author
d0274c3304 Renamed 'lladd' directories and python module to 'stasis' 2007-06-11 21:36:57 +00:00
Sears Russell
4998e57566 Updated for the new page API 2007-06-07 21:53:09 +00:00
Sears Russell
2f7da41663 Whitespace; restoring lost call to checkRid 2007-06-01 22:20:25 +00:00
Sears Russell
5e1445777f Should have gone in with the rest of the nowarn patch 2007-06-01 22:16:42 +00:00
Sears Russell
dd7c6b857d Added assertlock() and call it when page implementations assume a page has already been latched. (Fixed
associated bugs as well)
2007-06-01 21:32:33 +00:00
Sears Russell
d1aeba8a82 Cleaned up obsolete @todo's; fixed inconsistent page file initialization 2007-06-01 21:06:18 +00:00
Sears Russell
951a897040 Add casts to prevent warnings on (upcoming changes to) recordRead, recordWrite 2007-05-31 22:40:19 +00:00
Sears Russell
bff22716a7 Updated page.h's interface to make it more consistent. 2007-05-31 01:15:12 +00:00
Mark Callaghan
12c7f6a1c5 Simple SWIG interface 2007-05-30 23:48:36 +00:00
Sears Russell
a3885944a0 Messed with documentation to try to make doxygen happy and more likely to see this file. 2007-05-26 01:03:57 +00:00
Sears Russell
22dfd5a117 Fixed use after free. 2007-04-21 07:51:33 +00:00
Sears Russell
05ad97b37b Was releasing log_read_mutex without obtaining it first... 2007-04-20 07:13:18 +00:00
Sears Russell
362b1036de Changed CLR log format so that it is identical to update entries. The old format pointed back to an earlier
entry in the log, complicating truncation significantly.  The new format copies log entries into their CLRs,
and is somewhat redundant, as redo and undo information is stored in the CLR, but the undo information will
never be used...
2007-04-03 09:18:45 +00:00
Sears Russell
4f47613fe5 Fixed typo (print -> printf) 2007-03-30 09:20:03 +00:00
Sears Russell
8275eb71be Cleanup and refactoring for deferred updates. CLR's were broken; Tdefer requires them, so it is
only partially implemented.
2007-03-30 09:16:21 +00:00
Sears Russell
06de4dca0a Readability cleanups; fixed debug message. 2007-03-30 07:41:31 +00:00
Sears Russell
4c8466555c Cleaned up Tupdate() by adding TupdateRaw(); removed *_RAW and updated linear hash accordingly. 2007-03-28 09:21:07 +00:00
Sears Russell
cd352a6341 Removed out-of-date comments. 2007-03-19 21:55:47 +00:00
Sears Russell
6b60c10864 include config.h for 64-bit file support on 32-bit architectures 2007-03-13 09:19:32 +00:00
Sears Russell
d05cdfd357 Fixes compilation warning. 2007-03-13 08:53:54 +00:00
Sears Russell
4e6330492c Adaptor between the pageFile interface and stasis_handle_t 2007-03-13 08:40:31 +00:00
Sears Russell
6e749b93a4 bufferHash now seems to be correct, and makes use of the stasis_handle_t
interface.
2007-03-13 08:39:29 +00:00
Sears Russell
2e0ad972fd Bugfix. (lru->remove() wasn't removing node mapping.) 2007-03-13 08:32:04 +00:00
Sears Russell
11da78e46b Port for compatiblity with new API. 2007-03-13 08:31:15 +00:00
Sears Russell
2c6e674ab3 Streamlined bufferHash implementation, with new test-cases. 2007-03-11 07:55:00 +00:00
Sears Russell
17845a59ed A O(1) lru implementation. 2007-03-11 07:45:17 +00:00
Sears Russell
8145e8db6f A doubly linked list implementation. All operations are O(1), including the ability to remove things from
within the list, assuming you already have an appropriate pointer to it.
2007-03-11 07:37:20 +00:00
Sears Russell
15e77da1d4 more tests / bugfixes for buffermanager. 2007-03-10 01:29:43 +00:00
Sears Russell
d88aef1520 Replacement policy for new buffer manager 2007-03-08 07:58:24 +00:00
Sears Russell
61249c29a7 New "default" buffer manager that aims to replace the current one, but
without deadlocks.  Still need to track down a memory corruption bug
that this introduces, or exercises.
2007-03-08 07:56:53 +00:00
Sears Russell
5972fcc549 Sets p->dirty and p->LSN appropriately; checks their consistency. 2007-03-08 07:44:13 +00:00
Sears Russell
918fb9d375 Adds consistency checking for page lsn's. 2007-03-08 07:39:22 +00:00
Sears Russell
76cd6b5114 Added tryreadlock() and trywritelock(). 2007-03-08 07:36:02 +00:00
Sears Russell
8f3d503ea8 Added TdurabilityLevel().
Test cases now pass with LOG_TO_MEMORY and BUFFER_MANAGER_MEM_ARRAY
2007-03-07 06:45:28 +00:00
Sears Russell
237bbe0fbe Added ability to override default bufferManager implementation with
-DUSE_BUFFER_MANAGER
2007-03-06 00:00:26 +00:00
Sears Russell
44aef7e8ea Added ability to override default logging implementation with
-DUSE_LOGGER
2007-03-05 23:56:38 +00:00
Sears Russell
8c633f633e un-dirty pages during releasePage 2007-03-04 02:52:31 +00:00
Sears Russell
c1bf2ba7ac New buffer manager implementation (very simple; just stores pages in memory, addressed via an array of pointers) 2007-03-04 02:46:23 +00:00
Sears Russell
e49e8c004e dirtyPages_deinit was broken. (Was excercised by new pageArray bufferManager...) 2007-03-04 02:44:19 +00:00
Sears Russell
5650953c4f Added .cvsignore files. 2007-03-04 00:40:15 +00:00
Sears Russell
26e5aa3069 truncation.c no longer includes on pageFile.h 2007-03-04 00:36:45 +00:00
Sears Russell
2d3fc4ba47 Changed malloc() to calloc() to prevent unpacked structs from leaking
bytes to log
2007-03-03 23:24:00 +00:00
Sears Russell
ca57875007 Fixed TisActiveTransaction, cleaned up Tinit(), Tdeinit(). 2007-03-03 22:51:07 +00:00
Sears Russell
078b45dbcc Removed and/or flagged #include dependencies on pageFile.h (in the process of further factoring bufferManager implementation out of Stasis.) 2007-03-03 02:26:17 +00:00
Sears Russell
73788eb910 Reworked intialization code, includes to isolate bufferManager
implementation from the rest of Stasis.
2007-03-03 01:52:03 +00:00
Sears Russell
b3152261b4 Xid -1 leads to illegal memory accesses. Added checks for it; fixed
problematic unit test.
2007-03-03 01:48:58 +00:00
Sears Russell
86a6c3ff77 Removed comment that warns about a solved problem 2007-03-03 01:46:44 +00:00
Sears Russell
006cd1e621 Moved roundUp/Down to 'static inline' in header; completed unit test's checks. 2007-02-12 07:54:32 +00:00
Sears Russell
4ae4ad54d7 deleted dead code / unnecessary comments. 2007-02-07 03:06:35 +00:00
Sears Russell
d2d631ff30 Rewrote pinnedRanges. 2007-02-07 03:04:19 +00:00
Sears Russell
fe30fbbd74 RangeTracker seems to be working; still need to write unit tests for its return value. 2007-02-06 02:32:01 +00:00
Sears Russell
3b1135ea2f Miscellaneous cleanups, slightly more conservative latching. 2007-01-30 18:26:59 +00:00
Sears Russell
99bcf8acd9 Randomized test; bugfixes 2007-01-25 22:38:22 +00:00
Sears Russell
05275bbe5a Tracks ranges in O(m log n) time. 2007-01-24 18:25:38 +00:00
Sears Russell
c2fa9913b1 Added partial implementation of range tracking for pinning arbitrary
regions.  Currently, tracks regions, and is O(m log(n)) for each
operation, where m is the number of transition points per range, and n
is the number of transition points in the system.  A transition point is
a place in memory where the pincount changes.
2007-01-24 01:03:52 +00:00
Sears Russell
f6ccaadc35 Updated slotted api to match fixed api; cleaned up dead code. 2007-01-22 20:55:25 +00:00
Sears Russell
9b49787931 typo in getSetRaw() 2007-01-22 20:54:04 +00:00
Sears Russell
346fe97161 Fixed race (wasn't grabbing lock); typo in getInstantSet 2007-01-22 20:53:26 +00:00
Sears Russell
3aa83e7a48 Added link to test.c from main API page, and doxygenified the test.c comments. 2006-12-18 01:12:30 +00:00
Eric Brewer
fcb0a33da9 New directory for testing application code 2006-12-18 00:48:18 +00:00
Sears Russell
5b56370980 Fixed append. (It wasn't calling updateEOF, as it should have been. Also, updateEOF assumed start_pos was zero) 2006-11-22 05:04:48 +00:00
Sears Russell
802eeb33e7 New non-blocking implementation, with backpressure. Still doesn't handle overlapping writes. (Multiple writes to the same region is OK though.) 2006-11-21 06:50:12 +00:00
Sears Russell
1dbf1145ca Update to detect changes in file size (to support multiple file handles...) 2006-11-21 06:47:35 +00:00
Sears Russell
b8d0ccce79 Modularized the build; made berkeleydb and confuse optional. No longer build as many things by default. 2006-11-09 23:00:50 +00:00
Sears Russell
9294f89277 Fix for fallback posix_memalign implementation. (Inserted missing
casts)
2006-11-08 07:22:42 +00:00
Sears Russell
450261f3c5 Fixed 32bit bug. 2006-11-07 22:37:05 +00:00
Sears Russell
c86688884a Updates for 32-bit x86. There are still real 32-bit bugs being emitted as compiler warnings. 2006-11-07 20:36:59 +00:00
Sears Russell
8481e9cdd6 non_blocking is closer to working (it now flushes writes out in the background). This required some api changes. It still passes unit tests, but it's losing data on close()... 2006-10-28 03:33:02 +00:00
Sears Russell
bb9e339823 changed to deal with new LinkedList api. 2006-10-28 03:31:27 +00:00
Sears Russell
aa445bdfe5 slightly more general purpose; deals with longs instead of ints. 2006-10-28 03:30:45 +00:00
Sears Russell
faf55911df Added non-blocking io implementation. It doesn't actually work yet, but it passes the unit tests. ;) 2006-10-26 05:48:30 +00:00
Sears Russell
10b77729f5 Simple (blocking, poor truncation performance) file handle implementation. 2006-10-18 00:57:36 +00:00
Sears Russell
b948e72518 Removed the rwl* code; no longer includes assert.h 2006-10-17 03:27:17 +00:00
Sears Russell
32347b12e4 Added a "debug" handle dumps a trace of requests passed to it, and passes the requests through to another handle implementation. 2006-10-17 03:26:01 +00:00
Sears Russell
80a4148543 First cut at a new io API, with an in-memory reference implementation + test case. 2006-10-13 04:39:03 +00:00
Sears Russell
e961a2bdb8 Fixed compile warning. 2006-10-07 20:05:54 +00:00
Sears Russell
1575d97a6b Fixed recovery bug. TregionDealloc was being called during redo(), causing an assert to fail. Without the
assert, would have gone into infinite recursion.
2006-10-05 22:08:42 +00:00
Sears Russell
71f51d11bc Fixed a performance bug that was causing logical operations to unnecessarily pin pages. 2006-10-05 22:05:50 +00:00
Sears Russell
f0612e7353 Documentation Fix 2006-10-05 00:51:24 +00:00
Sears Russell
3054256c6e Documentation fix 2006-10-05 00:51:01 +00:00
Sears Russell
6a9d81c78f Removed unneeded #includes. 2006-10-05 00:50:46 +00:00
Sears Russell
836d2d097d Fixed initialization bugs on pendingCommits and syncLogCount. Group commit used to hang with 100% CPU if a signal interrputed it. Now it ignores the signal. (Don't know why it's receiving a singal, so it warns when this happens...) 2006-10-05 00:50:21 +00:00
Sears Russell
2d136695ff Documentation Fix; FILE_PERM is now in constants.h 2006-10-05 00:47:05 +00:00
Sears Russell
84dcdf228f Documentation Fix 2006-10-05 00:46:18 +00:00