Sears Russell
922669bde4
fix compiler warning
2008-03-08 03:04:16 +00:00
Sears Russell
8da9a5e8ad
Added "interests" to survey.
2008-03-05 20:21:06 +00:00
Sears Russell
c5a75a9102
Fixed some parsing / tokenization problems (added support for more characters / whitespace within tuples.
...
Implemented perl driver (and sample .cgi) for toplevel.c's network server.
2008-03-05 02:31:58 +00:00
Sears Russell
54055cd3e7
Initial checkin of relational algebra implementation.
2008-03-02 23:43:38 +00:00
Sears Russell
034343737b
Preliminary cmake build system (just enough for unit testing; misses lots of old code and benchmarks...)
2008-03-02 23:25:31 +00:00
Sears Russell
e49d51cb7e
Clean up includes for new cmake build system.
2008-03-02 23:21:39 +00:00
Sears Russell
3b74523a53
Fix memory leak.
2008-03-01 20:40:31 +00:00
Sears Russell
4104de06ff
fixed double free (was freeing iterator in next() and close()...)
2008-03-01 20:30:48 +00:00
Sears Russell
146563ca45
Allow third parties to register new iterator types. (made iterator registration non-static; moved constants into constants.h)
2008-03-01 19:34:12 +00:00
Sears Russell
f05b0233a3
Fixed memory leaks on iterator open/close Also zero out some memory defensively.
2008-03-01 19:32:34 +00:00
Sears Russell
4c83e1c373
Fixed memory leak during analysis phase.
2008-03-01 19:27:31 +00:00
Sears Russell
673f6b55d3
Allocation bugfixes
2008-02-29 18:03:32 +00:00
Sears Russell
043b9a7a01
Regions are 1 offset;iterator was totally broken.
2008-02-20 22:56:52 +00:00
Sears Russell
17d4f95d03
Fix bookkeeping, get rid of aborts during recovery of partially flushed log.
2008-02-20 22:51:52 +00:00
Sears Russell
a823255227
Added interface to let other stasis modules find regions' boundary tags
2008-02-19 22:07:13 +00:00
Sears Russell
1846340251
Zero out memory at initilization
2008-02-19 21:29:46 +00:00
Sears Russell
175b7e281e
Zero out memory and dirty bit at initialization.
2008-02-19 21:27:34 +00:00
Sears Russell
19949af99d
More sanity checking.
2008-02-19 21:26:31 +00:00
Sears Russell
178ef7dc47
Fixes errors/warnings revealed by 32-bit x86.
2007-12-19 03:23:31 +00:00
Sears Russell
71451f0c93
Bugfixes for experimental repeatability
2007-12-14 19:08:09 +00:00
Sears Russell
ab4fb0df6c
Fix linker namespace collision with libz
2007-12-06 21:52:37 +00:00
Sears Russell
5d62e0c0df
Filled in paper info about the data set; minor tweaks to R setting code.
2007-11-15 16:57:25 +00:00
Sears Russell
2bb6fce574
Code is ready(?) for experiments (version before this was solid despite (now) known bugs; I saw some crashes with these diffs, but think they've all been
...
addressed.)
2007-11-15 01:33:39 +00:00
Sears Russell
58e0466339
roseTable csv parser. updated rose.cpp for benchmarking
2007-11-13 23:40:21 +00:00
Sears Russell
5ad137164f
Fixed compiler warnings.
2007-11-12 16:40:50 +00:00
Sears Russell
5384d1efc5
indirect.c creates a scratch page with malloc. It wasn't setting the scratch page's type to UNINITIALIZED_PAGE, leading to segfaults.
2007-11-12 16:32:00 +00:00
Sears Russell
799c7498cd
Essentially leak free (mem and disk) after a few hours of roseTable
2007-11-12 07:27:49 +00:00
Sears Russell
ecc2392066
No (?) significant disk space leaks.
2007-11-12 01:40:12 +00:00
Sears Russell
9bb6984c23
force_range is now being called after compressData()
2007-11-12 00:49:00 +00:00
Sears Russell
f51148e686
More fixes for machines without file_sync_range
2007-11-11 23:38:10 +00:00
Sears Russell
863586135e
Fixed compilation for machines without sync_file_range()
2007-11-11 23:33:23 +00:00
Sears Russell
87a70f29bc
Preliminary force_range implementation; lsmTable leaks significantly less space now.
2007-11-11 23:22:21 +00:00
Sears Russell
07a6cd29e3
Forgot ; new abort() statement...
2007-11-11 17:24:44 +00:00
Sears Russell
48cdffe4d4
Stopgap (inefficient, but possibly correct) fix for the arraylist kludgieness.
2007-11-11 17:18:57 +00:00
Sears Russell
c34617fa16
Got versioning iterator to work.
2007-11-11 00:46:10 +00:00
Sears Russell
f2df518338
Implemented TlsmTableFind(); fixed quite a few bugs in merge, comparators, etc...
2007-11-06 02:27:04 +00:00
Sears Russell
d03a4e0c1f
Static dispatch, multiple column types per page.
2007-11-04 21:25:08 +00:00
Sears Russell
e46dcce461
No more leaks; "fixed" RB tree memory usage estimates.
2007-11-04 01:51:37 +00:00
Sears Russell
5a6ba6ed94
Fixed memory leak.
2007-11-03 22:21:46 +00:00
Sears Russell
3a88e43e9b
Fixed statistics reporting.
2007-11-02 21:56:17 +00:00
Sears Russell
75cbb20e6d
Tuple insertion now works (modulo storage leakage, hard coded tree sizes (not even ratios), and many other problems...)
2007-11-02 21:20:30 +00:00
Sears Russell
f101919244
LSM table is now able to spawn threads, then exit.
2007-11-02 15:00:47 +00:00
Sears Russell
7e2c37534e
Partial implementation of a collection oriented interface for ROSE. (Checking in to create version to diff against.)
2007-11-01 20:09:55 +00:00
Sears Russell
2c25c3a393
Statically typed tuples.
2007-10-30 23:32:37 +00:00
Sears Russell
b167b98085
* Remove spurious warnings messages from tests that intentionally crash stasis.
...
* Move and rename lladd_autoTruncation flag to stasis_truncation_automatic in flags.c
2007-10-23 23:16:58 +00:00
Sears Russell
9b8fefe68d
Added force() to the handle API. It is now called from tests, and by the buffer manager
2007-10-23 01:51:03 +00:00
Sears Russell
d7e56fc96f
Added more buffer manager flags (allow programs to bypass non_blocking).
2007-10-22 20:50:00 +00:00
Sears Russell
44a766a7f6
* Fixed a race condition. Pages that were merged during writeback were
...
set clean and unpinned while the slow handle was writing them back.
This allowed other threads to come in, and read the old version of the
page from disk.
* Fixed performance bug: When considering pages for writeback, start
after the end of the last flushed page (not the first flushed page)
* Honor "max_fast_handles".
2007-10-22 20:45:48 +00:00
Sears Russell
1c408dd2f1
Initial refactoring of rose.cpp into reusable components. (Just shuffles the code around.)
2007-10-18 18:52:12 +00:00
Sears Russell
cd5ec5f70c
Initial ROSE check in.
2007-10-15 17:46:44 +00:00
Sears Russell
0239743b03
More updates to svn:ignore (and removing .deps directory that doesn't belong in svn...)
2007-10-03 01:59:21 +00:00
Sears Russell
22c89bb3fe
Renamed physical_slot_length
2007-10-03 01:53:51 +00:00
Sears Russell
7fb4fd4c1a
Updated svn:ignore.
2007-10-03 01:52:41 +00:00
Sears Russell
c9bbf3af94
Converted page.h to follow new naming convention; documented new page api; begun stasis documentation cleanup.
2007-10-02 00:18:33 +00:00
Sears Russell
5f954eb239
Final commit from google.
2007-08-24 23:01:08 +00:00
Sears Russell
5bd2138a8b
Fixes a number of memory leaks; adds pageCleanup() callback, and allows callers to use custom allocators with LSM trees
2007-08-20 21:58:20 +00:00
Sears Russell
9c1c284406
Implemented range scans; lsmTree now supports keys that are stored as fixed length byte arrays.
2007-08-20 16:53:16 +00:00
Sears Russell
519bd515f4
New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes.
2007-08-20 16:25:08 +00:00
Sears Russell
90f011b049
New access method for the buffer manager; write coalescing; runtime bufferManager selection and a few bufferManager bugfixes.
2007-08-20 16:23:57 +00:00
Sears Russell
8963d6d381
Fixed recordNext(), add unit test for recordNext() on slotted and fixed pages.
2007-08-20 16:04:44 +00:00
Sears Russell
8367dfe9a3
releasePage() is now a function, not a function pointer. releasePageImpl is the name of the new function pointer.
2007-08-14 01:20:08 +00:00
Sears Russell
9745d62887
Preliminary LSM tree implementation (hardcodes keys as ints for now)
2007-08-14 01:17:31 +00:00
Sears Russell
a773c4d8b7
Bugfixes and improved error handling for recovery tests and registerPageType()
2007-07-19 23:47:06 +00:00
Sears Russell
f539011e9f
Implemented simulateBufferManagerCrash.
2007-07-19 16:36:17 +00:00
Sears Russell
3d84412cea
It is now possible to register page types before Tinit() is called, so that they may be used by recovery.
2007-07-19 16:35:11 +00:00
Sears Russell
7ca0619db0
Adds a void * to Page_s so that page implementations can store information with the pages they manage.
2007-07-18 20:10:10 +00:00
Sears Russell
9fd91cffb8
Updated page api to handle page types that need to grab resources on record read/ write, or that perform callbacks when read / written to disk.
2007-07-18 20:09:14 +00:00
Sears Russell
356387eafe
support "make install", and use libtool to generate .so, .a files.
2007-06-25 15:47:28 +00:00
no author
d0274c3304
Renamed 'lladd' directories and python module to 'stasis'
2007-06-11 21:36:57 +00:00
Sears Russell
4998e57566
Updated for the new page API
2007-06-07 21:53:09 +00:00
Sears Russell
2f7da41663
Whitespace; restoring lost call to checkRid
2007-06-01 22:20:25 +00:00
Sears Russell
5e1445777f
Should have gone in with the rest of the nowarn patch
2007-06-01 22:16:42 +00:00
Sears Russell
dd7c6b857d
Added assertlock() and call it when page implementations assume a page has already been latched. (Fixed
...
associated bugs as well)
2007-06-01 21:32:33 +00:00
Sears Russell
d1aeba8a82
Cleaned up obsolete @todo's; fixed inconsistent page file initialization
2007-06-01 21:06:18 +00:00
Sears Russell
951a897040
Add casts to prevent warnings on (upcoming changes to) recordRead, recordWrite
2007-05-31 22:40:19 +00:00
Sears Russell
bff22716a7
Updated page.h's interface to make it more consistent.
2007-05-31 01:15:12 +00:00
Mark Callaghan
12c7f6a1c5
Simple SWIG interface
2007-05-30 23:48:36 +00:00
Sears Russell
a3885944a0
Messed with documentation to try to make doxygen happy and more likely to see this file.
2007-05-26 01:03:57 +00:00
Sears Russell
22dfd5a117
Fixed use after free.
2007-04-21 07:51:33 +00:00
Sears Russell
05ad97b37b
Was releasing log_read_mutex without obtaining it first...
2007-04-20 07:13:18 +00:00
Sears Russell
362b1036de
Changed CLR log format so that it is identical to update entries. The old format pointed back to an earlier
...
entry in the log, complicating truncation significantly. The new format copies log entries into their CLRs,
and is somewhat redundant, as redo and undo information is stored in the CLR, but the undo information will
never be used...
2007-04-03 09:18:45 +00:00
Sears Russell
4f47613fe5
Fixed typo (print -> printf)
2007-03-30 09:20:03 +00:00
Sears Russell
8275eb71be
Cleanup and refactoring for deferred updates. CLR's were broken; Tdefer requires them, so it is
...
only partially implemented.
2007-03-30 09:16:21 +00:00
Sears Russell
06de4dca0a
Readability cleanups; fixed debug message.
2007-03-30 07:41:31 +00:00
Sears Russell
4c8466555c
Cleaned up Tupdate() by adding TupdateRaw(); removed *_RAW and updated linear hash accordingly.
2007-03-28 09:21:07 +00:00
Sears Russell
cd352a6341
Removed out-of-date comments.
2007-03-19 21:55:47 +00:00
Sears Russell
6b60c10864
include config.h for 64-bit file support on 32-bit architectures
2007-03-13 09:19:32 +00:00
Sears Russell
d05cdfd357
Fixes compilation warning.
2007-03-13 08:53:54 +00:00
Sears Russell
4e6330492c
Adaptor between the pageFile interface and stasis_handle_t
2007-03-13 08:40:31 +00:00
Sears Russell
6e749b93a4
bufferHash now seems to be correct, and makes use of the stasis_handle_t
...
interface.
2007-03-13 08:39:29 +00:00
Sears Russell
2e0ad972fd
Bugfix. (lru->remove() wasn't removing node mapping.)
2007-03-13 08:32:04 +00:00
Sears Russell
11da78e46b
Port for compatiblity with new API.
2007-03-13 08:31:15 +00:00
Sears Russell
2c6e674ab3
Streamlined bufferHash implementation, with new test-cases.
2007-03-11 07:55:00 +00:00
Sears Russell
17845a59ed
A O(1) lru implementation.
2007-03-11 07:45:17 +00:00
Sears Russell
8145e8db6f
A doubly linked list implementation. All operations are O(1), including the ability to remove things from
...
within the list, assuming you already have an appropriate pointer to it.
2007-03-11 07:37:20 +00:00
Sears Russell
15e77da1d4
more tests / bugfixes for buffermanager.
2007-03-10 01:29:43 +00:00
Sears Russell
d88aef1520
Replacement policy for new buffer manager
2007-03-08 07:58:24 +00:00
Sears Russell
61249c29a7
New "default" buffer manager that aims to replace the current one, but
...
without deadlocks. Still need to track down a memory corruption bug
that this introduces, or exercises.
2007-03-08 07:56:53 +00:00
Sears Russell
5972fcc549
Sets p->dirty and p->LSN appropriately; checks their consistency.
2007-03-08 07:44:13 +00:00
Sears Russell
918fb9d375
Adds consistency checking for page lsn's.
2007-03-08 07:39:22 +00:00
Sears Russell
76cd6b5114
Added tryreadlock() and trywritelock().
2007-03-08 07:36:02 +00:00
Sears Russell
8f3d503ea8
Added TdurabilityLevel().
...
Test cases now pass with LOG_TO_MEMORY and BUFFER_MANAGER_MEM_ARRAY
2007-03-07 06:45:28 +00:00
Sears Russell
237bbe0fbe
Added ability to override default bufferManager implementation with
...
-DUSE_BUFFER_MANAGER
2007-03-06 00:00:26 +00:00
Sears Russell
44aef7e8ea
Added ability to override default logging implementation with
...
-DUSE_LOGGER
2007-03-05 23:56:38 +00:00
Sears Russell
8c633f633e
un-dirty pages during releasePage
2007-03-04 02:52:31 +00:00
Sears Russell
c1bf2ba7ac
New buffer manager implementation (very simple; just stores pages in memory, addressed via an array of pointers)
2007-03-04 02:46:23 +00:00
Sears Russell
e49e8c004e
dirtyPages_deinit was broken. (Was excercised by new pageArray bufferManager...)
2007-03-04 02:44:19 +00:00
Sears Russell
5650953c4f
Added .cvsignore files.
2007-03-04 00:40:15 +00:00
Sears Russell
26e5aa3069
truncation.c no longer includes on pageFile.h
2007-03-04 00:36:45 +00:00
Sears Russell
2d3fc4ba47
Changed malloc() to calloc() to prevent unpacked structs from leaking
...
bytes to log
2007-03-03 23:24:00 +00:00
Sears Russell
ca57875007
Fixed TisActiveTransaction, cleaned up Tinit(), Tdeinit().
2007-03-03 22:51:07 +00:00
Sears Russell
078b45dbcc
Removed and/or flagged #include dependencies on pageFile.h (in the process of further factoring bufferManager implementation out of Stasis.)
2007-03-03 02:26:17 +00:00
Sears Russell
73788eb910
Reworked intialization code, includes to isolate bufferManager
...
implementation from the rest of Stasis.
2007-03-03 01:52:03 +00:00
Sears Russell
b3152261b4
Xid -1 leads to illegal memory accesses. Added checks for it; fixed
...
problematic unit test.
2007-03-03 01:48:58 +00:00
Sears Russell
86a6c3ff77
Removed comment that warns about a solved problem
2007-03-03 01:46:44 +00:00
Sears Russell
006cd1e621
Moved roundUp/Down to 'static inline' in header; completed unit test's checks.
2007-02-12 07:54:32 +00:00
Sears Russell
4ae4ad54d7
deleted dead code / unnecessary comments.
2007-02-07 03:06:35 +00:00
Sears Russell
d2d631ff30
Rewrote pinnedRanges.
2007-02-07 03:04:19 +00:00
Sears Russell
fe30fbbd74
RangeTracker seems to be working; still need to write unit tests for its return value.
2007-02-06 02:32:01 +00:00
Sears Russell
3b1135ea2f
Miscellaneous cleanups, slightly more conservative latching.
2007-01-30 18:26:59 +00:00
Sears Russell
99bcf8acd9
Randomized test; bugfixes
2007-01-25 22:38:22 +00:00
Sears Russell
05275bbe5a
Tracks ranges in O(m log n) time.
2007-01-24 18:25:38 +00:00
Sears Russell
c2fa9913b1
Added partial implementation of range tracking for pinning arbitrary
...
regions. Currently, tracks regions, and is O(m log(n)) for each
operation, where m is the number of transition points per range, and n
is the number of transition points in the system. A transition point is
a place in memory where the pincount changes.
2007-01-24 01:03:52 +00:00
Sears Russell
f6ccaadc35
Updated slotted api to match fixed api; cleaned up dead code.
2007-01-22 20:55:25 +00:00
Sears Russell
9b49787931
typo in getSetRaw()
2007-01-22 20:54:04 +00:00
Sears Russell
346fe97161
Fixed race (wasn't grabbing lock); typo in getInstantSet
2007-01-22 20:53:26 +00:00
Sears Russell
3aa83e7a48
Added link to test.c from main API page, and doxygenified the test.c comments.
2006-12-18 01:12:30 +00:00
Eric Brewer
fcb0a33da9
New directory for testing application code
2006-12-18 00:48:18 +00:00
Sears Russell
5b56370980
Fixed append. (It wasn't calling updateEOF, as it should have been. Also, updateEOF assumed start_pos was zero)
2006-11-22 05:04:48 +00:00
Sears Russell
802eeb33e7
New non-blocking implementation, with backpressure. Still doesn't handle overlapping writes. (Multiple writes to the same region is OK though.)
2006-11-21 06:50:12 +00:00
Sears Russell
1dbf1145ca
Update to detect changes in file size (to support multiple file handles...)
2006-11-21 06:47:35 +00:00
Sears Russell
b8d0ccce79
Modularized the build; made berkeleydb and confuse optional. No longer build as many things by default.
2006-11-09 23:00:50 +00:00
Sears Russell
9294f89277
Fix for fallback posix_memalign implementation. (Inserted missing
...
casts)
2006-11-08 07:22:42 +00:00
Sears Russell
450261f3c5
Fixed 32bit bug.
2006-11-07 22:37:05 +00:00
Sears Russell
c86688884a
Updates for 32-bit x86. There are still real 32-bit bugs being emitted as compiler warnings.
2006-11-07 20:36:59 +00:00
Sears Russell
8481e9cdd6
non_blocking is closer to working (it now flushes writes out in the background). This required some api changes. It still passes unit tests, but it's losing data on close()...
2006-10-28 03:33:02 +00:00
Sears Russell
bb9e339823
changed to deal with new LinkedList api.
2006-10-28 03:31:27 +00:00
Sears Russell
aa445bdfe5
slightly more general purpose; deals with longs instead of ints.
2006-10-28 03:30:45 +00:00
Sears Russell
faf55911df
Added non-blocking io implementation. It doesn't actually work yet, but it passes the unit tests. ;)
2006-10-26 05:48:30 +00:00
Sears Russell
10b77729f5
Simple (blocking, poor truncation performance) file handle implementation.
2006-10-18 00:57:36 +00:00
Sears Russell
b948e72518
Removed the rwl* code; no longer includes assert.h
2006-10-17 03:27:17 +00:00
Sears Russell
32347b12e4
Added a "debug" handle dumps a trace of requests passed to it, and passes the requests through to another handle implementation.
2006-10-17 03:26:01 +00:00
Sears Russell
80a4148543
First cut at a new io API, with an in-memory reference implementation + test case.
2006-10-13 04:39:03 +00:00
Sears Russell
e961a2bdb8
Fixed compile warning.
2006-10-07 20:05:54 +00:00
Sears Russell
1575d97a6b
Fixed recovery bug. TregionDealloc was being called during redo(), causing an assert to fail. Without the
...
assert, would have gone into infinite recursion.
2006-10-05 22:08:42 +00:00
Sears Russell
71f51d11bc
Fixed a performance bug that was causing logical operations to unnecessarily pin pages.
2006-10-05 22:05:50 +00:00
Sears Russell
f0612e7353
Documentation Fix
2006-10-05 00:51:24 +00:00
Sears Russell
3054256c6e
Documentation fix
2006-10-05 00:51:01 +00:00
Sears Russell
6a9d81c78f
Removed unneeded #includes.
2006-10-05 00:50:46 +00:00
Sears Russell
836d2d097d
Fixed initialization bugs on pendingCommits and syncLogCount. Group commit used to hang with 100% CPU if a signal interrputed it. Now it ignores the signal. (Don't know why it's receiving a singal, so it warns when this happens...)
2006-10-05 00:50:21 +00:00
Sears Russell
2d136695ff
Documentation Fix; FILE_PERM is now in constants.h
2006-10-05 00:47:05 +00:00
Sears Russell
84dcdf228f
Documentation Fix
2006-10-05 00:46:18 +00:00
Sears Russell
212e3c4626
No longer compile page/header.c
2006-10-05 00:45:32 +00:00
Sears Russell
b06e3daf1b
Should now be silent during normal operation.
2006-10-04 04:41:53 +00:00
Sears Russell
92a1ac3ee5
Recovery now ignores INTERNALLOG entries
2006-10-04 04:41:19 +00:00
Sears Russell
524ece3fa4
Limited "Leaking iterators" warning to once per run.
2006-10-04 04:40:38 +00:00
Sears Russell
6bb126debf
Made "GetPage is stuck!" less obtrusive.
2006-10-04 04:39:58 +00:00
Sears Russell
4bd93ee66a
Added support for computing size of internal log entries.
2006-10-04 04:38:21 +00:00
Sears Russell
fd7f4074af
Added CRC's to log format.
2006-10-04 04:37:03 +00:00
Sears Russell
f01cff0d5b
Cleaned up logger API, added truncation support to inMemoryLog.c
2006-09-27 20:30:12 +00:00
Sears Russell
fcf01f5d71
Cleaned up some old comments.
2006-09-27 20:28:44 +00:00
Sears Russell
f620aaedd6
Removed some dead code.
2006-09-27 20:27:49 +00:00
Sears Russell
986ee57020
More fixes to prevent tardis from running out of disk space.
2006-09-25 22:27:13 +00:00
Sears Russell
b615f0bc3e
Towards 64-bit pageids. bufferManager can handle 64-bit offsets, but recordid.page is still 32 bit...
2006-08-11 19:31:42 +00:00
Sears Russell
8faf045e7d
Fixed numerous bugs in allocationPolicy.c and alloc.c
...
allocationPolicy.c was not handling deallocations correctly
Tdealloc() was not calling interpretRid() on its input before passing it into the allocationPolicy
Added locking support for TallocFromPage()
2006-08-11 02:56:41 +00:00
Sears Russell
ef43a8d54f
Added missing declaration of forcePageFile()
2006-08-11 02:42:17 +00:00
Sears Russell
b44551b941
fixed mutex checks
2006-08-11 02:25:17 +00:00
Sears Russell
7dada65a13
Addded "interpretRid" which knows how to call the "dereference*" functions.
2006-08-11 02:24:01 +00:00
Sears Russell
51c5b60047
Fix race in TallocFromPage()
2006-08-11 00:01:12 +00:00
Sears Russell
73436d0d6c
Disables fsckSlottedPage() by default.
2006-08-10 23:59:13 +00:00
Sears Russell
7ba91533fe
Added assertions to make sure that the region mutex is held when
...
appropriate.
2006-08-10 23:57:49 +00:00
Sears Russell
af175896cb
Added logWriter_isDurable. If = 0, then the log will never be forced.
2006-08-10 23:54:46 +00:00
Sears Russell
1b6c828bd2
Added logWriter_isDurable. If set to zero, the log will never be forced
...
to disk.
2006-08-10 23:53:51 +00:00
Sears Russell
3a43450477
Force in-flight page file writes to disk before truncating. (Needed if
...
O_DIRECT isn't in use.)
Changed diagnostic messages to go to stderr.
2006-08-10 23:52:48 +00:00
Sears Russell
f93b2acf69
Now, you can set pageFile_isDurable=0 to disable forcing data to the
...
page file.
Also, -DPAGE_FILE_O_DIRECT switches the page file from using a normal
file handle and fdatasync to use O_DIRECT with no fdatasync.
2006-08-10 23:51:15 +00:00
Sears Russell
6f9c6af99c
memoized loadPage() (per thread)
...
no longer requires pbl compatibility wrappers
2006-08-10 23:45:25 +00:00
Sears Russell
7847331771
Minor cleanup, added ability to calculate the global average number of
...
buckets traversed per find(). Added a warning for code that actually
relies upon PBL's way of interpreting insert.
2006-08-10 23:43:53 +00:00
Sears Russell
d3f87b5af4
Added support for locking on deallocation.
2006-08-10 23:39:36 +00:00
Sears Russell
6fcaf34bb5
Needed to protect a linked list with a mutex. It's suprising that this hasn't come up before.
2006-08-08 01:41:45 +00:00
Sears Russell
8a390c40d2
Improved latch profiling, especially for loadPage.
2006-08-04 23:45:27 +00:00
Sears Russell
c413203ec8
Talloc() now reuses space when possible. It still needs to call slottedCompact() intelligentally. Also, allocationPolicy should support an extra tier
...
of pages, so it doesn't suggest ones that aren't already in the buffer pool unless it has to.
2006-07-29 00:56:54 +00:00
Sears Russell
783d1d6ffd
Removed the fixed page initialization operations, which weren't being used, and were a slow hack anyway. There is now a more-general (and efficient)
...
implementation in alloc.c
2006-07-29 00:54:01 +00:00
Sears Russell
cdd44a2f2d
Initial import of redblack implementation.
2006-07-28 00:01:57 +00:00
Sears Russell
3725cc9b8e
Added a function that returns the number of allocated entries in the list
2006-07-28 00:00:32 +00:00
Sears Russell
165b91cf76
compensations_init() was being called too late.
2006-07-27 23:59:21 +00:00
Sears Russell
a3d0f6f6f5
Added support for concurrent transactions (by using nested top actions).
2006-07-27 00:15:29 +00:00
Sears Russell
1988cf297d
The "WARNING: Tdeinit() is aborting transaction %d" runtime message now
...
lists the xid of the transaction it's aborting instead of "-1".
TisActiveTransaction(xid) now returns 0 for INVALID_XID. Before the
output was undefined.
2006-07-27 00:13:20 +00:00
Sears Russell
d1da4e59c0
Fixed segmentation fault when a CLR with a NULLRID is encountered. I
...
don't understand why this bug wasn't triggered by linearHashNTA or
linkedListNTA, but is triggered by the new region implementation.
2006-07-27 00:10:21 +00:00
Sears Russell
7888d647ed
Removed unused abort/commit callbacks.
2006-07-26 17:48:36 +00:00
Sears Russell
62abe94bf5
added fsckRegions(), and call it from the unit tests.
2006-07-25 22:23:15 +00:00
Sears Russell
aec9148b83
added call to get the page type.
2006-07-25 22:22:49 +00:00
Sears Russell
41528ef066
Fixed lockManager. lhtable's iterators do not support concurrent modifications.
2006-07-25 19:12:53 +00:00
Sears Russell
8e419845be
removed assert() that checks to make sure that Tupdate() didn't pass a page pointer in.
2006-07-25 01:24:49 +00:00
Sears Russell
8aad1b896a
pthread.h | rw.h -> latches.h (Otherwise, -DPROFILE_LATCHES doesn't work.
2006-07-25 01:06:01 +00:00
Sears Russell
45a5996215
Documented subtle hack; TallocPage() really needs a way to set page type at recovery. Currently, this just doesn't happen, since page types are lazily set.
...
Perhaps Talloc() could handle it?
2006-07-25 01:05:02 +00:00
Sears Russell
8485cc7fe1
Added missing releasePage().
2006-07-25 01:03:57 +00:00
Sears Russell
745975112f
Removed an assert that assumed pages aren't reused.
2006-07-25 01:03:07 +00:00
Sears Russell
747bc9cdc9
Removed #defines for broken ptrheads stuff.
2006-07-25 01:02:27 +00:00
Sears Russell
9721e86133
Commented out (currently broken) pthreads instrumentation, added readLock tracking to the latch instrumentation.
2006-07-25 01:01:46 +00:00
Sears Russell
2a9cb788a6
if LONG_TEST is defined, check for pinned pages on exit.
...
This test is currently implemented inefficiently, otherwise it would always be enabled.
2006-07-25 01:00:46 +00:00
Sears Russell
a5a234635e
readBlob() no longer writes the blob contents to the log. ;)
2006-07-25 00:58:28 +00:00
Sears Russell
0f45b97eda
regions now make use of nested top actions, so they're almost correct. (Still need to lock freed regions until end of transaction.)
2006-07-25 00:56:50 +00:00
Sears Russell
86fab6a22b
Turn on paranoid slotted page consistency checks for long running tests.
2006-07-22 00:05:40 +00:00
Sears Russell
2af892709f
Rewrote slottedCompact; added fsckSlottedPage
2006-07-22 00:01:42 +00:00
Sears Russell
0725af91be
Fixed page leak in Talloc().
2006-07-21 01:07:09 +00:00
Sears Russell
eb13531c0f
Partial handling of incomplete log entries. (It detects when the log file does not end at the right byte, but doesn't checksum, or otherwise look for
...
sectors that didn't make it to disk.)
2006-07-21 01:06:35 +00:00
Sears Russell
1ff1d4c128
Re-enabled truncation (accidentally disabled it before...)
2006-07-20 01:30:58 +00:00
Sears Russell
ffd3bd960b
switched to region allocator, but TpageAlloc currently grabs its own region...
2006-07-20 01:29:39 +00:00
Sears Russell
7bc60c3ac4
fixed the fixedPageAlloc hack.
2006-07-20 00:49:28 +00:00
Sears Russell
8ed909e79d
Fixed the fixedPageAlloc hack.
2006-07-20 00:48:42 +00:00
Sears Russell
1ac3dc6779
More progress on boundary tags. (Still not tested/working yet...)
2006-07-18 23:59:00 +00:00
Sears Russell
bf98e32c73
fixed build
2006-06-22 23:31:42 +00:00
Sears Russell
93e7e96ea3
Started implementing the region allocator
2006-06-22 19:10:02 +00:00
Sears Russell
d26263262b
Completely new blob implementation. Slower than the old one was supposed to be, but is correct, and extremeley
...
simple. It simply writes the pre-image and post-image of each blob to the log using TpageSet.
2006-06-21 00:45:18 +00:00
Sears Russell
c8c9b7af19
the logger understands special record types. (At least partially...); shortened blob tests, since the blob
...
implementation is fundamentally broken, and slow
2006-06-20 23:02:27 +00:00
Sears Russell
6485a4aae9
No more PBL.
2006-06-20 21:44:17 +00:00
Sears Russell
4d79c0a466
Simplified allocation
2006-06-20 21:40:21 +00:00
Sears Russell
e14877821f
Fixed blob bug. The reason it's so slow is that it's logging a preimage + postimage of each blob and then synchronously writing to a second copy each time the blob is
...
written to(!!!)
2006-06-20 00:03:38 +00:00
Sears Russell
3e4cac0fe3
Continued cleaning up allocation code. It seems really slow all of a sudden, so this commit probably introduced a performance bug.
2006-06-17 00:25:09 +00:00
Sears Russell
209a6916e5
Updated some comments.
2006-06-16 00:27:02 +00:00
Sears Russell
dc8a3e5d60
Eliminated slottedPreRalloc
2006-06-16 00:05:44 +00:00
Sears Russell
245db32c23
Two programs to create and quickly query a read-only on disk hash table
2006-06-15 22:28:39 +00:00
Sears Russell
50515ffd23
More steps toward factoring page allocation out of record allocation.
2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8
half-hearted attempt to fix -Wextra warnings...
2006-06-13 23:58:04 +00:00
Sears Russell
a3678aad5c
Now AM_CFLAGS can be set by modifying GLOBAL_CFLAGS in the root
...
Makefile.am
2006-06-13 22:48:50 +00:00
Sears Russell
f53a46e788
removed heisenbug
2006-06-13 22:47:38 +00:00
Sears Russell
1b3a08d434
added some todos
2006-06-13 22:46:11 +00:00
Sears Russell
1cf3119eb7
renamed __really_do_ralloc to really_do_ralloc
2006-06-13 22:45:30 +00:00
Sears Russell
66ae3b9763
Made it more obvious that a suspicious looking assert is commented out
2006-06-13 22:44:40 +00:00
Sears Russell
24a5da9648
Fixed deprecated volatile static declaration (-> static volatile)
2006-06-13 22:43:58 +00:00
Sears Russell
33af9805ad
printf -> fprintf(stderr, and assert(0) -> abort()
2006-06-13 22:43:20 +00:00
Sears Russell
f77e8b240d
It was improperly tracking the log's global offset. (Hopefully)
...
fixed offset tracking, made it optional, and disabled it.
2006-06-13 22:42:15 +00:00
Sears Russell
c5add15bd3
assert(0) -> abort
2006-06-13 22:40:53 +00:00
Sears Russell
eab6385ca5
Moved #defines below definition of Page_s.
2006-06-13 22:40:24 +00:00
Sears Russell
f89903d529
moved stdio.h include out of header file.
2006-06-13 22:38:25 +00:00
Sears Russell
e56c46b95c
Moved blob_record_t into transactional.h (part of transition to using
...
slot type lookup tables.)
2006-06-13 22:37:29 +00:00
Sears Russell
a11fbdd9e6
Did away with slottedPreRallocFromPage.
2006-06-13 20:00:46 +00:00
Sears Russell
cef9e2c4ce
Added settings for longer-running tests
2006-06-12 22:45:41 +00:00
Sears Russell
e0b34633ec
Fixed broken min_rec_lsn() semantics; before, if there were not outstanding transactions / writes,
...
then these calls would return flushedLSN(). The problem was that flushedLSN wasn't guaranteed to
return a pointed to the beginning of a log entry.
2006-06-12 21:50:21 +00:00
Sears Russell
7bb0ce0d17
Fixed truncation bug (truncation is more aggressive now), and added more debugging info.
2006-06-12 20:55:49 +00:00
Sears Russell
27f7df6f09
Fixed races on flushedLSN and page->dirty.
2006-06-12 20:05:28 +00:00
Sears Russell
35a5e80871
removed bogus .deps files.
2006-06-01 22:18:50 +00:00
Sears Russell
fd19036843
Added more complete hashtable test; fixed incorrect return value in LH_ENTRY(find)
2006-05-31 00:37:56 +00:00
Sears Russell
0649f179b3
Got rid of the ~1 second delay on exit.
2006-05-30 22:59:22 +00:00
Sears Russell
68dcc2067e
No more warnings with -O2.
2006-05-25 22:50:52 +00:00
Sears Russell
8ce9e6127f
Fixed return value in removeFromLinkedList
2006-05-25 22:48:15 +00:00
Sears Russell
b5d578f4e0
Fixed remaining warnings, got rid of alTupdate
2006-05-25 20:08:12 +00:00
Sears Russell
fda416090b
Fixed a bunch of 'easy' warnings
2006-05-25 00:02:46 +00:00
Sears Russell
cb3a4ae20d
Bucket list extension working.
2006-05-24 23:24:31 +00:00
Sears Russell
8b54b0d265
No longer attempts to truncate when long transactions prevent it from
...
being useful...
2006-05-24 23:21:33 +00:00