Commit graph

330 commits

Author SHA1 Message Date
Sears Russell
836d2d097d Fixed initialization bugs on pendingCommits and syncLogCount. Group commit used to hang with 100% CPU if a signal interrputed it. Now it ignores the signal. (Don't know why it's receiving a singal, so it warns when this happens...) 2006-10-05 00:50:21 +00:00
Sears Russell
2d136695ff Documentation Fix; FILE_PERM is now in constants.h 2006-10-05 00:47:05 +00:00
Sears Russell
84dcdf228f Documentation Fix 2006-10-05 00:46:18 +00:00
Sears Russell
212e3c4626 No longer compile page/header.c 2006-10-05 00:45:32 +00:00
Sears Russell
b06e3daf1b Should now be silent during normal operation. 2006-10-04 04:41:53 +00:00
Sears Russell
92a1ac3ee5 Recovery now ignores INTERNALLOG entries 2006-10-04 04:41:19 +00:00
Sears Russell
524ece3fa4 Limited "Leaking iterators" warning to once per run. 2006-10-04 04:40:38 +00:00
Sears Russell
6bb126debf Made "GetPage is stuck!" less obtrusive. 2006-10-04 04:39:58 +00:00
Sears Russell
4bd93ee66a Added support for computing size of internal log entries. 2006-10-04 04:38:21 +00:00
Sears Russell
fd7f4074af Added CRC's to log format. 2006-10-04 04:37:03 +00:00
Sears Russell
f01cff0d5b Cleaned up logger API, added truncation support to inMemoryLog.c 2006-09-27 20:30:12 +00:00
Sears Russell
fcf01f5d71 Cleaned up some old comments. 2006-09-27 20:28:44 +00:00
Sears Russell
f620aaedd6 Removed some dead code. 2006-09-27 20:27:49 +00:00
Sears Russell
986ee57020 More fixes to prevent tardis from running out of disk space. 2006-09-25 22:27:13 +00:00
Sears Russell
b615f0bc3e Towards 64-bit pageids. bufferManager can handle 64-bit offsets, but recordid.page is still 32 bit... 2006-08-11 19:31:42 +00:00
Sears Russell
8faf045e7d Fixed numerous bugs in allocationPolicy.c and alloc.c
allocationPolicy.c was not handling deallocations correctly
Tdealloc() was not calling interpretRid() on its input before passing it into the allocationPolicy
Added locking support for TallocFromPage()
2006-08-11 02:56:41 +00:00
Sears Russell
ef43a8d54f Added missing declaration of forcePageFile() 2006-08-11 02:42:17 +00:00
Sears Russell
b44551b941 fixed mutex checks 2006-08-11 02:25:17 +00:00
Sears Russell
7dada65a13 Addded "interpretRid" which knows how to call the "dereference*" functions. 2006-08-11 02:24:01 +00:00
Sears Russell
51c5b60047 Fix race in TallocFromPage() 2006-08-11 00:01:12 +00:00
Sears Russell
73436d0d6c Disables fsckSlottedPage() by default. 2006-08-10 23:59:13 +00:00
Sears Russell
7ba91533fe Added assertions to make sure that the region mutex is held when
appropriate.
2006-08-10 23:57:49 +00:00
Sears Russell
af175896cb Added logWriter_isDurable. If = 0, then the log will never be forced. 2006-08-10 23:54:46 +00:00
Sears Russell
1b6c828bd2 Added logWriter_isDurable. If set to zero, the log will never be forced
to disk.
2006-08-10 23:53:51 +00:00
Sears Russell
3a43450477 Force in-flight page file writes to disk before truncating. (Needed if
O_DIRECT isn't in use.)

Changed diagnostic messages to go to stderr.
2006-08-10 23:52:48 +00:00
Sears Russell
f93b2acf69 Now, you can set pageFile_isDurable=0 to disable forcing data to the
page file.

Also, -DPAGE_FILE_O_DIRECT switches the page file from using a normal
file handle and fdatasync to use O_DIRECT with no fdatasync.
2006-08-10 23:51:15 +00:00
Sears Russell
6f9c6af99c memoized loadPage() (per thread)
no longer requires pbl compatibility wrappers
2006-08-10 23:45:25 +00:00
Sears Russell
7847331771 Minor cleanup, added ability to calculate the global average number of
buckets traversed per find().  Added a warning for code that actually
relies upon PBL's way of interpreting insert.
2006-08-10 23:43:53 +00:00
Sears Russell
d3f87b5af4 Added support for locking on deallocation. 2006-08-10 23:39:36 +00:00
Sears Russell
6fcaf34bb5 Needed to protect a linked list with a mutex. It's suprising that this hasn't come up before. 2006-08-08 01:41:45 +00:00
Sears Russell
8a390c40d2 Improved latch profiling, especially for loadPage. 2006-08-04 23:45:27 +00:00
Sears Russell
c413203ec8 Talloc() now reuses space when possible. It still needs to call slottedCompact() intelligentally. Also, allocationPolicy should support an extra tier
of pages, so it doesn't suggest ones that aren't already in the buffer pool unless it has to.
2006-07-29 00:56:54 +00:00
Sears Russell
783d1d6ffd Removed the fixed page initialization operations, which weren't being used, and were a slow hack anyway. There is now a more-general (and efficient)
implementation in alloc.c
2006-07-29 00:54:01 +00:00
Sears Russell
cdd44a2f2d Initial import of redblack implementation. 2006-07-28 00:01:57 +00:00
Sears Russell
3725cc9b8e Added a function that returns the number of allocated entries in the list 2006-07-28 00:00:32 +00:00
Sears Russell
165b91cf76 compensations_init() was being called too late. 2006-07-27 23:59:21 +00:00
Sears Russell
a3d0f6f6f5 Added support for concurrent transactions (by using nested top actions). 2006-07-27 00:15:29 +00:00
Sears Russell
1988cf297d The "WARNING: Tdeinit() is aborting transaction %d" runtime message now
lists the xid of the transaction it's aborting instead of "-1".

TisActiveTransaction(xid) now returns 0 for INVALID_XID.  Before the
output was undefined.
2006-07-27 00:13:20 +00:00
Sears Russell
d1da4e59c0 Fixed segmentation fault when a CLR with a NULLRID is encountered. I
don't understand why this bug wasn't triggered by linearHashNTA or
linkedListNTA, but is triggered by the new region implementation.
2006-07-27 00:10:21 +00:00
Sears Russell
7888d647ed Removed unused abort/commit callbacks. 2006-07-26 17:48:36 +00:00
Sears Russell
62abe94bf5 added fsckRegions(), and call it from the unit tests. 2006-07-25 22:23:15 +00:00
Sears Russell
aec9148b83 added call to get the page type. 2006-07-25 22:22:49 +00:00
Sears Russell
41528ef066 Fixed lockManager. lhtable's iterators do not support concurrent modifications. 2006-07-25 19:12:53 +00:00
Sears Russell
8e419845be removed assert() that checks to make sure that Tupdate() didn't pass a page pointer in. 2006-07-25 01:24:49 +00:00
Sears Russell
8aad1b896a pthread.h | rw.h -> latches.h (Otherwise, -DPROFILE_LATCHES doesn't work. 2006-07-25 01:06:01 +00:00
Sears Russell
45a5996215 Documented subtle hack; TallocPage() really needs a way to set page type at recovery. Currently, this just doesn't happen, since page types are lazily set.
Perhaps Talloc() could handle it?
2006-07-25 01:05:02 +00:00
Sears Russell
8485cc7fe1 Added missing releasePage(). 2006-07-25 01:03:57 +00:00
Sears Russell
745975112f Removed an assert that assumed pages aren't reused. 2006-07-25 01:03:07 +00:00
Sears Russell
747bc9cdc9 Removed #defines for broken ptrheads stuff. 2006-07-25 01:02:27 +00:00
Sears Russell
9721e86133 Commented out (currently broken) pthreads instrumentation, added readLock tracking to the latch instrumentation. 2006-07-25 01:01:46 +00:00
Sears Russell
2a9cb788a6 if LONG_TEST is defined, check for pinned pages on exit.
This test is currently implemented inefficiently, otherwise it would always be enabled.
2006-07-25 01:00:46 +00:00
Sears Russell
a5a234635e readBlob() no longer writes the blob contents to the log. ;) 2006-07-25 00:58:28 +00:00
Sears Russell
0f45b97eda regions now make use of nested top actions, so they're almost correct. (Still need to lock freed regions until end of transaction.) 2006-07-25 00:56:50 +00:00
Sears Russell
86fab6a22b Turn on paranoid slotted page consistency checks for long running tests. 2006-07-22 00:05:40 +00:00
Sears Russell
2af892709f Rewrote slottedCompact; added fsckSlottedPage 2006-07-22 00:01:42 +00:00
Sears Russell
0725af91be Fixed page leak in Talloc(). 2006-07-21 01:07:09 +00:00
Sears Russell
eb13531c0f Partial handling of incomplete log entries. (It detects when the log file does not end at the right byte, but doesn't checksum, or otherwise look for
sectors that didn't make it to disk.)
2006-07-21 01:06:35 +00:00
Sears Russell
1ff1d4c128 Re-enabled truncation (accidentally disabled it before...) 2006-07-20 01:30:58 +00:00
Sears Russell
ffd3bd960b switched to region allocator, but TpageAlloc currently grabs its own region... 2006-07-20 01:29:39 +00:00
Sears Russell
7bc60c3ac4 fixed the fixedPageAlloc hack. 2006-07-20 00:49:28 +00:00
Sears Russell
8ed909e79d Fixed the fixedPageAlloc hack. 2006-07-20 00:48:42 +00:00
Sears Russell
1ac3dc6779 More progress on boundary tags. (Still not tested/working yet...) 2006-07-18 23:59:00 +00:00
Sears Russell
bf98e32c73 fixed build 2006-06-22 23:31:42 +00:00
Sears Russell
93e7e96ea3 Started implementing the region allocator 2006-06-22 19:10:02 +00:00
Sears Russell
d26263262b Completely new blob implementation. Slower than the old one was supposed to be, but is correct, and extremeley
simple.  It simply writes the pre-image and post-image of each blob to the log using TpageSet.
2006-06-21 00:45:18 +00:00
Sears Russell
c8c9b7af19 the logger understands special record types. (At least partially...); shortened blob tests, since the blob
implementation is fundamentally broken, and slow
2006-06-20 23:02:27 +00:00
Sears Russell
6485a4aae9 No more PBL. 2006-06-20 21:44:17 +00:00
Sears Russell
4d79c0a466 Simplified allocation 2006-06-20 21:40:21 +00:00
Sears Russell
e14877821f Fixed blob bug. The reason it's so slow is that it's logging a preimage + postimage of each blob and then synchronously writing to a second copy each time the blob is
written to(!!!)
2006-06-20 00:03:38 +00:00
Sears Russell
3e4cac0fe3 Continued cleaning up allocation code. It seems really slow all of a sudden, so this commit probably introduced a performance bug. 2006-06-17 00:25:09 +00:00
Sears Russell
209a6916e5 Updated some comments. 2006-06-16 00:27:02 +00:00
Sears Russell
dc8a3e5d60 Eliminated slottedPreRalloc 2006-06-16 00:05:44 +00:00
Sears Russell
245db32c23 Two programs to create and quickly query a read-only on disk hash table 2006-06-15 22:28:39 +00:00
Sears Russell
50515ffd23 More steps toward factoring page allocation out of record allocation. 2006-06-15 05:31:20 +00:00
Sears Russell
59bd80a2a8 half-hearted attempt to fix -Wextra warnings... 2006-06-13 23:58:04 +00:00
Sears Russell
a3678aad5c Now AM_CFLAGS can be set by modifying GLOBAL_CFLAGS in the root
Makefile.am
2006-06-13 22:48:50 +00:00
Sears Russell
f53a46e788 removed heisenbug 2006-06-13 22:47:38 +00:00
Sears Russell
1b3a08d434 added some todos 2006-06-13 22:46:11 +00:00
Sears Russell
1cf3119eb7 renamed __really_do_ralloc to really_do_ralloc 2006-06-13 22:45:30 +00:00
Sears Russell
66ae3b9763 Made it more obvious that a suspicious looking assert is commented out 2006-06-13 22:44:40 +00:00
Sears Russell
24a5da9648 Fixed deprecated volatile static declaration (-> static volatile) 2006-06-13 22:43:58 +00:00
Sears Russell
33af9805ad printf -> fprintf(stderr, and assert(0) -> abort() 2006-06-13 22:43:20 +00:00
Sears Russell
f77e8b240d It was improperly tracking the log's global offset. (Hopefully)
fixed offset tracking, made it optional, and disabled it.
2006-06-13 22:42:15 +00:00
Sears Russell
c5add15bd3 assert(0) -> abort 2006-06-13 22:40:53 +00:00
Sears Russell
eab6385ca5 Moved #defines below definition of Page_s. 2006-06-13 22:40:24 +00:00
Sears Russell
f89903d529 moved stdio.h include out of header file. 2006-06-13 22:38:25 +00:00
Sears Russell
e56c46b95c Moved blob_record_t into transactional.h (part of transition to using
slot type lookup tables.)
2006-06-13 22:37:29 +00:00
Sears Russell
a11fbdd9e6 Did away with slottedPreRallocFromPage. 2006-06-13 20:00:46 +00:00
Sears Russell
cef9e2c4ce Added settings for longer-running tests 2006-06-12 22:45:41 +00:00
Sears Russell
e0b34633ec Fixed broken min_rec_lsn() semantics; before, if there were not outstanding transactions / writes,
then these calls would return flushedLSN().  The problem was that flushedLSN wasn't guaranteed to
return a pointed to the beginning of a log entry.
2006-06-12 21:50:21 +00:00
Sears Russell
7bb0ce0d17 Fixed truncation bug (truncation is more aggressive now), and added more debugging info. 2006-06-12 20:55:49 +00:00
Sears Russell
27f7df6f09 Fixed races on flushedLSN and page->dirty. 2006-06-12 20:05:28 +00:00
Sears Russell
35a5e80871 removed bogus .deps files. 2006-06-01 22:18:50 +00:00
Sears Russell
fd19036843 Added more complete hashtable test; fixed incorrect return value in LH_ENTRY(find) 2006-05-31 00:37:56 +00:00
Sears Russell
0649f179b3 Got rid of the ~1 second delay on exit. 2006-05-30 22:59:22 +00:00
Sears Russell
68dcc2067e No more warnings with -O2. 2006-05-25 22:50:52 +00:00
Sears Russell
8ce9e6127f Fixed return value in removeFromLinkedList 2006-05-25 22:48:15 +00:00
Sears Russell
b5d578f4e0 Fixed remaining warnings, got rid of alTupdate 2006-05-25 20:08:12 +00:00
Sears Russell
fda416090b Fixed a bunch of 'easy' warnings 2006-05-25 00:02:46 +00:00
Sears Russell
cb3a4ae20d Bucket list extension working. 2006-05-24 23:24:31 +00:00