sears
|
aa7f7189d6
|
admission control *almost* works; c1 sometimes blocks for a long time when a new c2 is created
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@809 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-26 00:58:17 +00:00 |
|
sears
|
c50c14d259
|
admission control is now behaving properly (but there are still no concurrent writes, or bounds on how long admission control throttles a given writer)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@806 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-21 23:43:17 +00:00 |
|
sears
|
2a1157602a
|
Rewrite merge thread synchronization code, update status messages, implement preliminary (and ineffective) admission control, and force write merged data every megabyte (so that prograess can be tracked by admission control. Also, refactor quite a few things.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@805 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-19 23:42:06 +00:00 |
|
sears
|
1adb980555
|
added throttling policy and better stats. the throttling makes a merge policy bug painfully obvious (committing because i plan to do some refactoring...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@802 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-12 22:16:41 +00:00 |
|
sears
|
7b2560d906
|
initial merge manager (multi-merge) statistics
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@797 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 23:13:04 +00:00 |
|
sears
|
ce48882946
|
oops; forgot to add mergeStats.h; finished encapsuating its state
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@795 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 01:03:56 +00:00 |
|
sears
|
176a1e804a
|
more encapsulation changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@794 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 00:57:48 +00:00 |
|
sears
|
ded9cc2585
|
fixed rounding errors in statistics written to stdout; whitespace cleanup; more encapsulation
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@793 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-28 21:29:15 +00:00 |
|
sears
|
151373d09a
|
refactoring; move init_stasis into logtable, put merge stats into their own module
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@792 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-28 19:21:25 +00:00 |
|
sears
|
418bc33805
|
add --benchmark flag; simplifies things when I push diffs from the dev machine to the servers
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@790 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-27 17:57:43 +00:00 |
|
sears
|
2f15673c80
|
pass sequential I/O hints to stasis
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@773 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-12 20:56:54 +00:00 |
|
sears
|
21238f1961
|
silence excessive debug spam
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@768 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-31 22:54:56 +00:00 |
|
sears
|
fb073c5671
|
fix integer arithmetic bug that caused C0 and C1 to merge arbitrarily often
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@767 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-31 22:54:26 +00:00 |
|
sears
|
2ea8b9ff44
|
latching fixes, server no longer ignores --test, performance tuning
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@759 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-24 20:30:35 +00:00 |
|
sears
|
ead6207f86
|
add --test argument to server, fix segfault due to scans with empty c0_mergeable
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@699 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-17 23:45:41 +00:00 |
|
sears
|
e1c937a602
|
Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@698 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-17 21:51:26 +00:00 |
|
sears
|
6cd1ccb5ff
|
commented about merge transaction strategy
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@697 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-16 17:58:19 +00:00 |
|
sears
|
28433bf336
|
remove logiterators.h/cpp and stop #including datapage.cpp
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@690 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-13 00:41:37 +00:00 |
|
sears
|
c8c48a188d
|
more refactoring; all iterators now live in their respective tree components, fixed some hardcoded parameters; encapsulate allocators inside of diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@689 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-13 00:05:06 +00:00 |
|
sears
|
dc8185a236
|
eliminate "lastLeaf" parameter from all functions in the diskTreeComponent API
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@686 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 23:48:42 +00:00 |
|
sears
|
5f0d5c4f97
|
use RegionAllocator for InternalNodes and DataPages
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@685 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 23:17:03 +00:00 |
|
sears
|
8d7199676c
|
made diskTreeComponent more object oriented; many of its functions are now private
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@684 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 22:18:55 +00:00 |
|
sears
|
b298e49bad
|
whitespace changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@683 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:30:39 +00:00 |
|
sears
|
5d533a7939
|
DataPage::RegionAllocator -> RegionAllocator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@682 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:29:03 +00:00 |
|
sears
|
54e73ab803
|
move the internal node region allocator stuff into diskTreeComponent::internalNode
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@681 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:23:15 +00:00 |
|
sears
|
01c65d7a3c
|
diskTreeComponent -> diskTreeComponent::internalNodes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@680 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 19:47:12 +00:00 |
|
sears
|
1f2f4c745b
|
more iterator renaming; also, getnext() -> next_callerFrees()
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@679 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 19:02:54 +00:00 |
|
sears
|
76cd6a26c7
|
changingMemTreeIterator -> memTreeComponent::changingMemTreeIterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@676 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:47:47 +00:00 |
|
sears
|
104f38f517
|
fix(?) hard to reproduce double free
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@675 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:45:51 +00:00 |
|
sears
|
156c015b84
|
fix boundary condition in histogram code
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@674 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:03:18 +00:00 |
|
sears
|
de7984b05a
|
create memTreeComponent class. Moved memTreeIterator, rbtree_t and tearDownTree into it (still need to move changableMemTreeIterator into it...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@673 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 01:42:23 +00:00 |
|
sears
|
220d58bd7c
|
DataPage::RecordIterator -> DataPage::iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@672 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 00:14:24 +00:00 |
|
sears
|
452ee97442
|
diskTreeComponentIterator -> diskTreeComponent::iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@671 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 00:09:38 +00:00 |
|
sears
|
85ca7a935c
|
remove most of the read/write record wrappers from diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@670 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-08 23:58:13 +00:00 |
|
sears
|
0a356875b2
|
removed some slotted page dispatch stuff from diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@669 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-08 20:16:03 +00:00 |
|
sears
|
a79c7d1c46
|
check_tcpclient now examines the output of its iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@668 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 23:23:43 +00:00 |
|
sears
|
06fa7999cb
|
c++-ify diskTreeComponentIterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@667 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 22:21:44 +00:00 |
|
sears
|
020f0faf17
|
evil? lucky? whitespace cleanup
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@666 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 21:19:52 +00:00 |
|
sears
|
b75ad3675c
|
fix comments + TODO in diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@665 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 20:46:20 +00:00 |
|
sears
|
eba30f92a3
|
clean up some crufty comments, remove hardcoded constant
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@664 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 20:34:42 +00:00 |
|
sears
|
2dfbba1341
|
remove duplicate code in datapage.cpp
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@663 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 19:56:50 +00:00 |
|
sears
|
632afe6d9c
|
cleanup statistics gathering and reporting.
constify inputs to merge functions (so they can't call freetuple())
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@662 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 19:07:47 +00:00 |
|
sears
|
f258ce1a3f
|
adding a few overlooked files
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@657 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-03 23:21:08 +00:00 |
|
sears
|
1243d999a5
|
Hacky histogram generation; API's for client-side iterators.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@656 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-03 23:20:05 +00:00 |
|
sears
|
747f4df1f3
|
Reopening existing trees now seems to work (no thorough tests yet). Added some network opcodes for statistics and debugging (not all are implemented yet). Reduce verbosity of server and client library.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@654 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-01 21:26:07 +00:00 |
|
sears
|
27720dddbe
|
Implemented (but did not test) header update.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@650 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-02-27 00:35:13 +00:00 |
|
sears
|
2d44b6beed
|
Fix another datapage leak in unit test.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@649 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-02-27 00:33:12 +00:00 |
|
sears
|
20dc06280b
|
Initial checkin of sherpa backend. These files probably don't belong here in the long term, but this is expedient.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@645 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-02-26 18:52:25 +00:00 |
|
sears
|
9c2c41c30c
|
fix build on non-stasis machines (workaround fact that check_tcpclient incorrectly requires stasis...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@644 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-02-26 18:51:12 +00:00 |
|
sears
|
51df61f8e9
|
logtableIterator now drops tombstone tuples by default
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@642 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-02-26 17:45:31 +00:00 |
|