greg/stasis-bLSM
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
92 commits 1 branch 0 tags 670 KiB
Commit graph

92 commits

This branch
This branch
All branches
Author SHA1 Message Date
sears
aa7f7189d6 admission control *almost* works; c1 sometimes blocks for a long time when a new c2 is created 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@809 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-05-26 00:58:17 +00:00
sears
c50c14d259 admission control is now behaving properly (but there are still no concurrent writes, or bounds on how long admission control throttles a given writer) 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@806 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-05-21 23:43:17 +00:00
sears
2a1157602a Rewrite merge thread synchronization code, update status messages, implement preliminary (and ineffective) admission control, and force write merged data every megabyte (so that prograess can be tracked by admission control. Also, refactor quite a few things. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@805 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-05-19 23:42:06 +00:00
sears
1adb980555 added throttling policy and better stats. the throttling makes a merge policy bug painfully obvious (committing because i plan to do some refactoring...) 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@802 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-05-12 22:16:41 +00:00
sears
7b2560d906 initial merge manager (multi-merge) statistics 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@797 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-29 23:13:04 +00:00
sears
ce48882946 oops; forgot to add mergeStats.h; finished encapsuating its state 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@795 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-29 01:03:56 +00:00
sears
176a1e804a more encapsulation changes 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@794 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-29 00:57:48 +00:00
sears
ded9cc2585 fixed rounding errors in statistics written to stdout; whitespace cleanup; more encapsulation 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@793 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-28 21:29:15 +00:00
sears
151373d09a refactoring; move init_stasis into logtable, put merge stats into their own module 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@792 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-28 19:21:25 +00:00
sears
418bc33805 add --benchmark flag; simplifies things when I push diffs from the dev machine to the servers 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@790 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-27 17:57:43 +00:00
sears
2f15673c80 pass sequential I/O hints to stasis 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@773 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-04-12 20:56:54 +00:00
sears
21238f1961 silence excessive debug spam 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@768 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-31 22:54:56 +00:00
sears
fb073c5671 fix integer arithmetic bug that caused C0 and C1 to merge arbitrarily often 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@767 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-31 22:54:26 +00:00
sears
2ea8b9ff44 latching fixes, server no longer ignores --test, performance tuning 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@759 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-24 20:30:35 +00:00
sears
ead6207f86 add --test argument to server, fix segfault due to scans with empty c0_mergeable 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@699 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-17 23:45:41 +00:00
sears
e1c937a602 Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@698 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-17 21:51:26 +00:00
sears
6cd1ccb5ff commented about merge transaction strategy 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@697 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-16 17:58:19 +00:00
sears
28433bf336 remove logiterators.h/cpp and stop #including datapage.cpp 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@690 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-13 00:41:37 +00:00
sears
c8c48a188d more refactoring; all iterators now live in their respective tree components, fixed some hardcoded parameters; encapsulate allocators inside of diskTreeComponent 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@689 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-13 00:05:06 +00:00
sears
dc8185a236 eliminate "lastLeaf" parameter from all functions in the diskTreeComponent API 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@686 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 23:48:42 +00:00
sears
5f0d5c4f97 use RegionAllocator for InternalNodes and DataPages 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@685 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 23:17:03 +00:00
sears
8d7199676c made diskTreeComponent more object oriented; many of its functions are now private 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@684 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 22:18:55 +00:00
sears
b298e49bad whitespace changes 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@683 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 20:30:39 +00:00
sears
5d533a7939 DataPage::RegionAllocator -> RegionAllocator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@682 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 20:29:03 +00:00
sears
54e73ab803 move the internal node region allocator stuff into diskTreeComponent::internalNode 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@681 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 20:23:15 +00:00
sears
01c65d7a3c diskTreeComponent -> diskTreeComponent::internalNodes 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@680 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 19:47:12 +00:00
sears
1f2f4c745b more iterator renaming; also, getnext() -> next_callerFrees() 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@679 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 19:02:54 +00:00
sears
76cd6a26c7 changingMemTreeIterator -> memTreeComponent::changingMemTreeIterator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@676 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 17:47:47 +00:00
sears
104f38f517 fix(?) hard to reproduce double free 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@675 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 17:45:51 +00:00
sears
156c015b84 fix boundary condition in histogram code 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@674 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 17:03:18 +00:00
sears
de7984b05a create memTreeComponent class. Moved memTreeIterator, rbtree_t and tearDownTree into it (still need to move changableMemTreeIterator into it...) 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@673 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 01:42:23 +00:00
sears
220d58bd7c DataPage::RecordIterator -> DataPage::iterator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@672 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 00:14:24 +00:00
sears
452ee97442 diskTreeComponentIterator -> diskTreeComponent::iterator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@671 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-09 00:09:38 +00:00
sears
85ca7a935c remove most of the read/write record wrappers from diskTreeComponent 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@670 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-08 23:58:13 +00:00
sears
0a356875b2 removed some slotted page dispatch stuff from diskTreeComponent 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@669 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-08 20:16:03 +00:00
sears
a79c7d1c46 check_tcpclient now examines the output of its iterator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@668 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 23:23:43 +00:00
sears
06fa7999cb c++-ify diskTreeComponentIterator 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@667 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 22:21:44 +00:00
sears
020f0faf17 evil? lucky? whitespace cleanup 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@666 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 21:19:52 +00:00
sears
b75ad3675c fix comments + TODO in diskTreeComponent 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@665 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 20:46:20 +00:00
sears
eba30f92a3 clean up some crufty comments, remove hardcoded constant 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@664 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 20:34:42 +00:00
sears
2dfbba1341 remove duplicate code in datapage.cpp 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@663 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 19:56:50 +00:00
sears
632afe6d9c cleanup statistics gathering and reporting. 
constify inputs to merge functions (so they can't call freetuple())


git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@662 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-05 19:07:47 +00:00
sears
f258ce1a3f adding a few overlooked files 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@657 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-03 23:21:08 +00:00
sears
1243d999a5 Hacky histogram generation; API's for client-side iterators. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@656 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-03 23:20:05 +00:00
sears
747f4df1f3 Reopening existing trees now seems to work (no thorough tests yet). Added some network opcodes for statistics and debugging (not all are implemented yet). Reduce verbosity of server and client library. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@654 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-03-01 21:26:07 +00:00
sears
27720dddbe Implemented (but did not test) header update. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@650 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-02-27 00:35:13 +00:00
sears
2d44b6beed Fix another datapage leak in unit test. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@649 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-02-27 00:33:12 +00:00
sears
20dc06280b Initial checkin of sherpa backend. These files probably don't belong here in the long term, but this is expedient. 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@645 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-02-26 18:52:25 +00:00
sears
9c2c41c30c fix build on non-stasis machines (workaround fact that check_tcpclient incorrectly requires stasis...) 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@644 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-02-26 18:51:12 +00:00
sears
51df61f8e9 logtableIterator now drops tombstone tuples by default 
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@642 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
 2010-02-26 17:45:31 +00:00