sears
|
eda514ddaa
|
amortize the computation of statistics (but not mutex acuqisitions) across many tuple insertions. Also, refactor stats stuff with latch contention in mind (but it still grabs too many latches...). This commit causes check_tcpclient to emit warnings on my machine. Not sure if it will happen on production hardware
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@824 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-06-02 21:47:58 +00:00 |
|
sears
|
fcf0dcca99
|
cleanup / reimplement some of the statistics calculations. dial back periodically_force
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@821 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-28 21:20:26 +00:00 |
|
sears
|
dca4fbe594
|
revert server thread count (it was set to 5 for debugging, then accidentally committed...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@820 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-28 18:31:34 +00:00 |
|
sears
|
4050475de9
|
more bugfixes / cleanup. latching is probably overly conservative at this point, but ycsb bulkload finally seems to work
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@819 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-28 01:29:10 +00:00 |
|
sears
|
d981d91dfa
|
numerous bugfixes; rate limit progress meter display
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@816 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-27 23:15:24 +00:00 |
|
sears
|
6eecf1557a
|
restore support for concurrent disk reads; logserver was accidentally using a findTuple function that assumed diffs. This commit uses rwlc, and requires Stasis -r1393 or better
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@814 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-27 01:49:27 +00:00 |
|
sears
|
0e375c005b
|
more merge tweaks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@813 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-26 23:53:21 +00:00 |
|
sears
|
aa7f7189d6
|
admission control *almost* works; c1 sometimes blocks for a long time when a new c2 is created
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@809 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-26 00:58:17 +00:00 |
|
sears
|
c50c14d259
|
admission control is now behaving properly (but there are still no concurrent writes, or bounds on how long admission control throttles a given writer)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@806 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-21 23:43:17 +00:00 |
|
sears
|
2a1157602a
|
Rewrite merge thread synchronization code, update status messages, implement preliminary (and ineffective) admission control, and force write merged data every megabyte (so that prograess can be tracked by admission control. Also, refactor quite a few things.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@805 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-19 23:42:06 +00:00 |
|
sears
|
1adb980555
|
added throttling policy and better stats. the throttling makes a merge policy bug painfully obvious (committing because i plan to do some refactoring...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@802 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-05-12 22:16:41 +00:00 |
|
sears
|
7b2560d906
|
initial merge manager (multi-merge) statistics
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@797 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 23:13:04 +00:00 |
|
sears
|
ce48882946
|
oops; forgot to add mergeStats.h; finished encapsuating its state
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@795 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 01:03:56 +00:00 |
|
sears
|
176a1e804a
|
more encapsulation changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@794 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-29 00:57:48 +00:00 |
|
sears
|
ded9cc2585
|
fixed rounding errors in statistics written to stdout; whitespace cleanup; more encapsulation
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@793 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-28 21:29:15 +00:00 |
|
sears
|
151373d09a
|
refactoring; move init_stasis into logtable, put merge stats into their own module
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@792 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-28 19:21:25 +00:00 |
|
sears
|
418bc33805
|
add --benchmark flag; simplifies things when I push diffs from the dev machine to the servers
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@790 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-27 17:57:43 +00:00 |
|
sears
|
2f15673c80
|
pass sequential I/O hints to stasis
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@773 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-04-12 20:56:54 +00:00 |
|
sears
|
21238f1961
|
silence excessive debug spam
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@768 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-31 22:54:56 +00:00 |
|
sears
|
fb073c5671
|
fix integer arithmetic bug that caused C0 and C1 to merge arbitrarily often
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@767 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-31 22:54:26 +00:00 |
|
sears
|
2ea8b9ff44
|
latching fixes, server no longer ignores --test, performance tuning
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@759 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-24 20:30:35 +00:00 |
|
sears
|
ead6207f86
|
add --test argument to server, fix segfault due to scans with empty c0_mergeable
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@699 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-17 23:45:41 +00:00 |
|
sears
|
e1c937a602
|
Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@698 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-17 21:51:26 +00:00 |
|
sears
|
6cd1ccb5ff
|
commented about merge transaction strategy
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@697 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-16 17:58:19 +00:00 |
|
sears
|
28433bf336
|
remove logiterators.h/cpp and stop #including datapage.cpp
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@690 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-13 00:41:37 +00:00 |
|
sears
|
c8c48a188d
|
more refactoring; all iterators now live in their respective tree components, fixed some hardcoded parameters; encapsulate allocators inside of diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@689 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-13 00:05:06 +00:00 |
|
sears
|
dc8185a236
|
eliminate "lastLeaf" parameter from all functions in the diskTreeComponent API
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@686 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 23:48:42 +00:00 |
|
sears
|
5f0d5c4f97
|
use RegionAllocator for InternalNodes and DataPages
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@685 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 23:17:03 +00:00 |
|
sears
|
8d7199676c
|
made diskTreeComponent more object oriented; many of its functions are now private
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@684 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 22:18:55 +00:00 |
|
sears
|
b298e49bad
|
whitespace changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@683 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:30:39 +00:00 |
|
sears
|
5d533a7939
|
DataPage::RegionAllocator -> RegionAllocator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@682 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:29:03 +00:00 |
|
sears
|
54e73ab803
|
move the internal node region allocator stuff into diskTreeComponent::internalNode
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@681 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 20:23:15 +00:00 |
|
sears
|
01c65d7a3c
|
diskTreeComponent -> diskTreeComponent::internalNodes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@680 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 19:47:12 +00:00 |
|
sears
|
1f2f4c745b
|
more iterator renaming; also, getnext() -> next_callerFrees()
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@679 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 19:02:54 +00:00 |
|
sears
|
76cd6a26c7
|
changingMemTreeIterator -> memTreeComponent::changingMemTreeIterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@676 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:47:47 +00:00 |
|
sears
|
104f38f517
|
fix(?) hard to reproduce double free
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@675 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:45:51 +00:00 |
|
sears
|
156c015b84
|
fix boundary condition in histogram code
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@674 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 17:03:18 +00:00 |
|
sears
|
de7984b05a
|
create memTreeComponent class. Moved memTreeIterator, rbtree_t and tearDownTree into it (still need to move changableMemTreeIterator into it...)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@673 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 01:42:23 +00:00 |
|
sears
|
220d58bd7c
|
DataPage::RecordIterator -> DataPage::iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@672 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 00:14:24 +00:00 |
|
sears
|
452ee97442
|
diskTreeComponentIterator -> diskTreeComponent::iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@671 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-09 00:09:38 +00:00 |
|
sears
|
85ca7a935c
|
remove most of the read/write record wrappers from diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@670 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-08 23:58:13 +00:00 |
|
sears
|
0a356875b2
|
removed some slotted page dispatch stuff from diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@669 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-08 20:16:03 +00:00 |
|
sears
|
a79c7d1c46
|
check_tcpclient now examines the output of its iterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@668 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 23:23:43 +00:00 |
|
sears
|
06fa7999cb
|
c++-ify diskTreeComponentIterator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@667 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 22:21:44 +00:00 |
|
sears
|
020f0faf17
|
evil? lucky? whitespace cleanup
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@666 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 21:19:52 +00:00 |
|
sears
|
b75ad3675c
|
fix comments + TODO in diskTreeComponent
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@665 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 20:46:20 +00:00 |
|
sears
|
eba30f92a3
|
clean up some crufty comments, remove hardcoded constant
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@664 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 20:34:42 +00:00 |
|
sears
|
2dfbba1341
|
remove duplicate code in datapage.cpp
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@663 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 19:56:50 +00:00 |
|
sears
|
632afe6d9c
|
cleanup statistics gathering and reporting.
constify inputs to merge functions (so they can't call freetuple())
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@662 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-05 19:07:47 +00:00 |
|
sears
|
f258ce1a3f
|
adding a few overlooked files
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@657 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
|
2010-03-03 23:21:08 +00:00 |
|