Read/latency-optimized log-structured merge tree.
Find a file
sears 1c8c0fe0da switch default buffer manager to concurrentBufferManager (AGAIN)
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1177 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2010-09-22 19:28:07 +00:00
benchmarks add no-op network call, and a simple benchmark that exercises it 2010-08-09 20:21:41 +00:00
sherpa add some error checking. testTablet is closer to passing 2010-09-16 21:13:43 +00:00
test add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
util add megabytes to status output 2010-09-02 23:02:51 +00:00
adriana-lima.awk initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
CMakeLists.txt add new server implementation that uses FILE to buffer I/O, and handles a smaller, fixed number of connections -- leads to an almost 4x speedup on no-ops on nehalem 2010-08-11 22:46:55 +00:00
cmds.txt initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
datapage.cpp fix latch/pin leak 2010-08-12 01:55:30 +00:00
datapage.h Implemented snowshoveling, with caveats. 2010-08-05 17:43:46 +00:00
datatuple.h partially working sherpa 1.10 backend with .so support 2010-09-15 21:53:51 +00:00
diskTreeComponent.cpp added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
diskTreeComponent.h added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
install.sh install.sh script for yroots 2010-02-21 17:04:30 +00:00
logserver.cpp add new server implementation that uses FILE to buffer I/O, and handles a smaller, fixed number of connections -- leads to an almost 4x speedup on no-ops on nehalem 2010-08-11 22:46:55 +00:00
logserver.h Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy 2010-03-17 21:51:26 +00:00
logstore.cpp switch default buffer manager to concurrentBufferManager (AGAIN) 2010-09-22 19:28:07 +00:00
logstore.h add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
memTreeComponent.cpp Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy 2010-03-17 21:51:26 +00:00
memTreeComponent.h remove old comments 2010-08-24 00:40:48 +00:00
mergeManager.cpp added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
mergeManager.h added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
merger.cpp added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
merger.h two unrelated changes: release rb_mut before getting header_mut on read path (breaks delta tuples), and implement first-cut support for pulling in statistics when reopening logstores (required for correct recovery) 2010-06-21 20:03:05 +00:00
mergeStats.cpp Rewrite merge thread synchronization code, update status messages, implement preliminary (and ineffective) admission control, and force write merged data every megabyte (so that prograess can be tracked by admission control. Also, refactor quite a few things. 2010-05-19 23:42:06 +00:00
mergeStats.h scattered, and poorly tested fixes. finer grained latching for tree nodes; throttle c0-c1 merge when c0 is small; fix delta computations for c0 throttling; disable short pauses for c1-c2 merge. this gets the bulk load throughput up to 8500, but workloada is still slow 2010-08-21 03:09:18 +00:00
network.h add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
newserver.cpp add memTreeComponent::batchedRevalidatingIterator; amortize cost of red black latching during merge 2010-08-18 17:29:25 +00:00
NOTES initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
regionAllocator.h Implemented snowshoveling, with caveats. 2010-08-05 17:43:46 +00:00
requestDispatch.cpp add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
requestDispatch.h add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
server.cpp incease UPDATE_PROGRESS_DELTA by 10x, and FORCE_INTERVAL by 2.5x; tick no longer grabs a writelock on header_mut, and instead uses its own mutex 2010-06-21 22:59:05 +00:00
simpleServer.cpp add a #define to turn TCP_NODELAY on/off 2010-09-02 23:03:13 +00:00
simpleServer.h re-enable old merge policy for c1-c2 merger; implement shutdown (sort of) 2010-08-17 21:23:39 +00:00
tcpclient.cpp add a #define to turn TCP_NODELAY on/off 2010-09-02 23:03:13 +00:00
tcpclient.h added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
tuplemerger.cpp cleanup statistics gathering and reporting. 2010-03-05 19:07:47 +00:00
tuplemerger.h cleanup statistics gathering and reporting. 2010-03-05 19:07:47 +00:00