Read/latency-optimized log-structured merge tree.
Find a file
sears 79936da79b loosen some scheduling parameters
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1467 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2010-12-08 19:46:55 +00:00
benchmarks add no-op network call, and a simple benchmark that exercises it 2010-08-09 20:21:41 +00:00
sherpa change cerr to log4cpp 2010-09-29 17:58:34 +00:00
test fix #include mistake 2010-10-05 18:27:56 +00:00
util port to newer gcc/g++ 2010-10-02 12:52:41 +00:00
adriana-lima.awk initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
bloomFilter.c initial checkin of bloom filter 2010-10-03 18:06:19 +00:00
bloomFilter.h initial checkin of bloom filter 2010-10-03 18:06:19 +00:00
CMakeLists.txt get rid of -Wno-variadic-macros since it suddenly broke compilation for some reason 2010-10-05 16:54:27 +00:00
cmds.txt initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
datapage.cpp fix latch/pin leak 2010-08-12 01:55:30 +00:00
datapage.h Implemented snowshoveling, with caveats. 2010-08-05 17:43:46 +00:00
datatuple.h port to newer gcc/g++ 2010-10-02 12:52:41 +00:00
diskTreeComponent.cpp whitespace 2010-12-08 19:18:05 +00:00
diskTreeComponent.h initial checkin of bloom filter logic for lsm trees 2010-10-03 23:05:45 +00:00
install.sh install.sh script for yroots 2010-02-21 17:04:30 +00:00
logserver.cpp add new server implementation that uses FILE to buffer I/O, and handles a smaller, fixed number of connections -- leads to an almost 4x speedup on no-ops on nehalem 2010-08-11 22:46:55 +00:00
logserver.h Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy 2010-03-17 21:51:26 +00:00
logstore.cpp re-re-re-...re-disable new buffer manager optimizations 2010-10-05 16:50:39 +00:00
logstore.h reduce default datapage_size to 1 (4096) to avoid useless seeks for small values 2010-10-05 16:23:31 +00:00
memTreeComponent.cpp Refactoring of logtable. Cleaned a bunch of includes, and logtable is now a template. This is in preparation for the new merge policy 2010-03-17 21:51:26 +00:00
memTreeComponent.h remove old comments 2010-08-24 00:40:48 +00:00
mergeManager.cpp loosen some scheduling parameters 2010-12-08 19:46:55 +00:00
mergeManager.h added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
merger.cpp conservatively make the bloom filter really big (should behave well down to 100 byte keys, waste ram otherwise...) 2010-10-05 16:55:29 +00:00
merger.h two unrelated changes: release rb_mut before getting header_mut on read path (breaks delta tuples), and implement first-cut support for pulling in statistics when reopening logstores (required for correct recovery) 2010-06-21 20:03:05 +00:00
mergeStats.cpp Rewrite merge thread synchronization code, update status messages, implement preliminary (and ineffective) admission control, and force write merged data every megabyte (so that prograess can be tracked by admission control. Also, refactor quite a few things. 2010-05-19 23:42:06 +00:00
mergeStats.h scattered, and poorly tested fixes. finer grained latching for tree nodes; throttle c0-c1 merge when c0 is small; fix delta computations for c0 throttling; disable short pauses for c1-c2 merge. this gets the bulk load throughput up to 8500, but workloada is still slow 2010-08-21 03:09:18 +00:00
network.h port to newer gcc/g++ 2010-10-02 12:52:41 +00:00
newserver.cpp add memTreeComponent::batchedRevalidatingIterator; amortize cost of red black latching during merge 2010-08-18 17:29:25 +00:00
NOTES initial import; removed cruft from mert's tarball, tweaked make's clean targets 2010-01-23 02:13:59 +00:00
regionAllocator.h Implemented snowshoveling, with caveats. 2010-08-05 17:43:46 +00:00
requestDispatch.cpp add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
requestDispatch.h add atomic testAndSet operation (needed for sherpa tablet names' uniqid field) 2010-09-16 22:36:48 +00:00
server.cpp incease UPDATE_PROGRESS_DELTA by 10x, and FORCE_INTERVAL by 2.5x; tick no longer grabs a writelock on header_mut, and instead uses its own mutex 2010-06-21 22:59:05 +00:00
simpleServer.cpp add a #define to turn TCP_NODELAY on/off 2010-09-02 23:03:13 +00:00
simpleServer.h re-enable old merge policy for c1-c2 merger; implement shutdown (sort of) 2010-08-17 21:23:39 +00:00
tcpclient.cpp add a #define to turn TCP_NODELAY on/off 2010-09-02 23:03:13 +00:00
tcpclient.h added bulk-insert APIs, prevent c1-c2 from outrunning c0-c1 by too much, and fix the overshoot computations in merge manager (roughly corresponds to run 20) 2010-08-30 22:22:25 +00:00
tuplemerger.cpp cleanup statistics gathering and reporting. 2010-03-05 19:07:47 +00:00
tuplemerger.h cleanup statistics gathering and reporting. 2010-03-05 19:07:47 +00:00