Commit graph

241 commits

Author SHA1 Message Date
sears
18b58aa484 add missing methods to thrift server; temporary CMake fix
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3535 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2012-01-09 19:29:17 +00:00
sears
7bb6c3e166 port to macosx, add explicit dependency on mapkeeper
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3508 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-12-22 04:37:40 +00:00
sears
bed774467a Add simple makefile for building static binaries
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3506 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-12-21 21:05:29 +00:00
sears
297e715514 move update progress out of application threads, and into background thread
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3288 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-11-04 20:59:22 +00:00
sears
8843807ab5 clean up red black tree latching
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3287 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-11-04 20:58:31 +00:00
sears
769b7615dd disable periodic force writes in merger (now handled by stasis instead); fix concurrency bug where merge held writelock while forcing data
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3285 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-11-04 20:55:27 +00:00
sears
6aae6898e7 add more benchmarking phases phases to lsm_microbenchmarks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3284 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-11-04 20:52:55 +00:00
sears
051f46b03a add blind update option to mapkeeper server; tweak benchmark mode memory settings
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@3283 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-11-04 20:50:50 +00:00
sears
f8f307803e do not default to writes_are_sequential
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2942 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-23 05:01:40 +00:00
sears
257b5587ca create new executable, lsm_microbenchmarks. The idea is to bring up the LSM tree a little at a time, and see where the performance falls over.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2940 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-23 01:26:05 +00:00
sears
a24f1e34fe change ambiguous field name
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2939 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-23 01:08:02 +00:00
sears
e944fa63c9 commit michi patch to target mapkeeper instead of dht_persistent_store; remove cruft; cleanup makefile
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2938 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-23 00:10:43 +00:00
sears
f05ccec98f increased verbosity of test
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2936 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-22 23:50:14 +00:00
sears
a780f4b78f change include for new version of stasis
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2935 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-22 23:48:56 +00:00
sears
8450f4172c change include for new version of stasis
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2934 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-22 23:46:56 +00:00
sears
7b9d9536d3 check in dht_persistent_store stuff
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2926 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-19 19:47:08 +00:00
sears
fd40318867 checkin thrift stuff
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2925 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-19 19:45:40 +00:00
sears
9727d0b39d add non-yahoo makefile for thrift server
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2924 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-19 19:18:33 +00:00
surajach
5524b96bd9 Removing the typename keyword to make declarations compile with gcc 4.1.2 after a bunch of types are no longer templates
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2672 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-13 18:47:21 +00:00
sears
d9e445df06 whitespace changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2671 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 02:05:03 +00:00
sears
693170eebe port sherpa wrapper to new api
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2670 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 01:43:46 +00:00
sears
6f82ae268a remove more template stuff
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2668 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 01:16:55 +00:00
sears
ef4d360b68 memTreeComponent is no longer a template
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2667 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:27:57 +00:00
sears
0923cd9d96 datapage is no longer a template
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2666 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:07:42 +00:00
sears
f0ba49a649 fix eclipse code indexer includes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2665 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:06:21 +00:00
sears
2b8da4a254 comment, whitespace cleanup
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2664 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:02:20 +00:00
sears
37795199fe add shutdown and fix deleted tuple handling in sherpa binding
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2663 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-08 23:58:29 +00:00
michim
2756b886fe removed debug printfs
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2574 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-19 22:15:53 +00:00
michim
8aadd27e3c fixed memory leaks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2555 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-16 21:16:36 +00:00
sears
05ee405772 fix for dropping first key in range scans
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2554 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 17:57:05 +00:00
michim
c4bf5a4995 removed debug printfs
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2553 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 07:06:04 +00:00
michim
ff6e081ca1 use htonl. fixed a typo in daemontools run script.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2552 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 06:53:39 +00:00
michim
88c718c828 commented out timestamp hack
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2550 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:08:41 +00:00
michim
c9695d4fd1 commented out timestamp hack
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2549 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:06:31 +00:00
michim
49b4d4ebdb added some option to daemontools run script.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2548 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:03:09 +00:00
michim
129342b42c added remove().
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2547 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 20:56:04 +00:00
michim
5291a25dce added packages and conf directories. added update and scan operations.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2546 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 20:41:18 +00:00
michim
abda0606de moving to thrift
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2545 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 00:30:02 +00:00
michim
630c16d12e moving to thrift.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2543 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-11 22:27:48 +00:00
sears
005ee8a776 fix memory leak, add asserts
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2531 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:10:23 +00:00
sears
72ecdea59e disable spammy printfs, change assert so that it prints extra debugging info, then ignores error
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2530 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:09:59 +00:00
sears
bb3e768df7 remove line that accidentally disabled strippedkeylen()
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2529 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:05:32 +00:00
sears
ae7c827ab5 add hacky garbage collection mechanism
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2484 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-28 21:56:25 +00:00
sears
c910a7af8f fix latching bug in scan
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2483 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-28 20:18:54 +00:00
sears
e81b8522d7 fix memory leaks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2457 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-25 15:28:45 +00:00
sears
36790f6c2c add comment
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2455 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-24 21:09:54 +00:00
sears
5010688123 fix compiler warning on 32 bit architectures;
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2453 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-23 18:53:38 +00:00
sears
5be84f59e8 add support for early tombstone dropping, extend datatuple format to support timestamps
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2451 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 22:54:49 +00:00
sears
9672bc4f48 add commented out debugging code
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2450 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:41:13 +00:00
sears
5343f3021e fix broken merge logic. it was sometimes dropping live tuples, and never dropping tombstones...
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2449 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:40:37 +00:00