Commit graph

275 commits

Author SHA1 Message Date
sears
fd40318867 checkin thrift stuff
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2925 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-19 19:45:40 +00:00
sears
9727d0b39d add non-yahoo makefile for thrift server
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2924 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-08-19 19:18:33 +00:00
surajach
5524b96bd9 Removing the typename keyword to make declarations compile with gcc 4.1.2 after a bunch of types are no longer templates
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2672 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-13 18:47:21 +00:00
sears
d9e445df06 whitespace changes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2671 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 02:05:03 +00:00
sears
693170eebe port sherpa wrapper to new api
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2670 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 01:43:46 +00:00
sears
6f82ae268a remove more template stuff
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2668 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 01:16:55 +00:00
sears
ef4d360b68 memTreeComponent is no longer a template
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2667 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:27:57 +00:00
sears
0923cd9d96 datapage is no longer a template
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2666 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:07:42 +00:00
sears
f0ba49a649 fix eclipse code indexer includes
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2665 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:06:21 +00:00
sears
2b8da4a254 comment, whitespace cleanup
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2664 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-09 00:02:20 +00:00
sears
37795199fe add shutdown and fix deleted tuple handling in sherpa binding
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2663 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-06-08 23:58:29 +00:00
michim
2756b886fe removed debug printfs
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2574 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-19 22:15:53 +00:00
michim
8aadd27e3c fixed memory leaks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2555 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-16 21:16:36 +00:00
sears
05ee405772 fix for dropping first key in range scans
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2554 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 17:57:05 +00:00
michim
c4bf5a4995 removed debug printfs
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2553 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 07:06:04 +00:00
michim
ff6e081ca1 use htonl. fixed a typo in daemontools run script.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2552 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-13 06:53:39 +00:00
michim
88c718c828 commented out timestamp hack
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2550 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:08:41 +00:00
michim
c9695d4fd1 commented out timestamp hack
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2549 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:06:31 +00:00
michim
49b4d4ebdb added some option to daemontools run script.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2548 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 21:03:09 +00:00
michim
129342b42c added remove().
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2547 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 20:56:04 +00:00
michim
5291a25dce added packages and conf directories. added update and scan operations.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2546 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 20:41:18 +00:00
michim
abda0606de moving to thrift
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2545 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-12 00:30:02 +00:00
michim
630c16d12e moving to thrift.
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2543 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-11 22:27:48 +00:00
sears
005ee8a776 fix memory leak, add asserts
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2531 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:10:23 +00:00
sears
72ecdea59e disable spammy printfs, change assert so that it prints extra debugging info, then ignores error
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2530 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:09:59 +00:00
sears
bb3e768df7 remove line that accidentally disabled strippedkeylen()
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2529 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-05-02 22:05:32 +00:00
sears
ae7c827ab5 add hacky garbage collection mechanism
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2484 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-28 21:56:25 +00:00
sears
c910a7af8f fix latching bug in scan
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2483 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-28 20:18:54 +00:00
sears
e81b8522d7 fix memory leaks
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2457 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-25 15:28:45 +00:00
sears
36790f6c2c add comment
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2455 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-24 21:09:54 +00:00
sears
5010688123 fix compiler warning on 32 bit architectures;
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2453 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-23 18:53:38 +00:00
sears
5be84f59e8 add support for early tombstone dropping, extend datatuple format to support timestamps
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2451 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 22:54:49 +00:00
sears
9672bc4f48 add commented out debugging code
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2450 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:41:13 +00:00
sears
5343f3021e fix broken merge logic. it was sometimes dropping live tuples, and never dropping tombstones...
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2449 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:40:37 +00:00
sears
4f74dfd45f documentation cleanup
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2448 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:39:52 +00:00
sears
38f1793eaa fix argument parsing typo
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2447 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:39:28 +00:00
sears
ab9cfd1443 add support for timestamps to datatuple comparator
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2446 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-22 17:38:18 +00:00
sears
65efc768a4 forgot to commit change_log_mode utility
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2438 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-21 00:53:23 +00:00
sears
c42a275ab4 fix shutdown bug; add debugging utility that allows the log to be enabled / batched / disabled at runtime
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2437 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-21 00:28:05 +00:00
sears
8135bbcc2e misc log cleanups; add command line parameter to newserver to control log mode
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2435 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-20 21:51:04 +00:00
sears
0508f6cb40 initial wal implementation
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2434 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-04-20 20:17:26 +00:00
sears
e5058da393 fix merge deadlock; port to fixed stasis buffer manager api; enable new buffer manager by default
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@2330 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-03-25 20:05:49 +00:00
sears
0a0646e75e ignore sigpipe
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1713 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-25 02:07:16 +00:00
sears
95c7290ac6 import eclipse project goo
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1712 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-25 02:06:42 +00:00
sears
f4936551bc optimize datatuple in-memory layout
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1590 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-11 22:08:10 +00:00
sears
975410845f add empirically determined estimators of c0 size, and pessimistic ones that are the default
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1589 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-11 22:07:39 +00:00
sears
abe7e36640 add comment explaining how to enable stlslab froms stasis
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1588 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-11 22:06:18 +00:00
sears
e674f4459a whitespace
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1587 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-11 22:05:52 +00:00
sears
dad55b564c Misc statistics cleanup; improved merge cost estimations during backpressure.
Misc statistics cleanups include:
 - fixes for corner case where c0 is empty, and it would divide by zero
 - always compute number of tuples (in / out, but not base)
 - rework amount of memory allocated when --test and --newserver are passed in.



git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1582 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2011-01-11 19:24:16 +00:00
sears
42b52a4d17 fix datapage padding behavior; the old padding overhead was ~ 100%; now it is much lower
git-svn-id: svn+ssh://svn.corp.yahoo.com/yahoo/yrl/labs/pnuts/code/logstore@1522 8dad8b1f-cf64-0410-95b6-bcf113ffbcfe
2010-12-17 21:16:43 +00:00