Commit graph

536 commits

Author SHA1 Message Date
Scott Lystig Fritchie
7bafc1c28a WIP: stop for the night, we are broken 2015-04-30 23:16:08 +09:00
Scott Lystig Fritchie
99fd7e7fe1 Add test/machi_flu_psup_test.erl, small cleanups 2015-04-30 21:20:21 +09:00
Scott Lystig Fritchie
442e79e4f1 Add machi_flu_psup.erl to supervise all 3 FLU processes (see below)
Introduce machi_flu_psup:start_flu_package/4 as a way to start all
related FLU processes
    * The projection store
    * The chain manager
    * The FLU itself

... as well as linked processes.
http://www.snookles.com/scotttmp/flu-tree-20150430.png shows one FLU
running, "a".  The process registered "a" is the append server,
"some-prefix" for the sequencer & writer for the current <<"some-prefix">>
file, and a process each for 3 active TCP connections to that FLU.
2015-04-30 19:15:27 +09:00
Scott Lystig Fritchie
9249663ff6 TODO updates for machi_flu1.erl based on doc rewriting work 2015-04-30 15:15:43 +09:00
Scott Lystig Fritchie
509d33e481 Merge branch 'doc/machi-high-level-design-port' (work-in-progress) 2015-04-24 19:59:37 +09:00
Scott Lystig Fritchie
6773915793 WIP: name-game-sketch.org and file migration 2015-04-24 16:59:44 +09:00
Scott Lystig Fritchie
c0a7a8fb57 WIP: name-game-sketch.org and file migration 2015-04-24 16:34:16 +09:00
Scott Lystig Fritchie
8154c07b91 WIP: name-game-sketch.org 2015-04-23 22:32:41 +09:00
Scott Lystig Fritchie
1019c659d5 WIP: name-game-sketch.org 2015-04-23 22:26:34 +09:00
Scott Lystig Fritchie
1f82704ef8 WIP: name-game-sketch.org 2015-04-23 18:55:05 +09:00
Scott Lystig Fritchie
e2d486d347 Working on new name-game-sketch.org 2015-04-23 17:13:13 +09:00
Scott Lystig Fritchie
4c784613a1 Bring chain-self-management-sketch.org into sync with high-level-chain-mgr.tex 2015-04-23 12:56:14 +09:00
Scott Lystig Fritchie
9c58a635f1 Draft 0.5 is now complete, I think, hooray! 2015-04-22 23:06:46 +09:00
Scott Lystig Fritchie
fa89b03d21 WIP: remove lots of orphaned text, continue attacking TODO items 2015-04-22 22:52:55 +09:00
Scott Lystig Fritchie
f7fa2704ee WIP: finishing first draft of inner projection description 2015-04-22 22:50:00 +09:00
Scott Lystig Fritchie
86581ee41b Oops, forgot to add chain-self-management-sketch.Diagram1.eps 2015-04-22 21:40:09 +09:00
Scott Lystig Fritchie
81bf3f3aff WIP: moo 2015-04-22 21:33:23 +09:00
Scott Lystig Fritchie
1b66312d7f WIP: finishing first draft of inner projection description 2015-04-22 21:32:26 +09:00
Scott Lystig Fritchie
088bc1c502 WIP: more restructuring (yay) 2015-04-22 19:26:28 +09:00
Scott Lystig Fritchie
7a89d8daeb WIP: more restructuring (yay) 2015-04-22 13:00:17 +09:00
Scott Lystig Fritchie
776f5ee9b3 WIP: more restructuring (yay) 2015-04-21 22:07:32 +09:00
Scott Lystig Fritchie
fea229d698 WIP: more restructuring 2015-04-21 18:26:33 +09:00
Scott Lystig Fritchie
b238eb4673 Merge branch 'master' of github.com:basho/machi 2015-04-20 21:26:34 +09:00
Scott Lystig Fritchie
f3ea2f7ab4 Oops, add doc/ level copy of high-level-machi.pdf 2015-04-20 21:26:04 +09:00
Scott Lystig Fritchie
e1a6c3678e Merge branch 'doc/machi-high-level-design-port' (unfinished/partial merge) 2015-04-20 21:21:22 +09:00
Scott Lystig Fritchie
3c70fff003 WIP: more restructuring 2015-04-20 21:21:11 +09:00
Scott Lystig Fritchie
cd6282b76d WIP: more restructuring 2015-04-20 21:09:25 +09:00
Scott Lystig Fritchie
9ab104933e WIP: more restructuring 2015-04-20 20:32:20 +09:00
Scott Lystig Fritchie
8481e23214 WIP: more restructuring 2015-04-20 20:30:26 +09:00
Scott Lystig Fritchie
cc6988ead6 WIP: more restructuring 2015-04-20 18:38:32 +09:00
Scott Lystig Fritchie
36ce2c75bd WIP: more restructuring 2015-04-20 17:27:16 +09:00
Scott Lystig Fritchie
7badb93f9a WIP: more restructuring 2015-04-20 17:16:04 +09:00
Scott Lystig Fritchie
d90d11ae7d Cut out "The safety of epoch transitions" section (commentary follows)
I don't want to cut this section, because the points that it makes are
important ... but those points aren't a good fit for the purposes of this
document.  If someone needs some examples of why badly managed chain
replication can lose data, this is the section to look in.  ^_^
2015-04-20 16:54:55 +09:00
Scott Lystig Fritchie
451d7d458c WIP: more restructuring 2015-04-20 16:54:00 +09:00
Scott Lystig Fritchie
ed6c54c0d5 WIP: integration of chain-self-management-sketch.org into high-level-chain-mgr.tex 2015-04-20 15:56:53 +09:00
Scott Lystig Fritchie
3a0fbb7e7c Add the 1st draft of high-level-machi.pdf 2015-04-20 12:54:05 +09:00
Scott Lystig Fritchie
60dfff0c86 Type up Friday's edits 2015-04-20 12:46:39 +09:00
Scott Lystig Fritchie
55492c1cac Update on the status of prototype/chain-manager code: now moved to TOP/src on 2015-04-18 01:42:47 +09:00
Scott Lystig Fritchie
8c85f925ab Merge branch 'master' of github.com:basho/machi 2015-04-18 01:07:17 +09:00
Scott Lystig Fritchie
ed5a4e0423 Merge branch 'slf/otp-refactoring-step3' 2015-04-18 01:05:38 +09:00
Scott Lystig Fritchie
62d3dadf98 Doc split to high-level-chain-mgr.tex finished
All of the major surgery required to move Chain Manager design & discussion
details out of the high-level-machi.tex document are complete.  I've done
only a very small amount of work on the original high-level-machi.tex to
fix document flow problems.

There's probably a good way to have LaTeX automatically manage the
mutual references between the now-split documents, but I didn't know about,
sorry.
2015-04-17 16:39:38 +09:00
Scott Lystig Fritchie
70f3c02644 Base high level design doc, prior to splitting
Major changes, when compared to the original Basho-internal document:

* Start removing strong consistency topics to a separate doc (unfinished)
* Remove section on per-file metadata management: it was too speculative IMHO
* Remove the following sections (numbering is relative to v3 of internal doc):
  7.2.1 scenario 1, 13.3, 14
* Move the "Recommended Reading" section to the end
2015-04-17 16:38:35 +09:00
Scott Lystig Fritchie
dec70c5bd9 Attempt to add correct orgmode link to chain-self-management-sketch.Diagram1.pdf 2015-04-16 10:23:44 +09:00
Scott Lystig Fritchie
cf01f0afd2 Attempt to add correct orgmode link to chain-self-management-sketch.Diagram1.pdf 2015-04-16 10:22:34 +09:00
Scott Lystig Fritchie
02bc7fe0bc WIP: Fix bug that flaps inside an inner projection, oops! 2015-04-14 18:23:00 +09:00
Scott Lystig Fritchie
90df655256 WIP: Ha! There's a bug, this verbose logging change made it easier to see 2015-04-14 16:38:19 +09:00
Scott Lystig Fritchie
9e587b3d11 WIP: crufty TODO & comment cleanup 2015-04-14 16:17:49 +09:00
Scott Lystig Fritchie
59936eda62 WIP: By Jove, I believe the chain manager is working 2015-04-14 15:30:24 +09:00
Scott Lystig Fritchie
09051aecce WIP: experiments for transitioning out of inner/nested projection state 2015-04-14 00:54:38 +09:00
Scott Lystig Fritchie
7eead876c8 Merge branch 'slf/otp-refactoring-step2' (more commentary follows)
It's Friday, so this is an end-of-week merge.  This week has focused
on the chain manager.   I ended up doing more refactoring than I'd
expected in order to lift it out of it's "one node, talk to everything
by distributed Erlang, run inside a not-quite-PULSE-but-still-quite-
restricted simulator" and into some OTP sunlight + communicate by
generic point-to-point TCP connections (same ASCII protocol as
demo day, no change there) + capable of running without all of the
simulator control.

I'm happy to say that it appears to work as well as it does inside
of the simulator.  Having said that, the branch of experimental
work that I chose to integrate has some problems making transitions
when asymmetric network splits happen.  But those appear fixable.
Next week.  ^_^
2015-04-10 22:54:32 +09:00