UENISHI Kota
e882f774ef
Unify LevelDB usage to single instance
...
* Perfile LevelDB instance usage are changed to use single instance
per FLU server.
* machi_csum_file reference is managed with machi_flu_filename_mgr
as an aim to manage filenames with leveldb
* Not only chunk checksums, but the list of trimmed files are also
stored in LevelDB.
* Remove 1024 bytes file header; instead put any metadata into
LevelDB if needed.
* LevelDB `db_ref()` lifecycle is same as that of `machi_metadata_mgr`
* `machi_file_proxy` just uses it as it's passed at process startup
* There are several optimization space still left as it is
WIP
2016-02-09 13:36:25 +09:00
Scott Lystig Fritchie
546901ef49
Dialyzer warning cleanup
2015-12-18 17:48:33 +09:00
Scott Lystig Fritchie
de5d5e88dd
Do not use 18.x for TravisCI testing
2015-12-18 17:40:16 +09:00
Scott Lystig Fritchie
70d42a3fb5
Merge pull request #55 from basho/ss/flu1-factorization2
...
Ss/flu1 factorization2
2015-12-18 17:19:17 +09:00
Scott Lystig Fritchie
7d262fd3ec
Move update_wedge_state() & wedge_myself() to machi_flu1_append_server.erl
2015-12-18 16:56:01 +09:00
Shunichi Shinohara
b8297afc18
Reduce count of accepror processes 100 -> 10
2015-12-18 16:30:35 +09:00
Scott Lystig Fritchie
c49ccafdc6
Merge slf/flu-config-rcd-style
2015-12-18 15:41:02 +09:00
Scott Lystig Fritchie
d602663060
Ignore RUNLOG*
2015-12-18 13:43:18 +09:00
Scott Lystig Fritchie
0922def0d6
s/verb/term/gi
2015-12-18 11:50:15 +09:00
Scott Lystig Fritchie
bb0e67f6e0
Add doc/flu-and-chain-lifecycle.org
2015-12-17 21:33:30 +09:00
Scott Lystig Fritchie
51a05ba770
Fix dialyzer complaints in machi_lifecycle_mgr.erl
2015-12-17 12:44:10 +09:00
Scott Lystig Fritchie
1d1bfadb96
Corrections from review
2015-12-17 12:31:32 +09:00
Scott Lystig Fritchie
f98b4da45b
Add 'quick admin' config management: better file handling
2015-12-16 19:05:25 +09:00
Shunichi Shinohara
dffb73330d
Dialyzer and eunit fix
2015-12-16 17:56:17 +09:00
Shunichi Shinohara
3a0086afb2
Change listen port to avoid eaddrinuse on Linux
2015-12-16 17:38:28 +09:00
Shunichi Shinohara
dcb2464cb8
Separate append server as gen_server callback module
2015-12-16 17:33:53 +09:00
Scott Lystig Fritchie
463d20a9fd
Add 'quick admin' config management tool/hack
2015-12-16 16:41:11 +09:00
Scott Lystig Fritchie
b8b3e872e4
Merge pull request #54 from basho/slf/doc-201512-update
...
Doc update, including mid-December 2015 status
2015-12-16 11:15:09 +09:00
Scott Lystig Fritchie
9bd885ccb4
Part 3 of X
2015-12-15 16:20:57 +09:00
Scott Lystig Fritchie
ec56164bd1
Part 2 of X
2015-12-15 15:52:29 +09:00
Scott Lystig Fritchie
e5f7f3ba9a
Remove doc/overview.edoc
2015-12-15 15:07:18 +09:00
Scott Lystig Fritchie
d196dbcee5
MD fixup
2015-12-14 19:21:20 +09:00
Scott Lystig Fritchie
e4a784d3dd
Part 1 of X
2015-12-14 19:19:07 +09:00
Scott Lystig Fritchie
6f077fbb62
New machi_lifecycle_mgr_test, AST spec -> running FLUs & chains works!
2015-12-11 19:07:00 +09:00
Scott Lystig Fritchie
e55115fdba
All EUnit tests in machi_lifecycle_mgr_test pass!
2015-12-11 17:28:27 +09:00
Scott Lystig Fritchie
009bad230f
WIP: change internal types for most strings -> atom to match chmgr internal use
2015-12-11 16:36:18 +09:00
Scott Lystig Fritchie
6b7d871ada
WIP: diff in progress 2
2015-12-11 16:26:13 +09:00
Scott Lystig Fritchie
1db232db1b
WIP: diff in progress
2015-12-11 15:33:31 +09:00
Scott Lystig Fritchie
3826af8ee2
WIP: dict -> gb_trees, 2 of 2
2015-12-11 13:17:33 +09:00
Scott Lystig Fritchie
df8eea8c10
WIP: dict -> gb_trees, 1 of 2
2015-12-11 12:54:54 +09:00
Scott Lystig Fritchie
61eae1300f
WIP: finish basic 'run', add negative tests
2015-12-11 12:43:38 +09:00
Shunichi Shinohara
436c308db2
Merge pull request #46 from basho/ss/flu1-factorization1-ranch
...
FLU1 Factorization 1/N: Introduce ranch and factor out socket handling process
2015-12-11 10:16:10 +09:00
Scott Lystig Fritchie
3ee3de1aaf
WIP: end of day
2015-12-10 23:44:27 +09:00
Scott Lystig Fritchie
6a5c590ad1
WIP: AST change {chain,...} thingie
2015-12-10 23:05:08 +09:00
Scott Lystig Fritchie
c37f23d97a
WIP: 'Run' AST thingie ha, take that, wheel!
2015-12-10 22:53:17 +09:00
Scott Lystig Fritchie
9cec53eea6
Yet another strawman AST
2015-12-10 19:18:25 +09:00
Shunichi Shinohara
eef00e4f8f
Add TODO comment for possible race condition
2015-12-10 15:58:17 +09:00
Scott Lystig Fritchie
9472bad37b
Clean up test errors
2015-12-10 15:57:35 +09:00
Scott Lystig Fritchie
cb706f0d23
Add test/machi_lifecycle_mgr_test.erl
2015-12-10 15:20:56 +09:00
Scott Lystig Fritchie
61ef7739cd
Modify chain mostly works, better
2015-12-10 00:12:34 +09:00
Scott Lystig Fritchie
b0a9e65ca2
WIP: trying to shut down entire chain, but buggy, derp
2015-12-09 23:00:27 +09:00
Scott Lystig Fritchie
95e2df304e
WIP: minor cleanup
2015-12-09 22:25:43 +09:00
Scott Lystig Fritchie
7f25fcc8f8
Modify chain mostly works
2015-12-09 19:02:16 +09:00
Scott Lystig Fritchie
cd9bf9eeab
Modify chain mostly works, 2 TODOs remain
2015-12-09 18:17:26 +09:00
Shunichi Shinohara
2e2d282afc
Use outside of ephemeral port range to listen on
...
When there is TCP_WAIT connection whose local part has
port to be listened, listen (bind) will fail by eaddrinuse
_on Linux_ (won't on Mac OS X).
This commit also adds some logs and pattern matches.
Reference
- Ephemeral port - Wikipedia, the free encyclopedia
https://en.wikipedia.org/wiki/Ephemeral_port
"Many Linux kernels use the port range 32768 to 61000.[note 2]
FreeBSD has used the IANA port range since release 4.6. Previous
versions, including the Berkeley Software Distribution (BSD), use
ports 1024 to 5000 as ephemeral ports.[2]"
- Demostration of collision between already-closed ephemeral port
and listen port on Linux (Mac OS X allows)
https://gist.github.com/shino/36ae1e01608366d52236
2015-12-09 18:04:50 +09:00
Scott Lystig Fritchie
2871f8397c
WIP: modify chain still a bit broken
2015-12-09 17:19:02 +09:00
Scott Lystig Fritchie
65eec61f82
Basic stuff to add new flus via 'pending' dir
2015-12-09 14:48:46 +09:00
Scott Lystig Fritchie
7301c8308e
Clarify the initial docs, thanks @mrallen1!
2015-12-09 14:07:27 +09:00
Scott Lystig Fritchie
b243a9b863
Avoid TCP port # reuse in machi_flu_psup_test tests
2015-12-09 12:29:59 +09:00
Scott Lystig Fritchie
f23e500993
WIP comments
2015-12-09 11:32:05 +09:00