cascade/ipfs-cluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
a53861c844
ipfs-cluster/sharness/t0052-service-state-export.sh

38 lines
1.0 KiB
Bash
Raw Normal View History

Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
#!/bin/bash
test_description="Test service state export"
. lib/test-lib.sh
test_ipfs_init
Service: Select consensus on "init" (not on "daemon") Fixes #865. This makes the necessary changes so that consensu is selected on "init" with a flag set, by default, to "crdt". This generates only a "crdt" or a "raft" section, not both. If the configuration file has a "raft" section, "raft" will be used to start the daemon. If it has a "crdt" section, "crdt" will be used. If it has none or both sections, an error will happen. This also affects "state *" commands, which will now autoselect how to work from the existing configuration.
2019-08-09 14:00:55 +00:00
test_cluster_init "" crdt
Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
Sharness: run state import/export with both crdt and raft
2019-07-30 11:48:48 +00:00
test_expect_success IPFS,CLUSTER,JQ "state export saves the correct state to expected file (crdt)" '
cid=`docker exec ipfs sh -c "echo test_52-1 | ipfs add -q"` &&
Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
ipfs-cluster-ctl pin add "$cid" &&
sleep 5 &&
cluster_kill && sleep 5 &&
Service: Select consensus on "init" (not on "daemon") Fixes #865. This makes the necessary changes so that consensu is selected on "init" with a flag set, by default, to "crdt". This generates only a "crdt" or a "raft" section, not both. If the configuration file has a "raft" section, "raft" will be used to start the daemon. If it has a "crdt" section, "crdt" will be used. If it has none or both sections, an error will happen. This also affects "state *" commands, which will now autoselect how to work from the existing configuration.
2019-08-09 14:00:55 +00:00
ipfs-cluster-service --debug --config "test-config" state export -f export.json &&
Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
[ -f export.json ] &&
Consensus: add new "crdt" consensus component This adds a new "crdt" consensus component using go-ds-crdt. This implies several refactors to fully make cluster consensus-component independent: * Delete mapstate and fully adopt dsstate (after people have migrated). * Return errors from state methods rather than ignoring them. * Add a new "datastore" modules so that we can configure datastores in the main configuration like other components. * Let the consensus components fully define the "state.State". Thus, they do not receive the state, they receive the storage where we put the state (a go-datastore). * Allow to customize how the monitor component obtains Peers() (the current peerset), including avoiding using the current peerset. At the moment the crdt consensus uses the monitoring component to define the current peerset. Therefore the monitor component cannot rely on the consensus component to produce a peerset. * Re-factor/re-implementation of "ipfs-cluster-service state" operations. Includes the dissapearance of the "migrate" one. The CRDT consensus component defines creates a crdt-datastore (with ipfs-lite) and uses it to intitialize a dssate. Thus the crdt-store is elegantly wrapped. Any modifications to the state get automatically replicated to other peers. We store all the CRDT DAG blocks in the local datastore. The consensus components only expose a ReadOnly state, as any modifications to the shared state should happen through them. DHT and PubSub facilities must now be created outside of Cluster and passed in so they can be re-used by different components.
2019-02-20 14:24:25 +00:00
jq -r ".cid | .[\"/\"]" export.json | grep -q "$cid"
Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
'
Sharness: run state import/export with both crdt and raft
2019-07-30 11:48:48 +00:00
cluster_kill
Service: Select consensus on "init" (not on "daemon") Fixes #865. This makes the necessary changes so that consensu is selected on "init" with a flag set, by default, to "crdt". This generates only a "crdt" or a "raft" section, not both. If the configuration file has a "raft" section, "raft" will be used to start the daemon. If it has a "crdt" section, "crdt" will be used. If it has none or both sections, an error will happen. This also affects "state *" commands, which will now autoselect how to work from the existing configuration.
2019-08-09 14:00:55 +00:00
sleep 5
test_cluster_init "" raft
Sharness: run state import/export with both crdt and raft
2019-07-30 11:48:48 +00:00
test_expect_success IPFS,CLUSTER,JQ "state export saves the correct state to expected file (raft)" '
cid=`docker exec ipfs sh -c "echo test_52-2 | ipfs add -q"` &&
ipfs-cluster-ctl pin add "$cid" &&
sleep 5 &&
cluster_kill && sleep 5 &&
Service: Select consensus on "init" (not on "daemon") Fixes #865. This makes the necessary changes so that consensu is selected on "init" with a flag set, by default, to "crdt". This generates only a "crdt" or a "raft" section, not both. If the configuration file has a "raft" section, "raft" will be used to start the daemon. If it has a "crdt" section, "crdt" will be used. If it has none or both sections, an error will happen. This also affects "state *" commands, which will now autoselect how to work from the existing configuration.
2019-08-09 14:00:55 +00:00
ipfs-cluster-service --debug --config "test-config" state export -f export.json &&
Sharness: run state import/export with both crdt and raft
2019-07-30 11:48:48 +00:00
[ -f export.json ] &&
jq -r ".cid | .[\"/\"]" export.json | grep -q "$cid"
'
Sharness hardening: Better error messages in test-lib init functions and ipfshttp Cleanup functions are now called after every test file License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2018-01-09 19:17:21 +00:00
test_clean_ipfs
test_clean_cluster
Add and refine cli interface for cluster state Added import, export, cleanup. Changed state interface. New sharness tests. License: MIT Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
2017-12-19 17:05:32 +00:00
test_done
Reference in New Issue Copy Permalink