cascade/ipfs-cluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
444 Commits 3 Branches 70 Tags 15 MiB
c0310ea995
Commit Graph

444 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hector Sanjuan
c0310ea995 Issue #219: Fix PeerAdd test 
ClusterPeers now contains ourselves.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-10 17:09:08 +01:00
Hector Sanjuan
d1473fd3be Issue #219: Fix waiting for save on shutdown 
Improve the logic

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-10 16:55:39 +01:00
Hector Sanjuan
01fc55550a Issue #219: make sure peers are saved after Join 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-10 16:22:31 +01:00
Hector Sanjuan
2a616aeddb Issue #219: Provide a list of peers and a list of addresses in the ID object. 
Fix cluster-ctl to show right number of peers

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-10 16:11:09 +01:00
Hector Sanjuan
289890ad6c Back to 6 testing peers 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-09 01:27:26 +01:00
Hector Sanjuan
b852dfa892 Fix #219: WIP: Remove duplicate peer accounting 
This change removes the duplicities of the PeerManager component:

* No more commiting PeerAdd and PeerRm log entries
* The Raft peer set is the source of truth
* Basic broadcasting is used to communicate peer multiaddresses
  in the cluster
* A peer can only be added in a healthy cluster
* A peer can be removed from any cluster which can still commit
* This also adds support for multiple multiaddresses per peer

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-08 20:04:04 +01:00
Hector Sanjuan
aced97cfa1
Merge pull request #199 from ipfs/feat/131-new-raft 
Fix #139: Update cluster to Raft 1.0.0
 2017-11-02 16:06:05 +01:00
Hector Sanjuan
bff1ec3635 Issue #131: rename addFromMultiaddrs to setFromMultiaddrs 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 19:38:46 +01:00
Hector Sanjuan
f64d3edb91 config: save 1 time per second at most. 
This prevents hammering and saving multiple times for example
when bootstrapping.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 14:42:23 +01:00
Hector Sanjuan
073c43e291 Issue #131: Make sure peers are moved to bootstrap when leaving 
Also, do not shutdown when seeing our own departure during bootstrap.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 13:58:57 +01:00
Hector Sanjuan
c912cfd205 Issue #131: Destroy raft data when the peer has been removed 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 13:25:28 +01:00
Hector Sanjuan
7a5f8f184b Issue #131: Improvements adding and removing 
This works on remove+shutdown procedure and fixes a few small
issues.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 13:00:32 +01:00
Hector Sanjuan
10c7afbd59 Raft: re-enable: do not start with unconsistent peers. 
Improved error messages

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
74ed634653 Raft: add cachestore for the log store 
Just like consul does it

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
107ad3bdfc Shutdown: do not save peers if we did not become ready 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
199dbb944a Raft/PeerRm: attempt more orderly peer removal 
Wait until FSM has applied the operation.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
7540e7b056 Leave on shutdown: only attempt when cluster reached ready state. 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
7df2277684 Consensus: only log pins committed on the leader. 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
09e9b05ed0 Peer add: do not print "new peer" info messages on boot 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
d21cc2b32f Issue #213: Always wait for configuration to be saved 
Even when cluster dies

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
18dbf1a93b Issue #131: Do not abort on bad peerset 
Print warning instead.

Shutdown raft on peerRm.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
b7ed9e5c25 Issue #131: Be more verbose when raft initialization fails 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
7bfb3c45d7 Issue #131: Remove some left-over logging 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
0980a5de70 Issue #131: Do not crash when shutting down after consensus start error 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
848023e381 Fix #139: Update cluster to Raft 1.0.0 
The main differences is that the new version of Raft is more strict
about starting raft peers which already contain configurations.

For a start, cluster will fail to start if the configured cluster
peers are different from the Raft peers. The user will have to
manually cleanup Raft (TODO: an ipfs-cluster-service command for it).

Additionally, this commit adds extra options to the consensus/raft
configuration section, adds tests and improves existing ones and
improves certain code sections.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-11-01 12:17:33 +01:00
Hector Sanjuan
71a37e8303
Merge pull request #217 from ipfs/fix/216-docker 
Fix #216: Docker does not like an env variable in CMD (anymore?)
 2017-10-31 11:55:51 +01:00
Hector Sanjuan
fb7be4137f Fix #216: Docker does not like an env variable in CMD (anymore?) 
This used to work. Even if it's been surfaced by 4a8759939 we were
extensively testing the Dockerfile before that release.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-31 11:46:32 +01:00
Hector Sanjuan
e51f771391
Merge pull request #214 from ipfs/fix/213-save 
Issue #213: Fix save in cluster component config
 2017-10-27 23:46:03 +02:00
Hector Sanjuan
746ce00d31 Issue #213: Peer addresses should never be a nil slice 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-27 22:11:14 +02:00
Hector Sanjuan
828236dcc0 Issue #213: Make sure we wait for configuration to be saved 
There might be a case where the program is terminated before
configuration is saved.

Also, avoid calling save() multiple times on shutdowns.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-27 21:44:02 +02:00
Hector Sanjuan
849581681a Issue #213: Fix save in cluster component config 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-27 20:22:14 +02:00
Hector Sanjuan
073848257a gx publish 0.2.1 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 17:01:22 +02:00
Hector Sanjuan
f5e5ed1e6e Release 0.2.1 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 17:01:04 +02:00
Hector Sanjuan
094f725605 Merge pull request #207 from ipfs/0.2.1/changelog 
0.2.1/changelog
 2017-10-26 17:00:52 +02:00
Hector Sanjuan
7ee9742feb Changelog for v0.2.1 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 16:48:12 +02:00
Hector Sanjuan
4c315bec9b Merge pull request #205 from ipfs/fix/202-32-bit 
Fix #202: Fix informers and allocators for 32-bit architectures
 2017-10-26 16:47:17 +02:00
Hector Sanjuan
b392d28884 Merge pull request #209 from ipfs/fix/208-repl-factor 
Fix #208: Set replication factor from loaded json
 2017-10-26 16:38:12 +02:00
Hector Sanjuan
64dfaa2efd Fix #208: Set replication factor from loaded json 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 16:14:19 +02:00
Hector Sanjuan
5831b251fe Issue #202: Fix mock informer 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 16:01:41 +02:00
Hector Sanjuan
5fb0753aed Issue #202: Make sure the ipfs mock repo/stat endpoint behaves like ipfs 
This should fix tests.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 16:01:41 +02:00
Hector Sanjuan
4ddf57cee4 Issue #202: Fix mock connector in tests to provide uint64s 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 16:01:41 +02:00
Hector Sanjuan
00e871ddec Fix #202: Fix informers and allocators for 32-bit architectures 2017-10-26 16:01:41 +02:00
Hector Sanjuan
3c48c35920 Merge pull request #204 from ipfs/fix/203-peers-ignored 
Fix #203: Assign peers and bootstrap when parsing the configuration
 2017-10-26 15:29:14 +02:00
Hector Sanjuan
289ac77cf6 Issue #203: Add test for the issue 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 13:56:31 +02:00
Hector Sanjuan
af091cc51b Fix #203: Assign peers and bootstrap when parsing the configuration 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-26 13:42:43 +02:00
Hector Sanjuan
f002dd10b2 Merge pull request #196 from ipfs/fix/194-same-binary 
Fix #194: Same binary in dockerfile
 2017-10-25 16:16:10 +02:00
Hector Sanjuan
7c42b1af13 Fix #194: Same binary in dockerfile 2017-10-25 16:15:45 +02:00
Hector Sanjuan
934714b0ba gx publish 0.2.0 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-23 19:40:45 +02:00
Hector Sanjuan
7c5f40babf Release 0.2.0 
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
 2017-10-23 19:39:37 +02:00
ZenGround0
98ce13dd73 Merge pull request #188 from ipfs/fix/dockerfile-again 
Dockerfile-test: Add bash to busybox
 2017-10-23 11:38:17 -04:00