cascade/ipfs-cluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,734 Commits 3 Branches 70 Tags 15 MiB
96752e4e58
Commit Graph

1734 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hector Sanjuan
96752e4e58 Fix: handling allocations 
* pin() should not allocate if allocations are already provided
* pin() should not skip pinning if the exact same pin exists
  * Additionally this was unreliable as it allocated it before
    so the pin may have existed but the allocations may have been
    artificially changed.
* pin() re-uses existing pin when pin options are the same and thus
  avoids changing the allocations of a pin.

As a side effect, this fixes re-allocations which were broken: peers
called `shouldPeerRepinCid()` and instead of repinning that single
cid proceeded to repin the full state. For every pin.

Additionally tests have been adapted. It may be that some re-alloc tests
were very unreliable for the problems above.
 2019-09-06 17:56:00 +02:00
Hector Sanjuan
d9a5e17974
Merge pull request #892 from ipfs/fix/sharness 
Use the updated sharness library
 2019-09-06 15:11:23 +02:00
Hector Sanjuan
c2b28be6de
Merge pull request #901 from ipfs/fix/pin-queue-full 
Error queue is full
 2019-09-06 15:05:53 +02:00
Hector Sanjuan
f45c8544a7
Merge pull request #890 from ipfs/feat/allocations-for-add 
Added UserAllocations support for `add`
 2019-09-06 15:03:22 +02:00
Hector Sanjuan
d63a7fd641
Merge pull request #877 from ipfs/fix/ipfs-to-p2p 
Use `p2p` protocol name over `ipfs` for multiaddr
 2019-09-06 15:00:36 +02:00
Kishan Mohanbhai Sagathiya
ea7093aa73 BlockAllocate should respect user allocations 2019-08-31 16:24:20 +05:30
Hector Sanjuan
ef8483e30e
Merge pull request #906 from ipfs/fix/crdt-mass-import 
Fix/crdt mass import
 2019-08-29 17:32:25 +02:00
Hector Sanjuan
b247783dd8 Badger: Do not compact L0 on close by default 
If this goes wrong probably database goes to hell. We want to stop
the daemon as quickly as possible.
 2019-08-28 12:09:31 +02:00
Hector Sanjuan
a399d893b7 Remove mdns debug logging 
Leftover
 2019-08-28 12:09:04 +02:00
Hector Sanjuan
1b91303fe0 Do not allocate an unused item for the trackedPinsMap 2019-08-28 12:08:41 +02:00
Hector Sanjuan
bab0485616 Update go-ds-crdt 2019-08-28 12:07:47 +02:00
Hector Sanjuan
a958d81371
Merge pull request #905 from ipfs/fix/trust-all 
Fix: trust-all remained enabled always
 2019-08-28 09:31:46 +02:00
Hector Sanjuan
8ca0f5781c Fix: trust-all remained enabled always 2019-08-27 19:18:50 +02:00
Hector Sanjuan
1cfea47696
Release 0.11.0-rc8 2019-08-27 12:55:41 +02:00
Hector Sanjuan
95682d9b62
Merge pull request #904 from ipfs/update/go-ds-crdt 
Update go-ds-crdt
 2019-08-27 12:54:39 +02:00
Hector Sanjuan
c030dd7c8c Update go-ds-crdt 2019-08-27 11:49:24 +02:00
Kishan Mohanbhai Sagathiya
7cb13cb97d Abort on any error 2019-08-27 09:38:41 +05:30
Hector Sanjuan
46cd5327fa
Release 0.11.0-rc7 2019-08-26 14:58:49 +02:00
Hector Sanjuan
397e538bf0 Do not error when not unpinning something and unpin is disabled 2019-08-26 14:56:19 +02:00
Hector Sanjuan
5d888f7390
Merge pull request #900 from ipfs/feat/mdns-properly 
mDNS: attach mDNS inside the Cluster. Allow interval configuration.
 2019-08-26 13:14:45 +02:00
Hector Sanjuan
d71c1cb380
Merge pull request #899 from ipfs/feat/trust-all-warning 
crdt: inform about trust all mode
 2019-08-26 12:23:23 +02:00
Hector Sanjuan
df7621ba6e crdt: inform about trust all mode 2019-08-26 12:22:44 +02:00
Kishan Mohanbhai Sagathiya
2d9e6c1de8 Error queue is full 
- abort if a Track() calls fails due to queue being full
- increase max pin queue size to 1 million
- hind max_pin_queue_size from configuration
- use an elaborated error message

Fixes #377
 2019-08-26 13:23:02 +05:30
Hector Sanjuan
33f111c44d mDNS: attach mDNS inside the Cluster. Allow interval configuration. 
Setting up mDNS outside the Cluster is dirtier and allows less configuration.

This adds MDNSInterval to the cluster config options and allow disabling it
when the option is set to 0.
 2019-08-24 17:24:18 +02:00
Hector Sanjuan
9c73c2bdbd
Merge pull request #887 from ipfs/fix/small-issues 
Fixes for some small issues
 2019-08-24 14:24:38 +02:00
Hector Sanjuan
ad32ae02f1
Merge pull request #886 from ipfs/fix/pstore-panic 
Fix: peerstore reading panics on empty lines
 2019-08-24 14:23:45 +02:00
Hector Sanjuan
db008aa9f0
Merge pull request #885 from ipfs/update/deps3 
Update go-ds-crdt
 2019-08-24 14:23:18 +02:00
Hector Sanjuan
fea27ef340
Merge pull request #879 from ipfs/fix/api-improvements 
Make sure all API errors are in JSON
 2019-08-24 14:19:32 +02:00
Hector Sanjuan
aab5f9bd0b Enable p2p addresses in a single place 2019-08-23 22:45:32 +02:00
Kishan Mohanbhai Sagathiya
05a4661145 Use the updated sharness library 2019-08-19 16:49:27 +05:30
Kishan Mohanbhai Sagathiya
6bd897ac47 Added UserAllocations support for add 2019-08-16 18:13:06 +05:30
Kishan Mohanbhai Sagathiya
6656b80a00 Some more occurences of /ipfs 
and use  SwapToP2pMultiaddrs (very helpful since ipfs still send
addresses with `/ipfs` tag)
 2019-08-16 11:56:09 +05:30
Kishan Sagathiya
edd5e33a1b
Update api/rest/restapi.go 2019-08-14 19:49:15 +05:30
Hector Sanjuan
62b7054d31 Fix: pintrackers: Do not spam the logs when running recover 
Currently logs every pin we call recover with. We call recover regularly.
So it will print all pins.
 2019-08-14 14:10:44 +02:00
Hector Sanjuan
5e4c8d9418 Ctl: increase host-name spacing in status output 
Allow for slightly longer hostnames
 2019-08-14 14:10:11 +02:00
Hector Sanjuan
6743f92e51 Fix: do not set PinUpdate when cid is Undef 
It gets set to 'b' and then prints an error when parsing.
 2019-08-14 14:09:46 +02:00
Hector Sanjuan
406e8b5954 Update unixfs and reprovide too 2019-08-14 13:48:03 +02:00
Hector Sanjuan
ce2457a7aa Fix: peerstore reading panics on empty lines 2019-08-14 13:44:26 +02:00
Hector Sanjuan
08f5f9f62a Update go-ds-crdt 
I could not sleep last night and my mind randomly discovered that go-ds-crdt
had a small problem which is now partially addressed.
 2019-08-14 10:57:46 +02:00
Kishan Mohanbhai Sagathiya
229953f943 Merge branch 'master' of github.com:ipfs/ipfs-cluster into fix/api-improvements 2019-08-14 09:05:56 +05:30
Hector Sanjuan
dc2e73dfc2
Release 0.11.0-rc6 2019-08-13 20:25:53 +02:00
Hector Sanjuan
216d288b65
Merge pull request #884 from ipfs/fix/883-testadd 
Fix #883: Tweak timeouts for better tests
 2019-08-13 20:24:09 +02:00
Hector Sanjuan
28ae394fa9 Fix #883: Tweak timeouts for better tests 2019-08-13 19:44:48 +02:00
Hector Sanjuan
ea977d43aa
Merge pull request #882 from ipfs/fix/docker-crdt 
Improve Docker support for CRDTs
 2019-08-13 19:44:04 +02:00
Hector Sanjuan
4556cbe726 Docker: improve for CRDTs 
This:

  * Allows choosing the consensus for the automatic "init" on Docker with
  IPFS_CLUSTER_CONSENSUS.

  * Removes IPFS_PATH and the sed replacements for 0.0.0.0 on RestAPI and
  Ipfsproxy endpoints because these are easily supported by setting env vars
  correctly and pose some security risk when running with net=host.

  * Brings up to date Dockerfile-test and Dockerfile-bundle, even if mostly
  unused.
 2019-08-13 19:32:38 +02:00
Hector Sanjuan
bd6d01b32e Docker-compose: simplify, use CRDTs and mDNS 
This makes the docker-compose.yml a way to get a test-example cluster up and
running. Since mDNS works now, cluster peers can auto-discover in the docker
network and do not need a command override to bootstrap.

More docs have been added to the top to make sure users use it to get up and
running with a test-cluster. Unnecessary port-exposures have been
removed. Cluster options have been set in a more canonical way using env vars.
 2019-08-13 19:32:38 +02:00
Hector Sanjuan
dc3170b1d2 cluster: add mDNS service discovery 
I always thought the libp2p node would do this, but it is not the case.
With this, CRDT peers are able to autodiscover on local networks.
 2019-08-13 19:32:38 +02:00
Kishan Mohanbhai Sagathiya
06729def89 Use router.NotFoundHandler instead 2019-08-13 22:55:43 +05:30
Hector Sanjuan
912740e2f7
Merge pull request #871 from ipfs/issue_852 
Improve error handling on `add`
 2019-08-13 19:16:50 +02:00
Kishan Mohanbhai Sagathiya
935c824b33 Merge branch 'master' of github.com:ipfs/ipfs-cluster into fix/api-improvements 2019-08-13 22:34:51 +05:30