cascade/ipfs-cluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,576 Commits 3 Branches 70 Tags 15 MiB
524e2ecbc0
Commit Graph

2576 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hector Sanjuan
5bbc699bb4 Issue #340: Fix some data races 
Unfortunately, there are still some data races in yamux
https://github.com/libp2p/go-libp2p/issues/396 so we can't
enable this by default.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-15 12:27:01 +02:00
Hector Sanjuan
e86c2e6c59
Merge pull request #460 from ipfs/statelesstracker 
implements a stateless pintracker
 2018-08-15 11:04:38 +02:00
Hector Sanjuan
949abb25f0 Align stateless tracker with sharding 
Also: Fixes #500

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 20:51:01 +02:00
Hector Sanjuan
10fa7a13b5 Allow selecting pintracker with ipfs-cluster-service 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 19:57:14 +02:00
Hector Sanjuan
b8194143c2 Test with stateless tracker. Make map tracker default for tests. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 19:18:26 +02:00
Hector Sanjuan
95683ac8f0 Remove unreachable code 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 18:38:38 +02:00
Hector Sanjuan
584f532bb1 Fix tests after rebase to master 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 15:18:16 +02:00
Adrian Lanzafame
c6eada9db5 uses new gorpc method to distinguish err type 
License: MIT
Signed-off-by: Adrian Lanzafame <adrianlanzafame92@gmail.com>
 2018-08-14 13:34:02 +02:00
Adrian Lanzafame
33f56e8867 stateless: reduce num of methods 
License: MIT
Signed-off-by: Adrian Lanzafame <adrianlanzafame92@gmail.com>
 2018-08-14 13:33:39 +02:00
Adrian Lanzafame
bec77546ce optracker: fix complexity of filter fn 
License: MIT
Signed-off-by: Adrian Lanzafame <adrianlanzafame92@gmail.com>
 2018-08-14 13:33:39 +02:00
Adrian Lanzafame
df2753dfc6 implements a stateless pintracker 
Also updates to the optracker to make retrieving information easier.

License: MIT
Signed-off-by: Adrian Lanzafame <adrianlanzafame92@gmail.com>
 2018-08-14 13:33:36 +02:00
Hector Sanjuan
505794707d
Merge pull request #484 from ipfs/feat/sharding-v1 
Sharding: support adding content directly to IPFS Cluster
 2018-08-14 13:29:25 +02:00
Hector Sanjuan
df768b0b17 Align go-libp2p-kad-dht version 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 12:09:13 +02:00
Hector Sanjuan
1b8967aa46 Merge branch 'master' into feat/sharding-v1 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-14 11:40:03 +02:00
Hector Sanjuan
2675bf8040
Merge pull request #489 from ipfs/feat/dht 
Feat: Enable DHT-based peer discovery and routing for cluster peers
 2018-08-14 11:34:35 +02:00
Hector Sanjuan
9baffd3d4f
Merge pull request #498 from ipfs/fix/client-resolve-panic 
Feat/rest/client: auto-handling of libp2p endpoints
 2018-08-14 11:33:58 +02:00
Hector Sanjuan
f4455d3733 Address comments 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-13 11:56:16 +02:00
Hector Sanjuan
c1363f3ad9 rest/client: clarify comment about overriding ssl configs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-13 10:28:25 +02:00
Hector Sanjuan
522791df8d Feat/rest/client: auto-handling of libp2p endpoints 
This removes PeerAddr and uses APIAddr directly, figuring out if it is
a Peer multiaddress or not.

PeerAddr is actually kept for compatiblity.

It also fixes a bad panic when resolving returned 0 results

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 16:29:41 +02:00
Hector Sanjuan
f2dbd625a3 style 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:53:46 +02:00
Hector Sanjuan
bbf707d61e Fix allocations filter option 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:39:44 +02:00
Hector Sanjuan
7b826a5335 Dependency upgrades 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:39:34 +02:00
Hector Sanjuan
f707621a39 Allow to use adder only once 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 11:51:27 +02:00
Hector Sanjuan
3c80169174 dag -> dgs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 13:24:10 +02:00
Hector Sanjuan
50fc3c4e95 Address comments from review 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 13:22:47 +02:00
Hector Sanjuan
c2312cbb05 Fix: close files. Close test files. Clean properly. Fix windows tests. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 12:05:27 +02:00
Hector Sanjuan
26cbecca4c Fix tests 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 03:42:39 +02:00
Hector Sanjuan
031ff7183b Fix sharness 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 02:41:30 +02:00
Hector Sanjuan
78b8f47c14 Fix: Wrap-in-directory 
Usually we had wrap-in-directory enabled by default because otherwise
we had an error when adding single, non-directory files.

wrap-in-directory happens automatically when adding more than one file
so that was no problem. Thigns also worked when adding a folder and Wrap was
disabled. The only case was adding a single with wrap disabled (a default option).

This patches the ipfsadd/add.go file to remember the last added file so that
we can use it's Cid as the resulting root of the adding process without
having to fetch it from our dummy dagservice.

We have to pass this CID to our Finalize() functions, because it turns out that
in this case (single file without wrap-in-directory), the last block added to the DAG
is not the IPFS root (the ipfsadd/Adder adds the mfs root folder last always).

This was the case when wrap-in-directory was enabled by default.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 01:16:30 +02:00
Hector Sanjuan
e3834cf8ab Force-enable wrap-in-directory 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:43:20 +02:00
Hector Sanjuan
1228d1cfc6 Golint and improved error messages 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:29:21 +02:00
Hector Sanjuan
0151f5e312 Fixes for adding: set default timeouts to 0. Improve flags and param names. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:11:26 +02:00
Hector Sanjuan
0ed14a4b39 Adder: add context to add functions. Fix allocation everywhere. Helpers. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:10:42 +02:00
Hector Sanjuan
7460be32c4 Try more 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:47:47 +02:00
Hector Sanjuan
fc2d7beacc Try syncing test folders 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:31:40 +02:00
Hector Sanjuan
5bb4d1a4bc misc 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:24:33 +02:00
Hector Sanjuan
87f4fcf958 Make the adder modules ipld.DAGService modules. 
This removes a bunch of the channel dance and block forwarding
by having the adder submodules be DAGServices themselves and take
Add() directly from the ipfsAdder.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
e2e84dfad1 Remove some commented code. Addressing a couple of comments. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
585cc69eed Put add endpoint in /add 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
6ffc8b8347 Update metrics regularly after a few blockputs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
3575f05753 Support adding Output (api.AddedOutput) 
This was a long FIXME/TODO. Handling adding output and
reporting to the client of the progress of the adding process.

This attempts to do it. It is not sure that it works correctly
(response body being written while the multipart request is still being read)

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
7ef7a8d158 sync test files after creation 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
c81f61eeea Make sure sync and recover operations receive all cids in a clusterDAG. 
Cleanup some code and fixmes.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
8f1a15b279 Move adder.Params to api.AddParams. Re-use in other modules 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
7c08177d6f Address some comments from lanzafame 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
0893f69607 add fixme 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
16df90effc reduce complexity 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
aa5589d0d8 codeclimate 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
327a81b85a golint govets 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
6b9000fe7b Fix broken test 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00