cascade/ipfs-cluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,011 Commits 3 Branches 70 Tags 15 MiB
b9485626d1
Commit Graph

1011 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Hector Sanjuan
9baffd3d4f
Merge pull request #498 from ipfs/fix/client-resolve-panic 
Feat/rest/client: auto-handling of libp2p endpoints
 2018-08-14 11:33:58 +02:00
Hector Sanjuan
f4455d3733 Address comments 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-13 11:56:16 +02:00
Hector Sanjuan
c1363f3ad9 rest/client: clarify comment about overriding ssl configs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-13 10:28:25 +02:00
Hector Sanjuan
522791df8d Feat/rest/client: auto-handling of libp2p endpoints 
This removes PeerAddr and uses APIAddr directly, figuring out if it is
a Peer multiaddress or not.

PeerAddr is actually kept for compatiblity.

It also fixes a bad panic when resolving returned 0 results

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 16:29:41 +02:00
Hector Sanjuan
f2dbd625a3 style 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:53:46 +02:00
Hector Sanjuan
bbf707d61e Fix allocations filter option 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:39:44 +02:00
Hector Sanjuan
7b826a5335 Dependency upgrades 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 14:39:34 +02:00
Hector Sanjuan
f707621a39 Allow to use adder only once 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-10 11:51:27 +02:00
Hector Sanjuan
3c80169174 dag -> dgs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 13:24:10 +02:00
Hector Sanjuan
50fc3c4e95 Address comments from review 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 13:22:47 +02:00
Hector Sanjuan
c2312cbb05 Fix: close files. Close test files. Clean properly. Fix windows tests. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 12:05:27 +02:00
Hector Sanjuan
26cbecca4c Fix tests 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 03:42:39 +02:00
Hector Sanjuan
031ff7183b Fix sharness 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 02:41:30 +02:00
Hector Sanjuan
78b8f47c14 Fix: Wrap-in-directory 
Usually we had wrap-in-directory enabled by default because otherwise
we had an error when adding single, non-directory files.

wrap-in-directory happens automatically when adding more than one file
so that was no problem. Thigns also worked when adding a folder and Wrap was
disabled. The only case was adding a single with wrap disabled (a default option).

This patches the ipfsadd/add.go file to remember the last added file so that
we can use it's Cid as the resulting root of the adding process without
having to fetch it from our dummy dagservice.

We have to pass this CID to our Finalize() functions, because it turns out that
in this case (single file without wrap-in-directory), the last block added to the DAG
is not the IPFS root (the ipfsadd/Adder adds the mfs root folder last always).

This was the case when wrap-in-directory was enabled by default.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-09 01:16:30 +02:00
Hector Sanjuan
e3834cf8ab Force-enable wrap-in-directory 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:43:20 +02:00
Hector Sanjuan
1228d1cfc6 Golint and improved error messages 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:29:21 +02:00
Hector Sanjuan
0151f5e312 Fixes for adding: set default timeouts to 0. Improve flags and param names. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:11:26 +02:00
Hector Sanjuan
0ed14a4b39 Adder: add context to add functions. Fix allocation everywhere. Helpers. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-08 21:10:42 +02:00
Hector Sanjuan
7460be32c4 Try more 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:47:47 +02:00
Hector Sanjuan
fc2d7beacc Try syncing test folders 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:31:40 +02:00
Hector Sanjuan
5bb4d1a4bc misc 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:24:33 +02:00
Hector Sanjuan
87f4fcf958 Make the adder modules ipld.DAGService modules. 
This removes a bunch of the channel dance and block forwarding
by having the adder submodules be DAGServices themselves and take
Add() directly from the ipfsAdder.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
e2e84dfad1 Remove some commented code. Addressing a couple of comments. 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
585cc69eed Put add endpoint in /add 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
6ffc8b8347 Update metrics regularly after a few blockputs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
3575f05753 Support adding Output (api.AddedOutput) 
This was a long FIXME/TODO. Handling adding output and
reporting to the client of the progress of the adding process.

This attempts to do it. It is not sure that it works correctly
(response body being written while the multipart request is still being read)

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
7ef7a8d158 sync test files after creation 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
c81f61eeea Make sure sync and recover operations receive all cids in a clusterDAG. 
Cleanup some code and fixmes.

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
8f1a15b279 Move adder.Params to api.AddParams. Re-use in other modules 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
7c08177d6f Address some comments from lanzafame 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
0893f69607 add fixme 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
16df90effc reduce complexity 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
aa5589d0d8 codeclimate 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
327a81b85a golint govets 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
6b9000fe7b Fix broken test 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
623120fd50 Start cluster tests 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
65dc17a78b testfixing 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
db9070e0ca Fix api tests 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
2bfc8e7c2e Fix restapi tests 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
ffd36afbb6 fix a few TODOs and FIXMEs 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
f8ff9883b0 wip 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
9d89bda2a6 wip 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
a96241941e WIP 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Hector Sanjuan
68ec9316f7 Finish rebase of sharding branch. It builds! 
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
 2018-08-07 20:12:05 +02:00
Wyatt Daviau
463840bab3 more pin tests 
License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00
Wyatt Daviau
ecec7c24b0 new pin-test: sharded pins sharing a shard in cdag 
License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00
Wyatt Daviau
433928d3df addressing more feedback: 
validation of url params in restapi fileadd handler
use --only-hashes in sharness to simplify cid parse

License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00
Wyatt Daviau
1c91a99492 flag cleanup: 
silent flag removed for now
quiet flag renamed 'only-hashes' and implemented

License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00
Wyatt Daviau
1adc409aa7 refactor import_test 
License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00
Wyatt Daviau
82facd3629 fix for pinning same cid sharded and unsharded error 
License: MIT
Signed-off-by: Wyatt Daviau <wdaviau@cs.stanford.edu>
 2018-08-07 20:11:24 +02:00