Hector Sanjuan
072f0bc722
Feat: support adding CAR files
...
This commit adds a new add option: "format".
This option specifies how IPFS Cluster is expected to build the DAG when
adding content. By default, it takes a "unixfs", which chunks and DAG-ifies as
it did before, resulting in a UnixFSv1 DAG.
Alternatively, it can be set to "car". In this case, Cluster will directly
read blocks from the CAR file and add them.
Adding CAR files or doing normal processing is independent from letting
cluster do sharding or not. If sharding is ever enabled, Cluster could
potentially shard a large CAR file among peers.
Currently, importing CAR files is limited to a single CAR file with a single
root (the one that is pinned). Future iterations may support multiple CARs
and/or multiple roots by transparently wrapping them.
2021-04-21 13:55:06 +02:00
Hector Sanjuan
717ed85823
gofmt -s fixes
2020-04-14 23:44:18 +02:00
Hector Sanjuan
2c47585870
Handle wrapping outside the ipfs adder
...
The ipfs adder does not wrap anymore.
2019-10-01 12:19:22 +02:00
Kishan Mohanbhai Sagathiya
70e429f925
Fix #852 : Improve error handling on add
...
Keep sending blocks while adding as long as one destination works.
2019-08-13 16:06:20 +02:00
Hector Sanjuan
ea85cf7805
Rename "test.Test*" to "test.*" (test.TestCid1 -> test.Cid1)
...
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2019-02-27 20:19:10 +00:00
Hector Sanjuan
9df6344a07
Avoid using string testing CIDs and use cid.Cids directly
...
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2019-02-27 20:09:31 +00:00
Hector Sanjuan
ced9f2f7f1
Update to go-ipfs-files 2.0.3
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-12-17 14:29:44 +01:00
Hector Sanjuan
15413edbc6
Unrewrite deps
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-12-17 14:16:38 +01:00
Łukasz Magiera
406d2b53f8
files2.0: Close subfiles in adder
...
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-12-17 14:16:38 +01:00
Łukasz Magiera
9b0ff603b8
files2.0: use type helpers
...
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-12-17 14:16:38 +01:00
Łukasz Magiera
c6944e4376
files2.0: update for no errors from NewMultiFileReader
...
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-12-17 14:16:38 +01:00
Łukasz Magiera
d0678aad6e
files2.0: fix ContextCancelled test
...
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-12-17 14:16:38 +01:00
Łukasz Magiera
00df384e1c
go-ipfs-files 2.0 updates
...
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-12-17 14:16:38 +01:00
Hector Sanjuan
b86f3cedb4
Files package has been extracted from cmdkit
...
Related: https://github.com/ipfs/go-ipfs-cmdkit/pull/31
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-10-24 01:28:05 +02:00
Hector Sanjuan
b2914c2516
Fix #495 : Hijack proxy /add correctly.
...
No more hacks around /add. This uses the local adder when hijacking /add.
It supports the parameters and works pretty well with the ipfs CLI, showing
progress and everything.
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-18 02:48:35 +02:00
Hector Sanjuan
c2312cbb05
Fix: close files. Close test files. Clean properly. Fix windows tests.
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-09 12:05:27 +02:00
Hector Sanjuan
26cbecca4c
Fix tests
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-09 03:42:39 +02:00
Hector Sanjuan
7460be32c4
Try more
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-07 20:47:47 +02:00
Hector Sanjuan
fc2d7beacc
Try syncing test folders
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-07 20:31:40 +02:00
Hector Sanjuan
7ef7a8d158
sync test files after creation
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-07 20:12:05 +02:00
Hector Sanjuan
327a81b85a
golint govets
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-07 20:12:05 +02:00
Hector Sanjuan
623120fd50
Start cluster tests
...
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-08-07 20:12:05 +02:00