ipfs-cluster/adder
Hector Sanjuan 072f0bc722 Feat: support adding CAR files
This commit adds a new add option: "format".

This option specifies how IPFS Cluster is expected to build the DAG when
adding content. By default, it takes a "unixfs", which chunks and DAG-ifies as
it did before, resulting in a UnixFSv1 DAG.

Alternatively, it can be set to "car". In this case, Cluster will directly
read blocks from the CAR file and add them.

Adding CAR files or doing normal processing is independent from letting
cluster do sharding or not. If sharding is ever enabled, Cluster could
potentially shard a large CAR file among peers.

Currently, importing CAR files is limited to a single CAR file with a single
root (the one that is pinned). Future iterations may support multiple CARs
and/or multiple roots by transparently wrapping them.
2021-04-21 13:55:06 +02:00
..
adderutils Dependency ugprade: changes needed 2020-03-22 14:50:25 +01:00
ipfsadd staticcheck: fix all staticcheck warnings in the project 2020-04-14 20:16:10 +02:00
sharding Feat: support adding CAR files 2021-04-21 13:55:06 +02:00
single Adder: make sure we always pin recursively after adding 2020-04-21 17:23:55 +02:00
adder_test.go Feat: support adding CAR files 2021-04-21 13:55:06 +02:00
adder.go Feat: support adding CAR files 2021-04-21 13:55:06 +02:00
util.go Fix: do not keep adding if BlockPut failed in all destinations 2020-05-17 02:50:54 +02:00