Go to file
Hector Sanjuan 8626fbc166 Fix: bad behaviour when adding and ipfs is down
Adding keeps retrying indefinitely to send blocks to ipfs. When ipfs is down this:

* Stores all errors
* Keeps retrying
* Additionally, forgot to close bodies

This resulted in memory leaks. The new behaviour does not keep retrying. And
response bodies are closed after reading.
2022-04-26 14:54:04 +02:00
.github Tests: Separate docker build and compose tests to different jobs 2021-12-01 01:27:59 +01:00
adder Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
allocator/balanced Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
api Merge pull request #1626 from ipfs/feat/cid-strings 2022-04-07 15:05:00 +02:00
cmd Release v1.0.0 2022-04-22 16:42:17 +02:00
cmdutils Pintracker: streaming methods 2022-03-22 15:38:01 +01:00
config Dependency upgrades (#1451) 2021-08-16 17:52:31 +02:00
consensus Fix: wrong pins metric when batching enabled 2022-04-25 23:45:34 +02:00
datastore Fix #1320: Add automatic GC to Badger datastore 2021-06-28 21:51:29 +02:00
docker Docker: allow controlling datastore backend via IPFS_CLUSTER_DATASTORE 2021-06-29 15:44:24 +02:00
informer Pintracker: streaming methods 2022-03-22 15:38:01 +01:00
ipfsconn/ipfshttp Fix: bad behaviour when adding and ipfs is down 2022-04-26 14:54:04 +02:00
monitor metrics: track total pins, queued, pinning, pin error. 2022-04-22 15:57:48 +02:00
observations metrics: track total pins, queued, pinning, pin error. 2022-04-22 15:57:48 +02:00
pintracker metrics: track total pins, queued, pinning, pin error. 2022-04-22 15:57:48 +02:00
pstoremgr Changes pertaining to go-libp2p v0.16.0 2021-11-30 06:25:15 +01:00
rpcutil RPC: Remove BlockPut from the policy 2022-03-24 19:13:11 +01:00
sharness Sharness: update state export file 2022-04-07 14:54:16 +02:00
state metrics: track total pins, queued, pinning, pin error. 2022-04-22 15:57:48 +02:00
test metrics: track total pins, queued, pinning, pin error. 2022-04-22 15:57:48 +02:00
version Release v1.0.0 2022-04-22 16:42:17 +02:00
.codeclimate.yml codeclimate 2018-08-07 20:12:05 +02:00
.codecov.yml Codecov: disable comments 2020-10-05 08:41:42 +02:00
.dockerignore Issue #259: Address CR comments 2017-12-04 13:59:48 +01:00
.gitignore Feat: ipfs-cluster-follow 2019-12-07 15:38:59 +01:00
add_test.go Adders: stream blocks to destinations 2022-03-24 17:24:58 +01:00
allocate.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
CHANGELOG.md Fix date in changelog 2022-04-22 16:46:56 +02:00
cluster_config_test.go allocator: Filter out metrics from non-trusted peers when configured 2022-03-01 11:25:16 +01:00
cluster_config.go allocator: Filter out metrics from non-trusted peers when configured 2022-03-01 11:25:16 +01:00
cluster_test.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
cluster.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
clusterhost.go Dependency upgrades (#1600) 2022-03-15 11:50:44 +01:00
config_test.go allocator: Filter out metrics from non-trusted peers when configured 2022-03-01 11:25:16 +01:00
connect_graph.go Streaming Peers(): make Peers() a streaming call 2022-03-23 01:27:57 +01:00
CONTRIBUTING.md Docs: Move to website. 2018-04-27 09:05:11 +02:00
COPYRIGHT Dual-license the codebase. 2019-03-01 20:12:19 +00:00
docker-compose.yml chore: use latest in all instances 2021-06-09 15:39:34 +02:00
Dockerfile Docker: set ipfs as file owner when adding 2021-12-01 01:47:15 +01:00
Dockerfile-bundle Docker: set ipfs as file owner when adding 2021-12-01 01:47:15 +01:00
Dockerfile-test Docker: set ipfs as file owner when adding 2021-12-01 01:47:15 +01:00
go.mod Merge pull request #1627 from ipfs/dependency-upgrades 2022-04-07 14:48:02 +02:00
go.sum Merge pull request #1627 from ipfs/dependency-upgrades 2022-04-07 14:48:02 +02:00
ipfscluster_test.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
ipfscluster.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
LICENSE Chore: Add license file with URLS (#1014) 2020-03-06 13:52:19 +01:00
LICENSE-APACHE Chore: Add license file with URLS (#1014) 2020-03-06 13:52:19 +01:00
LICENSE-MIT Chore: Add license file with URLS (#1014) 2020-03-06 13:52:19 +01:00
logging.go Merge branch 'master' into feat/pinning-api 2022-03-10 13:41:54 +01:00
Makefile Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
peer_manager_test.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
pnet_test.go Streaming Peers(): make Peers() a streaming call 2022-03-23 01:27:57 +01:00
README.md Update IRC link in repository badges 2021-06-01 14:29:47 +02:00
release.sh release.sh: improve script. 2021-01-14 14:06:53 +01:00
rpc_api.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00
rpc_policy.go RPC: Remove BlockPut from the policy 2022-03-24 19:13:11 +01:00
util.go Adopt api.Cid type - replaces cid.Cid everwhere. 2022-04-07 14:27:39 +02:00

IPFS Cluster

Made by Main project Matrix channel GoDoc Go Report Card Build Status codecov

Automated data availability and redundancy on IPFS

logo

IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers.

It provides:

  • A cluster peer application: ipfs-cluster-service, to be run along with go-ipfs.
  • A client CLI application: ipfs-cluster-ctl, which allows easily interacting with the peer's HTTP API.
  • An additional "follower" peer application: ipfs-cluster-follow, focused on simplifying the process of configuring and running follower peers.

Are you using IPFS Cluster?

Please participate in the IPFS Cluster user registry.


Table of Contents

Documentation

Please visit https://cluster.ipfs.io/documentation/ to access user documentation, guides and any other resources, including detailed download and usage instructions.

News & Roadmap

We regularly post project updates to https://cluster.ipfs.io/news/ .

The most up-to-date Roadmap is available at https://cluster.ipfs.io/roadmap/ .

Install

Instructions for different installation methods (including from source) are available at https://cluster.ipfs.io/download .

Usage

Extensive usage information is provided at https://cluster.ipfs.io/documentation/ , including:

Contribute

PRs accepted. As part of the IPFS project, we have some contribution guidelines.

License

This library is dual-licensed under Apache 2.0 and MIT terms.

© 2020. Protocol Labs, Inc.