Pins not replicated, while clusters sees each other about ipfs-cluster HOT 3 CLOSED

@AlexMesser if you want ipfs daemon to be in a fully locked private network, you need to add a swarm.key etc as explained here: https://github.com/ipfs/kubo/blob/master/docs/experimental-features.md#private-networks, otherwise there's always the risk that it joins the public network and connects to other peers or the other way around.

from ipfs-cluster.

Thank you for the detailed writeup.

I am not sure. Bob should pubsub-broadcast the new pin and alice should receive it.

Both peers are connected so that is not the problem.

The only thing that is consistent with this is that Alice does not include Bob in the trusted_peers array in the configuration (and it is not set to *). However, Alice is accepting the BlockPut stream, so that means it trusts Bob.

Are they broadcasting on the same pubsub topic? That is set by crdt/cluster_name option in the config.

from ipfs-cluster.

Thank you for response, cluster_name was the issue. I specified custom cluster name in ipfs-cluster-follow command while main cluster was default ipfs-cluster.

Btw, I found another not an issue, but a bad behavior from IPFS side during pinset replication.
When follower (Bob) connects to main (Alice), Bob's IPFS Cluster replicates all pins in a ~30 seconds (1000 pins), but IPFS replication takes hours. I enabled debugging on IPFS container and found that it requests pins from peers that not belongs to my private network.

I removed all bootstrap peers from Bob IPFS configure-ipfs.sh script and added Alice IPFS address as a bootstrap address:

ipfs init --profile=badgerds,server
ipfs config Addresses.API /ip4/0.0.0.0/tcp/5001
ipfs config Addresses.Gateway /ip4/0.0.0.0/tcp/8080
ipfs config --json Swarm.ConnMgr.HighWater 2000
ipfs config --json Datastore.BloomFilterSize 1048576
ipfs config Datastore.StorageMax 100GB
+ ipfs bootstrap rm --all
+ ipfs bootstrap add /dns4/${IPFS_BOOTSTRAP_NODE}/tcp/4001/p2p/${IPFS_BOOTSTRAP_PEER_ID}

after these changes IPFS replicated 1000 pins in a ~3 minutes.

from ipfs-cluster.