hyperledger / fabric

Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use cases. It offers a unique approach to consensus that enables performance at scale while preserving privacy.
https://wiki.hyperledger.org/display/fabric
Apache License 2.0
15.76k stars 8.86k forks source link

An optimization of the network communication architecture for improving the running of hyperledger fabric on kubernetes, where the random port of the pod affects the node's p2p communication #4927

Open JasonCeng opened 4 months ago

JasonCeng commented 4 months ago

Current Status

When running Hyperledger Fabric with Kubernetes, the port of the node's pod is random, while the ports of the Orderer and Peer anchor nodes are written in the genesis block gennis.block. When the node is restarted, the port will change, which will cause the node to be unable to establish p2p communication.

Expected

In order to improve the orchestration and deployment capabilities of Hyperledger Fabric on kubernetes, it is recommended to optimize the network communication architecture.

Solution

Introduce Zookeeper as a decentralized registration center, and each organization maintains a registration center. The specific design is as follows:

  1. Allow each organization to connect to its own Zookeeper cluster, ZNode=/hosts/{domain name}
  2. The {domain name, node ip, external random port} of the blockchain node (Orderer, peer, CA) is stored on the Zookeeper cluster
  3. When the blockchain node (Orderer, peer, CA) starts, it immediately reports the {domain name, node ip, external random port} of this node to ZNode
  4. When the blockchain node (Orderer, peer, CA) starts, it starts to monitor all changes in /hosts/{domain name} on ZNode. (a) When the data changes, update the local /etc/hosts (b) When the data changes, update the port number for the node to establish a connection with the peer node

Please let us know if you plan to work on this.

Yes!

yacovm commented 3 months ago

And where would Zookeeper run? If it runs in K8S you have the same problem, and if it runs outside of it, then why can't you run Fabric outside of Kubernetes too?

denyeart commented 3 months ago

Can't you specify the service port when using Kubernetes and/or use an ingress with a static port?