search

suryalnvs / fabric-docker-compose-svt

2 stars 3 forks source link

How to setup multi-host environment for multiple orderers #1

Open tonywang5671 opened 6 years ago

tonywang5671 commented 6 years ago

Hello sir, I am trying to split 3 orderers, 4 kafka node and 3 zookeeper at different host. But I encounter a connection problem when orderer try to connect to kafka. Bellow is my environments:

  1. host A run peers of org1, 1 orderer, 4 kafka nodes and 3 zookeeper

  2. host B run peers of org2, 1 orderer host A seems up normally abut I saw bellow error at the console log of org2 orderer at host B....would you please advise some tips or reference procedure?

    [sarama] 2017/12/12 06:11:52.186722 client.go:397: client/brokers registered new broker #0 at 33be78497375:9092 [sarama] 2017/12/12 06:11:52.186739 client.go:397: client/brokers registered new broker #1 at 2339e38eee34:9092 [sarama] 2017/12/12 06:11:52.186743 client.go:397: client/brokers registered new broker #2 at fa8269a66bdc:9092 [sarama] 2017/12/12 06:11:52.186746 client.go:397: client/brokers registered new broker #3 at b5a700af19de:9092 [sarama] 2017/12/12 06:11:52.186816 client.go:154: Successfully initialized new client [sarama] 2017/12/12 06:11:52.187031 config.go:329: ClientID is the default of 'sarama', you should consider setting it to something application-specific. [sarama] 2017/12/12 06:11:52.187256 async_producer.go:584: producer/broker/3 starting up [sarama] 2017/12/12 06:11:52.187263 async_producer.go:596: producer/broker/3 state change to [open] on testchainid/0 [sarama] 2017/12/12 06:11:52.506396 broker.go:96: Failed to connect to broker b5a700af19de:9092: dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:52.506475 async_producer.go:762: producer/broker/3 state change to [closing] because dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:52.506505 async_producer.go:458: producer/leader/testchainid/0 state change to [retrying-1] [sarama] 2017/12/12 06:11:52.506521 async_producer.go:468: producer/leader/testchainid/0 abandoning broker 3 [sarama] 2017/12/12 06:11:52.506546 async_producer.go:663: producer/broker/3 shut down [sarama] 2017/12/12 06:11:52.606760 client.go:599: client/metadata fetching metadata for [testchainid] from broker kafka0:9092 [sarama] 2017/12/12 06:11:52.608799 config.go:329: ClientID is the default of 'sarama', you should consider setting it to something application-specific. [sarama] 2017/12/12 06:11:52.609061 async_producer.go:584: producer/broker/3 starting up [sarama] 2017/12/12 06:11:52.609085 async_producer.go:596: producer/broker/3 state change to [open] on testchainid/0 [sarama] 2017/12/12 06:11:52.609103 async_producer.go:446: producer/leader/testchainid/0 selected broker 3 [sarama] 2017/12/12 06:11:52.609119 async_producer.go:474: producer/leader/testchainid/0 state change to [flushing-1] [sarama] 2017/12/12 06:11:52.609131 async_producer.go:496: producer/leader/testchainid/0 state change to [normal] [sarama] 2017/12/12 06:11:52.923382 broker.go:96: Failed to connect to broker b5a700af19de:9092: dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:52.923406 async_producer.go:762: producer/broker/3 state change to [closing] because dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:52.923422 async_producer.go:458: producer/leader/testchainid/0 state change to [retrying-2] [sarama] 2017/12/12 06:11:52.923426 async_producer.go:468: producer/leader/testchainid/0 abandoning broker 3 [sarama] 2017/12/12 06:11:52.923435 async_producer.go:663: producer/broker/3 shut down [sarama] 2017/12/12 06:11:53.023826 client.go:599: client/metadata fetching metadata for [testchainid] from broker kafka0:9092 [sarama] 2017/12/12 06:11:53.026292 config.go:329: ClientID is the default of 'sarama', you should consider setting it to something application-specific. [sarama] 2017/12/12 06:11:53.026574 async_producer.go:584: producer/broker/3 starting up [sarama] 2017/12/12 06:11:53.026604 async_producer.go:596: producer/broker/3 state change to [open] on testchainid/0 [sarama] 2017/12/12 06:11:53.026622 async_producer.go:446: producer/leader/testchainid/0 selected broker 3 [sarama] 2017/12/12 06:11:53.026639 async_producer.go:474: producer/leader/testchainid/0 state change to [flushing-2] [sarama] 2017/12/12 06:11:53.026651 async_producer.go:496: producer/leader/testchainid/0 state change to [normal] [sarama] 2017/12/12 06:11:53.156478 broker.go:96: Failed to connect to broker b5a700af19de:9092: dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:53.156501 async_producer.go:762: producer/broker/3 state change to [closing] because dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host [sarama] 2017/12/12 06:11:53.156518 async_producer.go:458: producer/leader/testchainid/0 state change to [retrying-3] [sarama] 2017/12/12 06:11:53.156522 async_producer.go:468: producer/leader/testchainid/0 abandoning broker 3 [sarama] 2017/12/12 06:11:53.156531 async_producer.go:663: producer/broker/3 shut down [sarama] 2017/12/12 06:11:53.256893 client.go:599: client/metadata fetching metadata for [testchainid] from broker kafka0:9092 [sarama] 2017/12/12 06:11:53.259126 config.go:329: ClientID is the default of 'sarama', you should consider setting it to something application-specific. [sarama] 2017/12/12 06:11:53.259394 async_producer.go:584: producer/broker/3 starting up [sarama] 2017/12/12 06:11:53.259405 async_producer.go:596: producer/broker/3 state change to [open] on testchainid/0 [sarama] 2017/12/12 06:11:53.259412 async_producer.go:446: producer/leader/testchainid/0 selected broker 3 [sarama] 2017/12/12 06:11:53.259417 async_producer.go:474: producer/leader/testchainid/0 state change to [flushing-3] [sarama] 2017/12/12 06:11:53.259422 async_producer.go:496: producer/leader/testchainid/0 state change to [normal] 2017-12-12 06:11:53.381 UTC [orderer/kafka] try -> DEBU 160 [channel: testchainid] Retrying every 1s for a total of 30s [sarama] 2017/12/12 06:11:53.381897 broker.go:96: Failed to connect to broker b5a700af19de:9092: dial tcp: lookup b5a700af19de on 127.0.0.11:53: no such host

    The orderer section in docker-compose-cli.yaml of org2 at host B is bellow: (I use peer2.org2 run as orderer....)

    peer2.org2.example.com: extends: file: base/docker-compose-base.yaml service: peer2.org2.example.com container_name: peer2.org2.example.com

    depends_on:

    - kafka0

    - kafka1

    - kafka2

    - kafka3

    dns_search: . extra_hosts:

    • "kafka0:192.168.242.133"
    • "kafka1:192.168.242.133"
    • "kafka2:192.168.242.133"
    • "kafka3:192.168.242.133"
    • "peer0.org1.example.com:192.168.242.133"
    • "peer1.org1.example.com:192.168.242.133"
    • "peer2.org1.example.com:192.168.242.133"
    • "peer0.org2.example.com:192.168.242.139"
    • "peer1.org2.example.com:192.168.242.139"
    • "peer2.org2.example.com:192.168.242.139"
    • "peer0.org3.example.com:192.168.242.140"
    • "peer1.org3.example.com:192.168.242.140"

    • "peer2.org3.example.com:192.168.242.140"

      And the orderer section in docker-compose-base.yaml of org2 at host B is bellow:

      peer2.org2.example.com: hostname: peer2.org2.example.com container_name: peer2.org2.example.com image: hyperledger/fabric-orderer environment:

    • ORDERER_GENERAL_LOGLEVEL=DEBUG
    • ORDERER_GENERAL_LISTENADDRESS=0.0.0.0
    • ORDERER_GENERAL_GENESISMETHOD=file
    • ORDERER_GENERAL_GENESISFILE=/var/hyperledger/orderer/orderer.genesis.block
    • ORDERER_GENERAL_LOCALMSPID=Org2MSP
    • ORDERER_GENERAL_LOCALMSPDIR=/var/hyperledger/orderer/msp
    • ORDERER_KAFKA_RETRY_PERIOD=3s
    • ORDERER_KAFKA_RETRY_STOP=10s

      enabled TLS

    • ORDERER_KAFKA_RETRY_SHORTINTERVAL=1s
    • ORDERER_KAFKA_RETRY_SHORTTOTAL=30s
    • ORDERER_KAFKA_VERBOSE=true
    • ORDERER_GENERAL_TLS_ENABLED=${ENABLE_TLS}
    • ORDERER_GENERAL_TLS_PRIVATEKEY=/var/hyperledger/orderer/tls/server.key
    • ORDERER_GENERAL_TLS_CERTIFICATE=/var/hyperledger/orderer/tls/server.crt
    • ORDERER_GENERAL_TLS_ROOTCAS=[/var/hyperledger/orderer/tls/ca.crt] working_dir: /opt/gopath/src/github.com/hyperledger/fabric command: orderer volumes:
    • ../channel-artifacts/orderer.genesis.block:/var/hyperledger/orderer/orderer.genesis.block
    • ../crypto-config/peerOrganizations/org2.example.com/peers/peer2.org2.example.com/msp:/var/hyperledger/orderer/msp
    • ../crypto-config/peerOrganizations/org2.example.com/peers/peer2.org2.example.com/tls/:/var/hyperledger/orderer/tls ports:

    • 8050:7050

sillysachin commented 6 years ago

@tonywang5671 Were you able to complete the setup?

rtrive commented 6 years ago

@tonywang5671 any news? i'm interested in this setup

happilymarrieddad commented 6 years ago

I'm encountering this same problem

selection_207