search

rabbitmq / rabbitmq-autocluster

RabbitMQ peer discovery and cluster formation plugin, supports RabbitMQ 3.6.x
BSD 3-Clause "New" or "Revised" License
241 stars 54 forks source link

Cannot get list of discovered service from consul #73

Closed sumeetmi2 closed 5 years ago

sumeetmi2 commented 5 years ago

I have a setup where the consul agent is running on my host machine and I am using pivotal/rabbitmq docker image with autocluster on.

My docker compose looks like below

version: "2"
services:
   rabbit:
    environment:
      - TCP_PORTS=15672, 5672,25672,4369,8500
      - AUTOCLUSTER_TYPE=consul
      - AUTOCLUSTER_DELAY=60
      - CONSUL_HOST=localhost
      - CONSUL_ACL_TOKEN=b7862315-05fe-4dda-8b13-4f533ec4e205
      - CONSUL_SVC=terracotta_rabbitmq
      - AUTOCLUSTER_CLEANUP=true
      - CLEANUP_WARN_ONLY=false
      - CONSUL_DEREGISTER_AFTER=60
      - AUTOCLUSTER_LOG_LEVEL=debug
      - CONSUL_SVC_ADDR_AUTO=true
      - CONSUL_SVC_ADDR_NODENAME=true
    image: pivotalrabbitmq/rabbitmq-autocluster
    expose:
      - 15672
      - 5672
      - 5671
      - 15671
      - 33431
      - 8300
      - 4369
      - 25672
      - 8500
    tty: true
    network_mode: host
    command:  sh -c "sleep 20; rabbitmq-server;"
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock

Strangely, on the step where it checks for services that are passing on consul, it gets empty list when queried from inside docker autocluster plugin.

bit_1_303964dae0b0 | autocluster: GET http://localhost:8500/v1/health/service/terracotta_rabbitmq
rabbit_1_303964dae0b0 | 
rabbit_1_303964dae0b0 | =INFO REPORT==== 9-Jan-2019::07:35:00 ===
rabbit_1_303964dae0b0 | autocluster: Response: [{ok,{{"HTTP/1.1",200,"OK"},
rabbit_1_303964dae0b0 |                              [{"date","Wed, 09 Jan 2019 07:35:00 GMT"},
rabbit_1_303964dae0b0 |                               {"content-length","2"},
rabbit_1_303964dae0b0 |                               {"content-type","application/json"},
rabbit_1_303964dae0b0 |                               {"x-consul-index","26252192"},
rabbit_1_303964dae0b0 |                               {"x-consul-knownleader","true"},
rabbit_1_303964dae0b0 |                               {"x-consul-lastcontact","0"}],
rabbit_1_303964dae0b0 |                              "[]"}}]

But when i curl from inside the docker sh, i get the list of services correctly. Because it is not able to identify passing services from consul, the cluster isnt forming.

michaelklishin commented 5 years ago

Thank you for your time.

Team RabbitMQ uses GitHub issues for specific actionable items engineers can work on. GitHub issues are not used for questions, investigations, root cause analysis, discussions of potential issues, etc (as defined by this team).

We get at least a dozen of questions through various venues every single day, often light on details. At that rate GitHub issues can very quickly turn into a something impossible to navigate and make sense of even for our team. Because GitHub is a tool our team uses heavily nearly every day, the signal/noise ratio of issues is something we care about a lot.

Please post this to rabbitmq-users.

Thank you.

michaelklishin commented 5 years ago

According to the log there are no results returned by Consul. While unlikely to be directly related, this plugin is only needed with RabbitMQ 3.6.x, which has been out of support for over 6 months. Please move to 3.7.x and the respective built-in Consul peer discovery plugin before you try anything else.