[Bug]: docker netmaker Fatal: Admin: could not connect to broker, token timeout, exiting ...

laiqinghua commented 2 years ago

Contact Details

nuandong.lai@gmail.com

What happened?

A bug happened!

https://netmaker.readthedocs.io/en/develop/quick-start.html

follow the document , but failed

Version

v0.16.1

What OS are you using?

Linux

Relevant log output

root@VM-0-42-ubuntu:~# docker logs -f netmaker

 __   __     ______     ______   __    __     ______     __  __     ______     ______
/\ "-.\ \   /\  ___\   /\__  _\ /\ "-./  \   /\  __ \   /\ \/ /    /\  ___\   /\  == \
\ \ \-.  \  \ \  __\   \/_/\ \/ \ \ \-./\ \  \ \  __ \  \ \  _"-.  \ \  __\   \ \  __<
 \ \_\\"\_\  \ \_____\    \ \_\  \ \_\ \ \_\  \ \_\ \_\  \ \_\ \_\  \ \_____\  \ \_\ \_\
  \/_/ \/_/   \/_____/     \/_/   \/_/  \/_/   \/_/\/_/   \/_/\/_/   \/_____/   \/_/ /_/

[netmaker] 2022-11-10 10:37:02 connecting to sqlite
[netmaker] 2022-11-10 10:37:02 database successfully connected
[netmaker] 2022-11-10 10:37:03 no OAuth provider found or not configured, continuing without OAuth
[netmaker] 2022-11-10 10:37:04 REST Server successfully started on port  8081  (REST)
[netmaker] 2022-11-10 10:37:04 connecting to mq broker at mq:1883 with TLS? false
[netmaker] Fatal: Admin: could not connect to broker, token timeout, exiting ...

Contributing guidelines

[X] Yes, I did.

laiqinghua commented 2 years ago

docker-compose.yml configure file

root@VM-0-42-ubuntu:~# cat docker-compose.yml version: "3.4"

services: netmaker: container_name: netmaker image: gravitl/netmaker:v0.16.1 cap_add:

NET_ADMIN
NET_RAW
SYS_MODULE sysctls:
net.ipv4.ip_forward=1
net.ipv4.conf.all.src_valid_mark=1
net.ipv6.conf.all.disable_ipv6=0
net.ipv6.conf.all.forwarding=1 restart: always volumes:
dnsconfig:/root/config/dnsconfig
sqldata:/root/data
mosquitto_data:/etc/netmaker environment: SERVER_NAME: "broker.nm.ddwan.ml" SERVER_HOST: "129.28.14.89" SERVER_API_CONN_STRING: "api.nm.ddwan.ml:443" COREDNS_ADDR: "129.28.14.89" DNS_MODE: "on" SERVER_HTTP_HOST: "api.nm.ddwan.ml" API_PORT: "8081" CLIENT_MODE: "on" MASTER_KEY: "V33V2rz7qOmJ0txM2tITOC3gMB0cpO" CORS_ALLOWED_ORIGIN: "" DISPLAY_KEYS: "on" DATABASE: "sqlite" NODE_ID: "netmaker-server-1" MQ_HOST: "mq" MQ_PORT: "443" MQ_SERVER_PORT: "1883" HOST_NETWORK: "off" VERBOSITY: "1" MANAGE_IPTABLES: "on" PORT_FORWARD_SERVICES: "dns" MQ_ADMIN_PASSWORD: "nuandong123456" ports:
"51821-51830:51821-51830/udp" expose:
"8081" labels:
traefik.enable=true
traefik.http.routers.netmaker-api.entrypoints=websecure
traefik.http.routers.netmaker-api.rule=Host(api.nm.ddwan.ml)
traefik.http.routers.netmaker-api.service=netmaker-api
traefik.http.services.netmaker-api.loadbalancer.server.port=8081 netmaker-ui: container_name: netmaker-ui image: gravitl/netmaker-ui:v0.16.1 depends_on:
netmaker links:
"netmaker:api" restart: always environment: BACKEND_URL: "https://api.nm.ddwan.ml/" expose:
"80" labels:
traefik.enable=true
traefik.http.middlewares.nmui-security.headers.accessControlAllowOriginList=.nm.ddwan.ml
traefik.http.middlewares.nmui-security.headers.stsSeconds=31536000
traefik.http.middlewares.nmui-security.headers.browserXssFilter=true
traefik.http.middlewares.nmui-security.headers.customFrameOptionsValue=SAMEORIGIN
traefik.http.middlewares.nmui-security.headers.customResponseHeaders.X-Robots-Tag=none
traefik.http.middlewares.nmui-security.headers.customResponseHeaders.Server= # Remove the server name
traefik.http.routers.netmaker-ui.entrypoints=websecure
traefik.http.routers.netmaker-ui.middlewares=nmui-security@docker
traefik.http.routers.netmaker-ui.rule=Host(dashboard.nm.ddwan.ml)
traefik.http.routers.netmaker-ui.service=netmaker-ui
traefik.http.services.netmaker-ui.loadbalancer.server.port=80 coredns: container_name: coredns image: coredns/coredns command: -conf /root/dnsconfig/Corefile depends_on:
netmaker restart: always volumes:
dnsconfig:/root/dnsconfig traefik: image: traefik:v2.6 container_name: traefik command:
"--certificatesresolvers.http.acme.email=931782512@qq.com"
"--certificatesresolvers.http.acme.storage=/letsencrypt/acme.json"
"--certificatesresolvers.http.acme.tlschallenge=true"
"--entrypoints.websecure.address=:443"
"--entrypoints.websecure.http.tls=true"
"--entrypoints.websecure.http.tls.certResolver=http"
"--log.level=INFO"
"--providers.docker=true"
"--providers.docker.exposedByDefault=false"
"--serverstransport.insecureskipverify=true" restart: always volumes:
/var/run/docker.sock:/var/run/docker.sock:ro
traefik_certs:/letsencrypt ports:
"443:443" mq: container_name: mq image: eclipse-mosquitto:2.0.11-openssl depends_on:
netmaker restart: unless-stopped command: ["/mosquitto/config/wait.sh"] environment: NETMAKER_SERVER_HOST: "https://api.nm.ddwan.ml/" volumes:
/root/mosquitto.conf:/mosquitto/config/mosquitto.conf
/root/wait.sh:/mosquitto/config/wait.sh
mosquitto_data:/mosquitto/data
mosquitto_logs:/mosquitto/log expose:
"8883" labels:
traefik.enable=true
traefik.tcp.routers.mqtt.rule=HostSNI(broker.nm.ddwan.ml)
traefik.tcp.routers.mqtt.tls.certresolver=http
traefik.tcp.services.mqtt.loadbalancer.server.port=8883
traefik.tcp.routers.mqtt.entrypoints=websecure volumes: traefik_certs: {} sqldata: {} dnsconfig: {} mosquitto_data: {} mosquitto_logs: {}

laiqinghua commented 2 years ago

C:\Users\p_qhualai>nslookup broker.nm.ddwan.ml 服务器: UnKnown Address: 192.168.255.10

非权威应答: 名称: broker.nm.ddwan.ml Address: 129.28.14.89

C:\Users\p_qhualai>nslookup api.nm.ddwan.ml 服务器: UnKnown Address: 192.168.255.10

非权威应答: 名称: api.nm.ddwan.ml Address: 129.28.14.89

C:\Users\p_qhualai>nslookup dashboard.nm.ddwan.ml 服务器: UnKnown Address: 192.168.255.10

非权威应答: 名称: dashboard.nm.ddwan.ml Address: 129.28.14.89

laiqinghua commented 2 years ago

@afeiszli @mattkasun @0xdcarns Please help me

mattkasun commented 2 years ago

why are you getting two different addresses for domain lookups for *.nm.ddwan.ml?

laiqinghua commented 2 years ago

root@VM-0-133-ubuntu:/home/ubuntu# nslookup nm.ddwan.ml Server: 127.0.0.53 Address: 127.0.0.53#53

Non-authoritative answer: Name: nm.ddwan.ml Address: 129.28.14.89

netmaker container error logs：

root@VM-0-133-ubuntu:/home/ubuntu# docker logs -f netmaker

/\ "-.\ \ /\ \ /_ _\ /\ "-./ \ /\ \ /\ \/ / /\ _\ /\ == \ \ \ -. \ \ \ _\ \//\ \/ \ \ -./\ \ \ \ \ \ \ "-. \ \ \ \ \ < \ _\"_\ \ _\ \ _\ \ _\ \ _\ \ _\ _\ \ _\ _\ \ _\ \ _\ _\ \// \// \/____/ \// \// \// \//\// \//\// \/____/ \// //

[netmaker] 2022-11-11 19:33:31 connecting to sqlite [netmaker] 2022-11-11 19:33:32 database successfully connected [netmaker] 2022-11-11 19:33:33 no OAuth provider found or not configured, continuing without OAuth [netmaker] 2022-11-11 19:33:36 REST Server successfully started on port 8081 (REST) [netmaker] 2022-11-11 19:33:36 connecting to mq broker at mq:1883 with TLS? false [netmaker] Fatal: Admin: could not connect to broker, token timeout, exiting ...

laiqinghua commented 2 years ago

I found the reason. I used docker ce. After I uninstalled the lower versions of containerd and docker ce, the installation method using the installation script has been successfully installed.

Reason: docker ce and containerd versions are too low. Thank you for your help!

gravitl / netmaker