search

netbirdio / netbird

Connect your devices into a secure WireGuard®-based overlay network with SSO, MFA and granular access controls.
https://netbird.io
BSD 3-Clause "New" or "Revised" License
11.33k stars 519 forks source link

iPhone / iOS cannot connect to "internal" peers #2438

Closed collse closed 3 months ago

collse commented 3 months ago

Describe the problem

Enrolling an iPhone and connecting it to the netbird.network it connects to external hosts fine but not to hosts that are internal in a self-hosted environment when on a mobile network - external peers work fine as well as when on local wifi.

To Reproduce

Steps to reproduce the behavior:

  1. Install self-hosted environment
  2. enrol a few hosts/devices
  3. enrol iPhone
  4. authenticate and connect to netbird.network when on mobile

Expected behavior

iPhone has access to the network

Are you using NetBird Cloud?

Self-hosted with Nginx Proxy Manager & Authentik

NetBird version

latest

NetBird status -d output:

shown from laptop-internal

Android device connected via iPhone hotspot on the same mobile network:

shown from laptop-internal Peers detail: external-linux-server.netbird.selfhosted: NetBird IP: 100.B.C.D Public key: -redacted- Status: Connected -- detail -- Connection type: Relayed Direct: false ICE candidate (Local/Remote): relay/host ICE candidate endpoints (Local/Remote): internal.server.ip:55004/external-linux-server.ip:51820 Last connection update: 46 minutes, 57 seconds ago Last WireGuard handshake: 2 minutes, 1 seconds ago Transfer status (received/sent) 2.8 KiB/8.1 KiB Quantum resistance: false Routes: - Latency: 12.019433ms

docker.netbird.selfhosted: NetBird IP: A.B.C.D Public key:: -redacted- Status: Connected -- detail -- Connection type: P2P Direct: true ICE candidate (Local/Remote): srflx/prflx ICE candidate endpoints (Local/Remote): internal-laptop.ip:51820/internal-docker-host.ip:51820 Last connection update: 46 minutes, 58 seconds ago Last WireGuard handshake: 25 seconds ago Transfer status (received/sent) 7.3 KiB/7.6 KiB Quantum resistance: false Routes: - Latency: 1.909864ms

iphone.netbird.selfhosted: (not connected providing hotspot to Android tablet) NetBird IP: A.B.C.D Public key:: -redacted- Status: Disconnected -- detail -- Connection type: Direct: false ICE candidate (Local/Remote): -/- ICE candidate endpoints (Local/Remote): -/- Last connection update: 22 minutes, 40 seconds ago Last WireGuard handshake: - Transfer status (received/sent) 0 B/0 B Quantum resistance: false Routes: - Latency: 10.510283ms

android-tablet.netbird.selfhosted: NetBird IP: A.B.C.D Public key: : -redacted- Status: Connected -- detail -- Connection type: Relayed Direct: true ICE candidate (Local/Remote): srflx/relay ICE candidate endpoints (Local/Remote): internal-laptop.ip:51820/internal-server.ip:55077 Last connection update: 23 seconds ago Last WireGuard handshake: 22 seconds ago Transfer status (received/sent) 240 B/272 B Quantum resistance: false Routes: - Latency: 48.156575ms

OS: darwin/amd64 Daemon version: 0.28.7 CLI version: 0.28.7 Management: Connected to https://netbird.B.C.D:443 Signal: Connected to https://netbird.B.C.D:443 Relays: [stun:netbird.B.C.D:3478] is Available [turn:netbird.B.C.D:3478?transport=udp] is Available Nameservers: FQDN: internal_laptop.netbird.selfhosted NetBird IP: A.B.C.D Interface type: Userspace Quantum resistance: false Routes: - Peers count: 3/4 Connected

Do you face any client issues on desktop?

no

Screenshots

n/a Additional context

here are the trace logs on the iOS device

2024-08-16T12:49:57Z DEBG client/internal/login.go:93: connecting to the Management service https://netbird.domain.com:443 2024-08-16T12:49:57Z DEBG client/internal/login.go:34: connected to the Management service https://netbird.domain.com:443 2024-08-16T12:49:57Z INFO client/ios/NetBirdSDK/client.go:91: Starting NetBird client 2024-08-16T12:49:57Z DEBG client/ios/NetBirdSDK/client.go:92: Tunnel uses interface: utun4 2024-08-16T12:49:57Z DEBG client/internal/login.go:93: connecting to the Management service https://netbird.domain.com:443 2024-08-16T12:49:58Z DEBG client/internal/login.go:34: connected to the Management service https://netbird.domain.com:443 2024-08-16T12:49:58Z DEBG client/internal/login.go:93: connecting to the Management service https://netbird.domain.com:443 2024-08-16T12:49:58Z DEBG client/internal/login.go:63: connected to the Management service https://netbird.domain.com:443 2024-08-16T12:49:58Z INFO client/ios/NetBirdSDK/client.go:120: Auth successful 2024-08-16T12:49:58Z INFO client/internal/connect.go:119: starting NetBird client version v0.28.7 on ios/arm64 2024-08-16T12:49:58Z DEBG client/internal/connect.go:180: connecting to the Management service netbird.domain.com:443 2024-08-16T12:49:58Z DEBG client/internal/connect.go:188: connected to the Management service netbird.domain.com:443 2024-08-16T12:49:59Z DEBG signal/client/grpc.go:81: connected to Signal Service: netbird.domain.com:443 2024-08-16T12:49:59Z INFO client/internal/routemanager/manager.go:135: Routing setup complete 2024-08-16T12:49:59Z INFO iface/tun_ios.go:44: create tun interface 2024-08-16T12:49:59Z DEBG iface/tun_ios.go:66: Attaching to interface 2024-08-16T12:49:59Z ERRO iface/uapi.go:15: failed to open uapi socket: mkdir /var/run/wireguard: operation not permitted 2024-08-16T12:49:59Z ERRO iface/wg_configurer_usp.go:191: failed to open uapi listener: mkdir /var/run/wireguard: operation not permitted 2024-08-16T12:49:59Z DEBG iface/wg_configurer_usp.go:39: adding Wireguard private key 2024-08-16T12:49:59Z DEBG iface/tun_ios.go:93: device is ready to use: utun4 2024-08-16T12:49:59Z DEBG signal/client/grpc.go:126: signal connection state READY 2024-08-16T12:49:59Z DEBG client/internal/engine.go:698: connecting to Management Service updates stream 2024-08-16T12:49:59Z INFO signal/client/grpc.go:147: connected to the Signal Service stream 2024-08-16T12:49:59Z INFO client/internal/engine.go:1494: Network monitor is disabled, not starting 2024-08-16T12:49:59Z DEBG management/client/grpc.go:113: management connection state READY 2024-08-16T12:49:59Z INFO client/internal/connect.go:267: Netbird engine started, the IP is: 100.71.178.212/16 2024-08-16T12:49:59Z INFO management/client/grpc.go:154: connected to the Management Service stream 2024-08-16T12:49:59Z DEBG management/client/grpc.go:251: got an update message from Management Service 2024-08-16T12:49:59Z DEBG client/internal/engine.go:724: got TURNs update from Management Service, updating 2024-08-16T12:49:59Z DEBG client/internal/engine.go:706: got STUNs update from Management Service, updating 2024-08-16T12:49:59Z WARN client/internal/engine.go:602: running SSH server is not permitted 2024-08-16T12:49:59Z DEBG client/internal/engine.go:769: got peers update from Management Service, total peers to connect to = 5 2024-08-16T12:49:59Z DEBG client/internal/engine.go:1010: creating peer connection 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:49:59Z DEBG client/internal/engine.go:1010: creating peer connection vOrO5eVpPcMASMVg+G9arrAMqjABtaRXYGjT1kCuRQI= 2024-08-16T12:49:59Z DEBG client/internal/engine.go:1010: creating peer connection DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= 2024-08-16T12:49:59Z DEBG client/internal/engine.go:1010: creating peer connection cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:49:59Z DEBG client/internal/engine.go:1010: creating peer connection kpTSMW4Aoc3B2QVAuE8FY40szsxiH6DAEwsJDjkQaTQ= 2024-08-16T12:49:59Z DEBG client/internal/dns/service_memory.go:51: dns service listening on: 100.71.255.254 2024-08-16T12:49:59Z DEBG client/internal/dns/host_ios.go:28: Applying DNS settings: {"domains":[{"disabled":false,"domain":"netbird.selfhosted","matchOnly":false}],"routeAll":false,"serverIP":"100.71.255.254","serverPort":53} 2024-08-16T12:49:59Z INFO client/internal/acl/manager.go:52: ACL rules processed in: 144.916µs, total rules count: 2 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:256: trying to connect to peer kpTSMW4Aoc3B2QVAuE8FY40szsxiH6DAEwsJDjkQaTQ= 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer kpTSMW4Aoc3B2QVAuE8FY40szsxiH6DAEwsJDjkQaTQ=, waiting for the confirmation 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:256: trying to connect to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:256: trying to connect to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=, waiting for the confirmation 2024-08-16T12:50:00Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=, waiting for the confirmation 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:256: trying to connect to peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=, waiting for the confirmation 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= on status Disconnected 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:639: peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= ICE ConnectionState has changed to Checking 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= -> udp4 host 37.187.C.D:51820 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 37.187.C.D:51820 for UVFlFUXgyYBfohdg 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:256: trying to connect to peer vOrO5eVpPcMASMVg+G9arrAMqjABtaRXYGjT1kCuRQI= 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 37.187.C.D:51820 for UVFlFUXgyYBfohdgstun:netbird.domain.com:3478 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer vOrO5eVpPcMASMVg+G9arrAMqjABtaRXYGjT1kCuRQI=, waiting for the confirmation 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:412: Conn resolved IP for 37.187.C.D:51820: 37.187.C.D 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:639: peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= ICE ConnectionState has changed to Connected 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:633: selected candidate pair [local <-> remote] -> [udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 <-> udp4 host 37.187.C.D:51820], peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= 2024-08-16T12:50:01Z DEBG iface/iface.go:92: updating interface utun4 peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=, endpoint 37.187.C.D:51820 2024-08-16T12:50:01Z INFO client/internal/peer/conn.go:362: connected to peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=, endpoint address: 37.187.C.D:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= -> udp4 srflx 37.187.C.D:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= on status Disconnected 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:654: sending answer to 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer DlaAjb8NY7Xk+UhEhvXD/hpsaSimf0CzA+Q9HlE2uFg= -> udp4 relay 192.168.C.A:55365 related 0.0.0.0:40764 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Checking 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 host 192.168.D.A:51820 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for qYPrcGuEbrcDXwVU 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for qYPrcGuEbrcDXwVUstun:netbird.domain.com:3478 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 srflx 192.168.D.A:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 relay 192.168.C.A:56550 related 0.0.0.0:57259 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56550 for qYPrcGuEbrcDXwVU 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56550 for qYPrcGuEbrcDXwVUstun:netbird.domain.com:3478 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= on status Disconnected 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:654: sending answer to cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Checking 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 host 172.21.0.2:51820 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for VHKfSEfZEyJpmsPQ 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for VHKfSEfZEyJpmsPQturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 srflx 192.168.C.B:51820 related 0.0.0.0:51820 2024-08-16T12:50:01Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:01Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 relay 192.168.C.A:57086 related 0.0.0.0:38011 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for VHKfSEfZEyJpmsPQ 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for VHKfSEfZEyJpmsPQturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:57086 for VHKfSEfZEyJpmsPQ 2024-08-16T12:50:01Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:57086 for VHKfSEfZEyJpmsPQturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Failed 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:496: trying to cleanup 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:13Z DEBG iface/iface.go:101: Removing peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= from interface utun4 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Closed 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:554: cleaned up connection to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:13Z DEBG client/internal/engine.go:990: connection to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= failed: connecting canceled by caller 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Failed 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:496: trying to cleanup cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:13Z DEBG iface/iface.go:101: Removing peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= from interface utun4 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Closed 2024-08-16T12:50:13Z DEBG client/internal/peer/conn.go:554: cleaned up connection to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:13Z DEBG client/internal/engine.go:990: connection to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= failed: connecting canceled by caller 2024-08-16T12:50:14Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:14Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= on status Disconnected 2024-08-16T12:50:14Z DEBG client/internal/peer/conn.go:732: OnRemoteOffer skipping message from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= on status Disconnected because is not ready 2024-08-16T12:50:14Z DEBG client/internal/peer/conn.go:256: trying to connect to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=, waiting for the confirmation 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= on status Disconnected 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Checking 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 host 192.168.D.A:51820 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for wTwglpdwYTfeAObW 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 srflx 192.168.D.A:51820 related 0.0.0.0:51820 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for wTwglpdwYTfeAObWstun:netbird.domain.com:3478 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 relay 192.168.C.A:56674 related 0.0.0.0:53421 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56674 for wTwglpdwYTfeAObW 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56674 for wTwglpdwYTfeAObWstun:netbird.domain.com:3478 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= on status Disconnected 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:732: OnRemoteOffer skipping message from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= on status Disconnected because is not ready 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:256: trying to connect to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=, waiting for the confirmation 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:741: OnRemoteAnswer from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= on status Disconnected 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Checking 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 host 172.21.0.2:51820 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 srflx 192.168.C.B:51820 related 0.0.0.0:51820 2024-08-16T12:50:15Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for OdxTTGpILCpyYJaE 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 relay 192.168.C.A:56417 related 0.0.0.0:39014 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56417 for OdxTTGpILCpyYJaE 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for OdxTTGpILCpyYJaE 2024-08-16T12:50:15Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for OdxTTGpILCpyYJaEturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:56417 for OdxTTGpILCpyYJaEturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:15Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for OdxTTGpILCpyYJaEturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Failed 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:496: trying to cleanup 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:27Z DEBG iface/iface.go:101: Removing peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= from interface utun4 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Closed 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:554: cleaned up connection to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:27Z DEBG client/internal/engine.go:990: connection to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= failed: connecting canceled by caller 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Failed 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:496: trying to cleanup cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:27Z DEBG iface/iface.go:101: Removing peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= from interface utun4 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Closed 2024-08-16T12:50:27Z DEBG client/internal/peer/conn.go:554: cleaned up connection to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:27Z DEBG client/internal/engine.go:990: connection to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= failed: connecting canceled by caller 2024-08-16T12:50:28Z DEBG client/internal/peer/conn.go:256: trying to connect to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:28Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=, waiting for the confirmation 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= on status Disconnected 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:654: sending answer to 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:639: peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= ICE ConnectionState has changed to Checking 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 host 192.168.D.A:51820 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for ydeMjPXdApcEywGa 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 srflx 192.168.D.A:51820 related 0.0.0.0:51820 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM=] 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer 3K2zhU9FvAH6QyLBZo3lL402UEH9Z7JmpOGr1su4NRM= -> udp4 relay 192.168.C.A:57736 related 0.0.0.0:62875 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:57736 for ydeMjPXdApcEywGa 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.D.A:51820 for ydeMjPXdApcEywGaturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:57736 for ydeMjPXdApcEywGaturn:netbird.domain.com:3478?transport=udp 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:256: trying to connect to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:288: connection offer sent to peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=, waiting for the confirmation 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:726: OnRemoteOffer from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= on status Disconnected 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:654: sending answer to cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:309: received connection confirmation from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= running version 0.28.7 and with remote WireGuard listen port 51820 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:639: peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= ICE ConnectionState has changed to Checking 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 host 10.0.49.243:51820 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 host 172.21.0.2:51820 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for GkOYljPHShsitgcV 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 srflx 192.168.C.B:51820 related 0.0.0.0:51820 2024-08-16T12:50:29Z TRAC signal/client/grpc.go:389: received a new message from Peer [fingerprint: cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw=] 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 172.21.0.2:51820 for GkOYljPHShsitgcVstun:netbird.domain.com:3478 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:603: discovered local candidate udp4 srflx self-hosted-perimeter-ip:51820 related 0.0.0.0:51820 2024-08-16T12:50:29Z DEBG client/internal/peer/conn.go:755: OnRemoteCandidate from peer cHG8vnyUbRPrIvvWSItZn5u+VF66kBsH+Ib5UARC4xw= -> udp4 relay 192.168.C.A:55261 related 0.0.0.0:48334 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for GkOYljPHShsitgcV 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.B:51820 for GkOYljPHShsitgcVstun:netbird.domain.com:3478 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:55261 for GkOYljPHShsitgcV 2024-08-16T12:50:29Z DEBG iface/bind/udp_mux.go:346: ICE: registered 192.168.C.A:55261 for GkOYljPHShsitgcVstun:netbird.domain.com:3478

collse commented 3 months ago

just saw a reference https://github.com/netbirdio/netbird/issues/1453

collse commented 3 months ago

closing