paritytech / polkadot-sdk

The Parity Polkadot Blockchain SDK
https://polkadot.network/
1.79k stars 645 forks source link

Discovered new external address for our node with unwanted IP address #2523

Closed hitchhooker closed 5 months ago

hitchhooker commented 9 months ago

Is there an existing issue?

Experiencing problems? Have you tried our Stack Exchange first?

Description of bug

All my nodes in Bangkok are suddenly being discovered with @miloskriz ip address(138.59.133.242) in Costa Rica and I can't think any way to make it stop.

There is not existing any wireguard/vpn between us and only connecting factor I can think of is geodns for rpc.dotters.network && rpc.ibp.network.

Also @paulormart was reporting the same happening on his nodes.

Is there any flag in polkadot to mitigate this or control what IP address my node advertises itself with. Feels a bit problematic if my validators have 350ms overhead on top of being hosted in region with barely any peers.

Nov 28 17:33:07 dot14 systemd[1]: polkadot.service: Consumed 27.319s CPU time.
Nov 28 17:33:07 dot14 systemd[1]: Started polkadot.service - "dot14 bootnode - Polkadot service".
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 Parity Polkadot
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 ✌️  version 1.4.0-00395a23d12
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 ❤️  by Parity Technologies <admin@parity.io>, 2017-2023
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 📋 Chain specification: Polkadot
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 🏷  Node name: Rotko Networks - dot14 Bootnode
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 👤 Role: FULL
Nov 28 17:33:07 dot14 polkadot[1293605]: 2023-11-28 17:33:07 💾 Database: ParityDb at /opt/polkadot/chains/polkadot/paritydb/full
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 Can't use warp sync mode with a partially synced database. Reverting to full sync mode.
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 🏷  Local node identity is: 12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/35214/wss/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Operating system: linux
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 CPU architecture: x86_64
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Target environment: gnu
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 CPU: AMD Ryzen 9 7950X 16-Core Processor
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 CPU cores: 4
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Memory: 16384MB
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Kernel: 6.2.16-10-pve
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Linux distribution: Debian GNU/Linux 12 (bookworm)
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 💻 Virtual machine: no
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 📦 Highest known block at #18363882
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 〽️ Prometheus exporter started at 0.0.0.0:7214
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 Running JSON-RPC server: addr=0.0.0.0:9214, allowed origins=["*"]
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx /ip4/192.168.69.14/tcp/33314
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx /ip4/192.168.69.14/tcp/34314/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa /ip4/192.168.69.124/tcp/33124
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7 /ip4/192.168.69.241/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx /ip4/192.168.69.34/tcp/34334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx /ip4/192.168.69.34/tcp/33334
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg /ip4/192.168.69.240/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1 /ip4/192.168.69.242/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu /ip4/192.168.69.242/tcp/34524/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu /ip4/192.168.69.242/tcp/33524
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN /ip4/192.168.69.243/tcp/34534/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN /ip4/192.168.69.243/tcp/33534
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW /ip4/192.168.69.241/tcp/34514/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW /ip4/192.168.69.241/tcp/33514
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ /ip4/192.168.69.240/tcp/34504/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ /ip4/192.168.69.240/tcp/33504
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc /ip4/192.168.69.23/tcp/33323
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc /ip4/192.168.69.23/tcp/34323/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ /ip4/192.168.69.234/tcp/34234/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ /ip4/192.168.69.234/tcp/33234
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU /ip4/192.168.69.24/tcp/33324
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU /ip4/192.168.69.24/tcp/34324/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4 /ip4/192.168.69.243/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK /ip4/192.168.69.121/tcp/33121
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37 /ip4/192.168.69.249/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e /ip4/192.168.69.111/tcp/33111
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX /ip4/192.168.69.245/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK /ip4/192.168.69.122/tcp/33122
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr /ip4/192.168.69.249/tcp/34593/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr /ip4/192.168.69.249/tcp/33593
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66 /ip4/192.168.69.245/tcp/34553/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66 /ip4/192.168.69.245/tcp/33553
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH /ip4/192.168.69.112/tcp/33112
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD /ip4/192.168.69.246/tcp/33563
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD /ip4/192.168.69.246/tcp/34563/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw /ip4/192.168.69.244/tcp/33543
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw /ip4/192.168.69.244/tcp/34543/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr /ip4/192.168.69.13/tcp/34313/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr /ip4/192.168.69.13/tcp/33313
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25 /ip4/192.168.69.246/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN /ip4/192.168.69.33/tcp/34333/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN /ip4/192.168.69.33/tcp/33333
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK /ip4/192.168.69.224/tcp/33224
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK /ip4/192.168.69.224/tcp/34224/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD /ip4/192.168.69.244/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt /ip4/192.168.69.247/tcp/30334/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH /ip4/192.168.69.247/tcp/34573/ws
Nov 28 17:33:11 dot14 polkadot[1293605]: 2023-11-28 17:33:11 discovered: 12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH /ip4/192.168.69.247/tcp/33573
Nov 28 17:33:12 dot14 polkadot[1293605]: 2023-11-28 17:33:12 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:12 dot14 polkadot[1293605]: 2023-11-28 17:33:12 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:12 dot14 polkadot[1293605]: 2023-11-28 17:33:12 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 17:33:12 dot14 polkadot[1293605]: 2023-11-28 17:33:12 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
[Unit]
Description="dot14 bootnode - Polkadot service"
After=network-online.target
Wants=network-online.target

[Service]
User=polkadot
Group=polkadot
ExecStart=/opt/polkadot/polkadot \
  --name "Rotko Networks - dot14 Bootnode" \
  --chain polkadot \
  --base-path /opt/polkadot \
  --database paritydb \
  --state-pruning 256 \
  --log sync=warn,afg=warn,babe=warn \
  --telemetry-url 'wss://telemetry-backend.w3f.community/submit 1' \
  --telemetry-url 'wss://telemetry.polkadot.io/submit/ 1' \
  --listen-addr /ip4/192.168.69.214/tcp/33214 \
  --listen-addr /ip4/192.168.69.214/tcp/34214/ws \
  --public-addr /dns/dot14.rotko.net/tcp/33214 \
  --public-addr /dns/dot14.rotko.net/tcp/34214/ws \
  --public-addr /dns/dot14.rotko.net/tcp/35214/wss \
  --rpc-port 9214 \
  --prometheus-port 7214 \
  --wasm-execution Compiled \
  --sync warp \
  --no-hardware-benchmarks \
  --no-beefy \
  --rpc-external \
  --rpc-methods safe \
  --prometheus-external \
  --rpc-cors all \
  --allow-private-ipv4

Restart=always
RestartSec=120

[Install]
WantedBy=multi-user.target
TASK [Print external addresses in JSON format without duplicates] ********************************************************************
ok: [ksm01] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33121/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK",
        "/ip4/27.131.160.106/tcp/33121/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK"
    ]
ok: [dot01] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e",
        "/ip4/27.131.160.106/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e"
    ]
ok: [ksm02] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33122/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK",
        "/ip4/27.131.160.106/tcp/33122/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK"
    ]
ok: [dot02] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33112/p2p/12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH",
        "/ip4/27.131.160.106/tcp/33112/p2p/12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH"
    ]
ok: [dot23] =>
  msg: |-
    [
        "/dns/dot23.rotko.net/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/dns/dot23.rotko.net/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/dns/dot23.rotko.net/tcp/35313/wss/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/138.59.133.242/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/138.59.133.242/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/27.131.160.106/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/27.131.160.106/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr"
    ]
ok: [ksm23] =>
  msg: |-
    [
        "/dns/ksm23.rotko.net/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/dns/ksm23.rotko.net/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/dns/ksm23.rotko.net/tcp/35323/wss/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/138.59.133.242/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/138.59.133.242/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/27.131.160.106/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/27.131.160.106/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc"
    ]
ok: [wnd23] =>
  msg: |-
    [
        "/dns/wnd23.rotko.net/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/dns/wnd23.rotko.net/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/dns/wnd23.rotko.net/tcp/35333/wss/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/138.59.133.242/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/138.59.133.242/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/27.131.160.106/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/27.131.160.106/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN"
    ]
ok: [dot24] =>
  msg: |-
    [
        "/dns/dot24.rotko.net/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/dns/dot24.rotko.net/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/dns/dot24.rotko.net/tcp/35314/wss/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/138.59.133.242/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/138.59.133.242/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/27.131.160.106/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/27.131.160.106/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx"
    ]
ok: [dot14] =>
  msg: |-
    [
        "/dns/dot14.rotko.net/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/dns/dot14.rotko.net/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/dns/dot14.rotko.net/tcp/35214/wss/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/138.59.133.242/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/138.59.133.242/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/27.131.160.106/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/27.131.160.106/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff"
    ]
ok: [ksm04] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33124/p2p/12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa",
        "/ip4/27.131.160.106/tcp/33124/p2p/12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa"
    ]
ok: [ksm14] =>
  msg: |-
    [
        "/dns/ksm14.rotko.net/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/dns/ksm14.rotko.net/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/dns/ksm14.rotko.net/tcp/35224/wss/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/138.59.133.242/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/138.59.133.242/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/27.131.160.106/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/27.131.160.106/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK"
    ]
ok: [ksm24] =>
  msg: |-
    [
        "/dns/ksm24.rotko.net/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/dns/ksm24.rotko.net/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/dns/ksm24.rotko.net/tcp/35324/wss/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/138.59.133.242/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/138.59.133.242/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/27.131.160.106/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/27.131.160.106/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU"
    ]
ok: [wnd14] =>
  msg: |-
    [
        "/dns/wnd14.rotko.net/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/dns/wnd14.rotko.net/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/dns/wnd14.rotko.net/tcp/35234/wss/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/138.59.133.242/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/138.59.133.242/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/27.131.160.106/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/27.131.160.106/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ"
    ]
ok: [wnd24] =>
  msg: |-
    [
        "/dns/wnd24.rotko.net/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/dns/wnd24.rotko.net/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/dns/wnd24.rotko.net/tcp/35334/wss/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/138.59.133.242/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/138.59.133.242/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/27.131.160.106/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/27.131.160.106/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx"
    ]
ok: [mint14] =>
  msg: |-
    [
        "/dns/mint14.rotko.net/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/dns/mint14.rotko.net/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/dns/mint14.rotko.net/tcp/35514/wss/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7",
        "/ip4/138.59.133.242/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/138.59.133.242/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7",
        "/ip4/27.131.160.106/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/27.131.160.106/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW"
    ]
ok: [pbr13] =>
  msg: |-
    [
        "/dns/pbr13.rotko.net/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/dns/pbr13.rotko.net/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/dns/pbr13.rotko.net/tcp/35543/wss/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD",
        "/ip4/138.59.133.242/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/138.59.133.242/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD",
        "/ip4/27.131.160.106/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/27.131.160.106/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw"
    ]
ok: [pch13] =>
  msg: |-
    [
        "/dns/pch13.rotko.net/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/dns/pch13.rotko.net/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/dns/pch13.rotko.net/tcp/35573/wss/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt",
        "/ip4/138.59.133.242/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/138.59.133.242/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt",
        "/ip4/27.131.160.106/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/27.131.160.106/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH"
    ]
ok: [mine14] =>
  msg: |-
    [
        "/dns/mine14.rotko.net/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/dns/mine14.rotko.net/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/dns/mine14.rotko.net/tcp/35524/wss/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1",
        "/ip4/138.59.133.242/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/138.59.133.242/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1",
        "/ip4/27.131.160.106/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/27.131.160.106/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu"
    ]
ok: [kbr13] =>
  msg: |-
    [
        "/dns/kbr13.rotko.net/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/dns/kbr13.rotko.net/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/dns/kbr13.rotko.net/tcp/35553/wss/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX",
        "/ip4/138.59.133.242/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/138.59.133.242/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX",
        "/ip4/27.131.160.106/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/27.131.160.106/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66"
    ]
ok: [wmint14] =>
  msg: |-
    [
        "/dns/wmint14.rotko.net/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/dns/wmint14.rotko.net/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/dns/wmint14.rotko.net/tcp/35534/wss/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4",
        "/ip4/138.59.133.242/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/138.59.133.242/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4",
        "/ip4/27.131.160.106/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/27.131.160.106/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN"
    ]
ok: [wbr13] =>
  msg: |-
    [
        "/dns/wbr13.rotko.net/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/dns/wbr13.rotko.net/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/dns/wbr13.rotko.net/tcp/35563/wss/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25",
        "/ip4/138.59.133.242/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/138.59.133.242/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25",
        "/ip4/27.131.160.106/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/27.131.160.106/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD"
    ]
ok: [wch13] =>
  msg: |-
    [
        "/dns/wch13.rotko.net/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/dns/wch13.rotko.net/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/dns/wch13.rotko.net/tcp/35593/wss/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37",
        "/ip4/138.59.133.242/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/138.59.133.242/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37",
        "/ip4/27.131.160.106/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/27.131.160.106/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr"
    ]
ok: [enc14] =>
  msg: |-
    [
        "/dns/enc14.rotko.net/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/dns/enc14.rotko.net/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/dns/enc14.rotko.net/tcp/35504/wss/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg",
        "/ip4/138.59.133.242/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/138.59.133.242/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg",
        "/ip4/27.131.160.106/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/27.131.160.106/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ"
    ]

Steps to reproduce

No response

altonen commented 9 months ago

Did dns.rotko14.net at any point resolve to 138.59.133.242? Could be a caching issue, something we don't really have any control over.

Does the issue disappear if you start your node with the actual public address instead of using a DNS address?

hitchhooker commented 9 months ago

I blocked p2p ports for that IP address for now to not cause any fuckups on my validator performance, but would be nice to if there was some better way to control what IP address my node is discoverable.

chain=output action=drop protocol=tcp dst-address=138.59.133.242 port=31000-36000
chain=input action=drop protocol=tcp src-address=138.59.133.242 port=31000-36000

Did dns.rotko14.net at any point resolve to 138.59.133.242? Could be a caching issue, something we don't really have any control over.

I have never had that IP in my dns setups. But that IP is hosting rpc.dotters.network dns that has my IP in there.

Does the issue disappear if you start your node with the actual public address instead of using a DNS address?

Yes

Nov 28 19:34:24 dot14 polkadot[1294045]: 2023-11-28 19:34:24 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 19:34:24 dot14 polkadot[1294045]: 2023-11-28 19:34:24 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 19:34:24 dot14 polkadot[1294045]: 2023-11-28 19:34:24 ✨ Imported #18365095 (0xe2ca…c7db)
Nov 28 19:34:24 dot14 polkadot[1294045]: 2023-11-28 19:34:24 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 19:34:24 dot14 polkadot[1294045]: 2023-11-28 19:34:24 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 19:34:25 dot14 polkadot[1294045]: 2023-11-28 19:34:25 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 19:34:25 dot14 polkadot[1294045]: 2023-11-28 19:34:25 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
root@dot14:/opt/polkadot# cat polkadot.service
[Unit]
Description="dot14 bootnode - Polkadot service"
After=network-online.target
Wants=network-online.target

[Service]
User=polkadot
Group=polkadot
ExecStart=/opt/polkadot/polkadot \
  --name "Rotko Networks - dot14 Bootnode" \
  --chain polkadot \
  --base-path /opt/polkadot \
  --database paritydb \
  --state-pruning 256 \
  --log sync=warn,afg=warn,babe=warn \
  --telemetry-url 'wss://telemetry-backend.w3f.community/submit 1' \
  --telemetry-url 'wss://telemetry.polkadot.io/submit/ 1' \
  --listen-addr /ip4/192.168.69.214/tcp/33214 \
  --listen-addr /ip4/192.168.69.214/tcp/34214/ws \
  --rpc-port 9214 \
  --prometheus-port 7214 \
  --wasm-execution Compiled \
  --sync warp \
  --no-hardware-benchmarks \
  --no-beefy \
  --rpc-external \
  --rpc-methods safe \
  --prometheus-external \
  --rpc-cors all \
  --allow-private-ipv4

Restart=always
RestartSec=120

[Install]
WantedBy=multi-user.target
altonen commented 9 months ago

If the DNS address given via --public-address resolves to a wrong IP address, there's very little we can do on the node side because that's essentially the address that is advertised to other peers on the network. I don't think this is a bug in Polkadot SDK/libp2p so this can be closed, yes?

hitchhooker commented 9 months ago
root@dot14:/etc/systemd/system# cat polkadot.service
[Unit]
Description="dot14 bootnode - Polkadot service"
After=network-online.target
Wants=network-online.target

[Service]
User=polkadot
Group=polkadot
ExecStart=/opt/polkadot/polkadot \
  --name "Rotko Networks - dot14 Bootnode" \
  --chain polkadot \
  --base-path /opt/polkadot \
  --database paritydb \
  --state-pruning 256 \
  --log sync=warn,afg=warn,babe=warn \
  --telemetry-url 'wss://telemetry-backend.w3f.community/submit 1' \
  --telemetry-url 'wss://telemetry.polkadot.io/submit/ 1' \
  --listen-addr /ip4/192.168.69.214/tcp/33214 \
  --listen-addr /ip4/192.168.69.214/tcp/34214/ws \
  --public-addr /ip4/27.131.160.106/tcp/33214 \
  --public-addr /ip4/27.131.160.106/tcp/34214/ws \
  --rpc-port 9214 \
  --prometheus-port 7214 \
  --wasm-execution Compiled \
  --sync warp \
  --no-hardware-benchmarks \
  --no-beefy \
  --rpc-external \
  --rpc-methods safe \
  --prometheus-external \
  --rpc-cors all \
  --allow-private-ipv4

Restart=always
RestartSec=120

[Install]
WantedBy=multi-user.target
root@dot14:/etc/systemd/system# systemctl restart polkadot
root@dot14:/etc/systemd/system# journalctl -fu polkadot
Nov 28 20:55:50 dot14 systemd[1]: Stopped polkadot.service - "dot14 bootnode - Polkadot service".
Nov 28 20:55:50 dot14 systemd[1]: polkadot.service: Consumed 33.411s CPU time.
Nov 28 20:55:50 dot14 systemd[1]: Started polkadot.service - "dot14 bootnode - Polkadot service".
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 Parity Polkadot
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 ✌️  version 1.4.0-00395a23d12
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 ❤️  by Parity Technologies <admin@parity.io>, 2017-2023
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 📋 Chain specification: Polkadot
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 🏷  Node name: Rotko Networks - dot14 Bootnode
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 👤 Role: FULL
Nov 28 20:55:50 dot14 polkadot[1294898]: 2023-11-28 20:55:50 💾 Database: ParityDb at /opt/polkadot/chains/polkadot/paritydb/full
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 Can't use warp sync mode with a partially synced database. Reverting to full sync mode.
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 🏷  Local node identity is: 12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 🔍 Discovered new external address for our node: /ip4/27.131.160.106/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Operating system: linux
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 CPU architecture: x86_64
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Target environment: gnu
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 CPU: AMD Ryzen 9 7950X 16-Core Processor
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 CPU cores: 4
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Memory: 16384MB
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Kernel: 6.2.16-10-pve
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Linux distribution: Debian GNU/Linux 12 (bookworm)
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 💻 Virtual machine: no
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 📦 Highest known block at #18365909
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 〽️ Prometheus exporter started at 0.0.0.0:7214
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 Running JSON-RPC server: addr=0.0.0.0:9214, allowed origins=["*"]
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1 /ip4/192.168.69.242/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7 /ip4/192.168.69.241/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu /ip4/192.168.69.242/tcp/33524
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu /ip4/192.168.69.242/tcp/34524/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa /ip4/192.168.69.124/tcp/33124
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH /ip4/192.168.69.112/tcp/33112
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx /ip4/192.168.69.34/tcp/33334
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx /ip4/192.168.69.34/tcp/34334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW /ip4/192.168.69.241/tcp/34514/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW /ip4/192.168.69.241/tcp/33514
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg /ip4/192.168.69.240/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU /ip4/192.168.69.24/tcp/34324/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU /ip4/192.168.69.24/tcp/33324
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ /ip4/192.168.69.240/tcp/34504/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ /ip4/192.168.69.240/tcp/33504
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN /ip4/192.168.69.243/tcp/34534/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN /ip4/192.168.69.243/tcp/33534
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK /ip4/192.168.69.224/tcp/34224/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK /ip4/192.168.69.224/tcp/33224
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD /ip4/192.168.69.246/tcp/34563/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD /ip4/192.168.69.246/tcp/33563
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ /ip4/192.168.69.234/tcp/34234/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ /ip4/192.168.69.234/tcp/33234
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66 /ip4/192.168.69.245/tcp/33553
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66 /ip4/192.168.69.245/tcp/34553/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK /ip4/192.168.69.121/tcp/33121
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw /ip4/192.168.69.244/tcp/34543/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw /ip4/192.168.69.244/tcp/33543
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX /ip4/192.168.69.245/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25 /ip4/192.168.69.246/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH /ip4/192.168.69.247/tcp/34573/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH /ip4/192.168.69.247/tcp/33573
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK /ip4/192.168.69.122/tcp/33122
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD /ip4/192.168.69.244/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt /ip4/192.168.69.247/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr /ip4/192.168.69.13/tcp/33313
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr /ip4/192.168.69.13/tcp/34313/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37 /ip4/192.168.69.249/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc /ip4/192.168.69.23/tcp/33323
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc /ip4/192.168.69.23/tcp/34323/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN /ip4/192.168.69.33/tcp/33333
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN /ip4/192.168.69.33/tcp/34333/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e /ip4/192.168.69.111/tcp/33111
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr /ip4/192.168.69.249/tcp/34593/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr /ip4/192.168.69.249/tcp/33593
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4 /ip4/192.168.69.243/tcp/30334/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx /ip4/192.168.69.14/tcp/34314/ws
Nov 28 20:55:55 dot14 polkadot[1294898]: 2023-11-28 20:55:55 discovered: 12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx /ip4/192.168.69.14/tcp/33314
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 ✨ Imported #18365910 (0xd5a1…dac5)
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 ✨ Imported #18365911 (0x49ab…d6ca)
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff
Nov 28 20:55:56 dot14 polkadot[1294898]: 2023-11-28 20:55:56 🔍 Discovered new external address for our node: /dns/dot14.rotko.net/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff

like removing whole dns with --public-address and traffic keeps still coming in. shouldn't I have some to decide whats my address in the network? im just worried that my validators wont be able to perform correctly if traffic gets routed through +500ms latencies. I really do not have enough understanding about how the p2p discovery and networking works.

hitchhooker commented 9 months ago
6055 🕸 polkadot --chain polkadot --base-path /tmp/node --name "Boot" --reserved-only --reserved-nodes "/dns/ibp-boot-polkadot.luckyfriday.io/tcp/30334/wss/p2p/12D3KooWEjk6QXrZJ26fLpaajisJGHiz6WiQsR8k7mkM9GmWKnRZ" --no-hardware-benchmarks
2023-11-28 21:07:20 Parity Polkadot
2023-11-28 21:07:20 ✌️  version 1.0.0-1ed6e2e50a4
2023-11-28 21:07:20 ❤️  by Parity Technologies <admin@parity.io>, 2017-2023
2023-11-28 21:07:20 📋 Chain specification: Polkadot
2023-11-28 21:07:20 🏷  Node name: Boot
2023-11-28 21:07:20 👤 Role: FULL
2023-11-28 21:07:20 💾 Database: RocksDb at /tmp/node/chains/polkadot/db/full
2023-11-28 21:07:21 🏷  Local node identity is: 12D3KooWLynADejYXRPi6dkXgp2FRxNAAmZ6tBsncoCa81mjsCmp
2023-11-28 21:07:21 💻 Operating system: linux
2023-11-28 21:07:21 💻 CPU architecture: x86_64
2023-11-28 21:07:21 💻 Target environment: gnu
2023-11-28 21:07:21 💻 CPU: AMD Ryzen 9 7940HS w/ Radeon 780M Graphics
2023-11-28 21:07:21 💻 CPU cores: 8
2023-11-28 21:07:21 💻 Memory: 60007MB
2023-11-28 21:07:21 💻 Kernel: 6.6.0-AMD
2023-11-28 21:07:21 💻 Linux distribution: EndeavourOS
2023-11-28 21:07:21 💻 Virtual machine: no
2023-11-28 21:07:21 📦 Highest known block at #1280
2023-11-28 21:07:21 〽️ Prometheus exporter started at 127.0.0.1:9615
2023-11-28 21:07:21 Running JSON-RPC server: addr=127.0.0.1:9944, allowed origins=["http://localhost:*", "http://127.0.0.1:*", "https://localhost:*", "https://127.0.0.1:*", "https://polkadot.js.org"]
2023-11-28 21:07:22 🔍 Discovered new external address for our node: /ip4/171.96.224.220/tcp/30333/ws/p2p/12D3KooWLynADejYXRPi6dkXgp2FRxNAAmZ6tBsncoCa81mjsCmp
2023-11-28 21:07:23 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/30333/ws/p2p/12D3KooWLynADejYXRPi6dkXgp2FRxNAAmZ6tBsncoCa81mjsCmp
2023-11-28 21:07:26 ⚙️  Syncing, target=#18366025 (1 peers), best: #1472 (0x4aca…c283), finalized #1024 (0x25a1…88da), ⬇ 20.0kiB/s ⬆ 6.3kiB/s
2023-11-28 21:07:31 ⚙️  Syncing 89.6 bps, target=#18366025 (1 peers), best: #1920 (0x98be…890d), finalized #1536 (0x0029…1bfd), ⬇ 32.8kiB/s ⬆ 0.3kiB/s

even my homepc gets discovered with this ip address and I really cant think of any connection this machine could have with it

hitchhooker commented 9 months ago

https://docs.rs/libp2p/latest/libp2p/swarm/enum.FromSwarm.html#variant.ExternalAddrConfirmed

it looks like that this ExternalAddrConfirmed has been removed in use?

hitchhooker commented 9 months ago

If you want to reproduce the issue:

wget https://github.com/paritytech/polkadot-sdk/releases/download/v1.4.0/polkadot
chmod +x polkadot
./polkadot

tried now in 3 machines that has never run polkadot before and all seem to be identifying with that IP address regardless of location

altonen commented 9 months ago

That's interesting. If those machines truly have no relation to the machine you're running the validator node on, then this seems bizarre. Could you run one of the nodes (not the validator) with -lsub-libp2p,libp2p=trace (probably very chatty) and post the logs so I could take a look at them? You can also check the ping time with nodes by grepping "Ping time with" from the logs.

hitchhooker commented 9 months ago

https://raw.githubusercontent.com/hitchhooker/libp2pdiscovery/main/libp2pdiscovery.log

looks like there is quite a few NodeID/PeerIds with that same IP address like it wouldn't be confirming that nodes have that IP in use.

miloskriz commented 9 months ago

hello everyone.. !

Just throwing my hat here in case you need me to make any changes in my configuration,

I am the operator at 138.59.133.242 and can confirm the following are related my bootnode in the Polkadot relaychain:

/dns/boot-cr.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
/dns/boot-cr.gatotech.network/tcp/34100/ws/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
/dns/boot-cr.gatotech.network/tcp/35100/wss/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w

However, I do not seem to recognize the rest of neither the ports nor the peerIds the multiaddresses in the logs from @hitchhooker, e.g.:

(...)
2023-11-28 17:09:18.874 TRACE tokio-runtime-worker libp2p_kad::behaviour: Peer KadPeer { node_id: PeerId("12D3KooWHwVSEWgMv4VhCugmGDS9eTzfsKe71YKAo6JY7FMRfg14"), multiaddrs: ["/ip4/138.59.133.242/tcp/30333/ws", "/ip4/43.207.205.161/tcp/30333/ws"], connection_ty: Connected } reported by 
(...)
2023-11-28 17:09:18.874 TRACE tokio-runtime-worker libp2p_kad::behaviour: Peer KadPeer { node_id: PeerId("12D3KooWCZKEvAMJRk9nwTHJcTjgVw6bDEqryQ3B7n7scNtfNqPB"), multiaddrs: ["/ip4/192.96.202.170/tcp/10002", "/ip4/192.96.202.161/tcp/10002", "/ip4/138.59.133.242/tcp/10002"], connection_ty: Connected } reported by 
(...)
2023-11-28 17:09:27.497 TRACE tokio-runtime-worker libp2p_identify::protocol: Sending: Info { public_key: Ed25519(PublicKey(compressed): 6ec2cf8bd7f075de6f2d8e12c1514684101b4063b91b17d5bdc870b9e226558d), protocol_version: "/substrate/1.0", agent_version: "Parity Polkadot/v1.4.0-00395a23d12 (heavenly-brake-4488)", listen_addrs: ["/ip6/fe80::9e6b:ff:fe1c:e07a/tcp/30333/ws", "/ip6/::1/tcp/30333/ws", "/ip4/172.17.0.1/tcp/30333/ws", "/ip4/127.0.0.1/tcp/30333/ws", "/ip4/192.168.72.1/tcp/30333/ws", "/ip4/172.17.0.1/tcp/30333/ws", "/ip4/95.216.235.72/tcp/30333/ws", "/ip4/127.0.0.1/tcp/30333/ws", "/ip4/138.59.133.242/tcp/30333/ws", "/ip4/100.64.4.1/tcp/30333/ws"], protocols: ["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1", "/dot/block-announces/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1", "/paritytech/grandpa/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/beefy/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1", "/dot/transactions/1", "/ipfs/ping/1.0.0", "/ipfs/id/1.0.0", "/ipfs/id/push/1.0.0", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad", "/dot/kad", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1", "/polkadot/req_chunk/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2", "/dot/state/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2", "/dot/sync/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp", "/dot/sync/warp", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1", "/polkadot/req_collation/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_attested_candidate/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1", "/polkadot/send_dispute/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1", "/polkadot/req_statement/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/beefy/justifications/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2", "/dot/light/2", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1", "/polkadot/req_pov/1", "/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1", "/polkadot/req_available_data/1"], observed_addr: "/ip4/54.37.194.50/tcp/30334/p2p/12D3KooWAWdraq4JQcWFRgooKZQPEM862cdxUSvDxMT2biKfCxQS" }    
(...)
2023-11-28 17:09:30.000 TRACE tokio-runtime-worker sub-libp2p: Addresses of PeerId("12D3KooWFRbrbwj1U4fAMoeqHbWNKAXXXt8BXAgxDCbamERfcntR"): ["/ip6/2a03:4000:54:fc9:1804:42ff:fe32:1a0f/tcp/27108", "/ip4/202.61.250.225/tcp/27108", "/ip4/138.59.133.242/tcp/27108"] 
(...)
etc...

Please advise if you need me to perform any tests...

Best regards!!

Milos

hitchhooker commented 9 months ago

looks like i have received plenty of new IP addressses for my nodes.

TASK [Print external addresses in JSON format without duplicates] ********************************************************************
ok: [ksm01] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33121/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK",
        "/ip4/27.131.160.106/tcp/33121/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK"
    ]
ok: [dot01] =>
  msg: |-
    [
        "/ip4/103.240.197.4/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e",
        "/ip4/138.59.133.242/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e",
        "/ip4/195.154.196.118/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e",
        "/ip4/27.131.160.106/tcp/33111/p2p/12D3KooWPym3wok5xexbwt1tw4CLoH1j2CdUP6fej8zrw5JVou2e"
    ]
ok: [ksm02] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33122/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK",
        "/ip4/27.131.160.106/tcp/33122/p2p/12D3KooWJiMJDtMx9oC55Vz2NCKKjHKWr7HhwPyFyKUMawQvyQYK"
    ]
ok: [dot02] =>
  msg: |-
    [
        "/ip4/138.59.133.242/tcp/33112/p2p/12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH",
        "/ip4/195.154.196.118/tcp/33112/p2p/12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH",
        "/ip4/27.131.160.106/tcp/33112/p2p/12D3KooWSszWxXzkX7sKoGu9tyw1L829L4DPMRN2emVmqyL5KfqH"
    ]
ok: [dot23] =>
  msg: |-
    [
        "/dns/dot23.rotko.net/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/dns/dot23.rotko.net/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/dns/dot23.rotko.net/tcp/35313/wss/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/138.59.133.242/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/138.59.133.242/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/195.154.196.118/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/195.154.196.118/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/27.131.160.106/tcp/33313/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr",
        "/ip4/27.131.160.106/tcp/34313/ws/p2p/12D3KooWKQ2PXd9WSckBfRHZxBXFYTXoFNucRxixbe1do4Fpbazr"
    ]
ok: [ksm23] =>
  msg: |-
    [
        "/dns/ksm23.rotko.net/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/dns/ksm23.rotko.net/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/dns/ksm23.rotko.net/tcp/35323/wss/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/138.59.133.242/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/138.59.133.242/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/27.131.160.106/tcp/33323/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc",
        "/ip4/27.131.160.106/tcp/34323/ws/p2p/12D3KooWCfKinQjVnYNruazbfYMLZsLZZq8dcuyFemx7dySCQgQc"
    ]
ok: [wnd23] =>
  msg: |-
    [
        "/dns/wnd23.rotko.net/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/dns/wnd23.rotko.net/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/dns/wnd23.rotko.net/tcp/35333/wss/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/138.59.133.242/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/138.59.133.242/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/27.131.160.106/tcp/33333/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN",
        "/ip4/27.131.160.106/tcp/34333/ws/p2p/12D3KooWP4vwqiPkZBmAknjeV9h8dtsPYtHy7ntwyhMea9T7tqeN"
    ]
ok: [ksm04] =>
  msg: |-
    [
        "/ip4/103.240.197.2/tcp/33124/p2p/12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa",
        "/ip4/138.59.133.242/tcp/33124/p2p/12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa",
        "/ip4/27.131.160.106/tcp/33124/p2p/12D3KooWNjLbuLtkU7fnkuiw5uVFoQb1XBUrorskrD6i4aYWXjPa"
    ]
ok: [ksm14] =>
  msg: |-
    [
        "/dns/ksm14.rotko.net/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/dns/ksm14.rotko.net/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/dns/ksm14.rotko.net/tcp/35224/wss/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/138.59.133.242/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/138.59.133.242/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/27.131.160.106/tcp/33224/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK",
        "/ip4/27.131.160.106/tcp/34224/ws/p2p/12D3KooWAa5THTw8HPfnhEei23HdL8P9McBXdozG2oTtMMksjZkK"
    ]
ok: [ksm24] =>
  msg: |-
    [
        "/dns/ksm24.rotko.net/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/dns/ksm24.rotko.net/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/dns/ksm24.rotko.net/tcp/35324/wss/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/103.240.197.2/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/103.240.197.2/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/138.59.133.242/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/138.59.133.242/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/27.131.160.106/tcp/33324/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU",
        "/ip4/27.131.160.106/tcp/34324/ws/p2p/12D3KooWQ7skG3iqLHR68AoxwQKpu8k9Grw8g8XDGTdtVhGpFRgU"
    ]
ok: [dot14] =>
  msg: |-
    [
        "/dns/dot14.rotko.net/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/dns/dot14.rotko.net/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/dns/dot14.rotko.net/tcp/35214/wss/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/138.59.133.242/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/138.59.133.242/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/27.131.160.106/tcp/33214/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff",
        "/ip4/27.131.160.106/tcp/34214/ws/p2p/12D3KooWPyEvPEXghnMC67Gff6PuZiSvfx3fmziKiPZcGStZ5xff"
    ]
ok: [wnd14] =>
  msg: |-
    [
        "/dns/wnd14.rotko.net/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/dns/wnd14.rotko.net/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/dns/wnd14.rotko.net/tcp/35234/wss/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/138.59.133.242/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/138.59.133.242/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/27.131.160.106/tcp/33234/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ",
        "/ip4/27.131.160.106/tcp/34234/ws/p2p/12D3KooWLK8Zj1uZ46phU3vQwiDVda8tB76S8J26rXZQLHpwWkDJ"
    ]
ok: [wnd24] =>
  msg: |-
    [
        "/dns/wnd24.rotko.net/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/dns/wnd24.rotko.net/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/dns/wnd24.rotko.net/tcp/35334/wss/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/138.59.133.242/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/138.59.133.242/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/27.131.160.106/tcp/33334/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx",
        "/ip4/27.131.160.106/tcp/34334/ws/p2p/12D3KooWL6qfvBtQCLJpfu9XpznKPSiL2ANDumWqEhjkavmiGpfx"
    ]
ok: [mint14] =>
  msg: |-
    [
        "/dns/mint14.rotko.net/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/dns/mint14.rotko.net/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/dns/mint14.rotko.net/tcp/35514/wss/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7",
        "/ip4/138.59.133.242/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/138.59.133.242/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/195.154.196.118/tcp/30334/ws/p2p/12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWJxCg4UxAQYuNhPtpeDCQoVjax31sEprXtaDDH79sY1T7",
        "/ip4/27.131.160.106/tcp/33514/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW",
        "/ip4/27.131.160.106/tcp/34514/ws/p2p/12D3KooWKkzLjYF6M5eEs7nYiqEtRqY8SGVouoCwo3nCWsRnThDW"
    ]
ok: [pbr13] =>
  msg: |-
    [
        "/dns/pbr13.rotko.net/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/dns/pbr13.rotko.net/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/dns/pbr13.rotko.net/tcp/35543/wss/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD",
        "/ip4/138.59.133.242/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/138.59.133.242/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/195.154.196.118/tcp/30334/ws/p2p/12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWNgpVoBa8KG32mQhFJyDJrSCYS79UjJ3a37qT3WABCkzD",
        "/ip4/27.131.160.106/tcp/33543/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw",
        "/ip4/27.131.160.106/tcp/34543/ws/p2p/12D3KooWMxZY7tDc2Rh454VaJJ7RexKAXVS6xSBEvTnXSGCnuGDw"
    ]
ok: [pch13] =>
  msg: |-
    [
        "/dns/pch13.rotko.net/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/dns/pch13.rotko.net/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/dns/pch13.rotko.net/tcp/35573/wss/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt",
        "/ip4/138.59.133.242/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/138.59.133.242/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWAgGkiF7mni9sCVazMvm6pXunHx4PiMdVfyo64ACsx4Gt",
        "/ip4/27.131.160.106/tcp/33573/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH",
        "/ip4/27.131.160.106/tcp/34573/ws/p2p/12D3KooWRXudHoazPZ9osMfdY38e8CBxQLD4RhrVeHpRSNNpcDtH"
    ]
ok: [mine14] =>
  msg: |-
    [
        "/dns/mine14.rotko.net/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/dns/mine14.rotko.net/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/dns/mine14.rotko.net/tcp/35524/wss/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/103.240.197.2/tcp/30334/ws/p2p/12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1",
        "/ip4/138.59.133.242/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/138.59.133.242/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWLMhG4prCnYhUsDNGr5Z6JhhJprMKdNk4ujdua2HjVPY1",
        "/ip4/27.131.160.106/tcp/33524/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu",
        "/ip4/27.131.160.106/tcp/34524/ws/p2p/12D3KooWJUFnjR2PNbsJhudwPVaWCoZy1acPGKjM2cSuGj345BBu"
    ]
ok: [kbr13] =>
  msg: |-
    [
        "/dns/kbr13.rotko.net/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/dns/kbr13.rotko.net/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/dns/kbr13.rotko.net/tcp/35553/wss/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX",
        "/ip4/138.59.133.242/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/138.59.133.242/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWMMEdB3YzNb3688JaY942ctSbMw4RLQeCNMv5Je6QrgnX",
        "/ip4/27.131.160.106/tcp/33553/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66",
        "/ip4/27.131.160.106/tcp/34553/ws/p2p/12D3KooWAmBp54mUEYtvsk2kxNEsDbAvdUMcaghxKXgUQxmPEQ66"
    ]
ok: [wmint14] =>
  msg: |-
    [
        "/dns/wmint14.rotko.net/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/dns/wmint14.rotko.net/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/dns/wmint14.rotko.net/tcp/35534/wss/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4",
        "/ip4/138.59.133.242/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/138.59.133.242/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWNHQ3jdo3X2EDRAVAcC4N5DPyLeDH17Tw69uQkgUcjqV4",
        "/ip4/27.131.160.106/tcp/33534/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN",
        "/ip4/27.131.160.106/tcp/34534/ws/p2p/12D3KooWE4UDXqgtTcMCyUQ8S4uvaT8VMzzTBA6NWmKuYwTacWuN"
    ]
ok: [wbr13] =>
  msg: |-
    [
        "/dns/wbr13.rotko.net/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/dns/wbr13.rotko.net/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/dns/wbr13.rotko.net/tcp/35563/wss/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25",
        "/ip4/138.59.133.242/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/138.59.133.242/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWCpsdsaVddAwzn2E4Hh8Y7fmacVzYHeHqJdc3T8q4gp25",
        "/ip4/27.131.160.106/tcp/33563/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD",
        "/ip4/27.131.160.106/tcp/34563/ws/p2p/12D3KooWJyeRHpxZZbfBCNEgeUFzmRC5AMSAs2tJhjJS1k5hULkD"
    ]
ok: [wch13] =>
  msg: |-
    [
        "/dns/wch13.rotko.net/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/dns/wch13.rotko.net/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/dns/wch13.rotko.net/tcp/35593/wss/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37",
        "/ip4/138.59.133.242/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/138.59.133.242/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWFeAndoc6MgCV39hG9xtTzfEdG73ocfZV3M9U14KGyh37",
        "/ip4/27.131.160.106/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/27.131.160.106/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/35.209.155.60/tcp/33593/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr",
        "/ip4/35.209.155.60/tcp/34593/ws/p2p/12D3KooWPG85zhuSRoyptjLkFD4iJFistjiBmc15JgQ96B4fdXYr"
    ]
ok: [enc14] =>
  msg: |-
    [
        "/dns/enc14.rotko.net/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/dns/enc14.rotko.net/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/dns/enc14.rotko.net/tcp/35504/wss/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/138.59.133.242/tcp/30334/ws/p2p/12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg",
        "/ip4/138.59.133.242/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/138.59.133.242/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/27.131.160.106/tcp/30334/ws/p2p/12D3KooWQtiSmeSw33W5TrFy8iM95p6f4jHxrdEFm2aGAQXhD3Qg",
        "/ip4/27.131.160.106/tcp/33504/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ",
        "/ip4/27.131.160.106/tcp/34504/ws/p2p/12D3KooWJ3327ZoZcR96pToGsXa8Xbehh8z25daxYseYXF46UDCZ"
    ]
ok: [dot24] =>
  msg: |-
    [
        "/dns/dot24.rotko.net/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/dns/dot24.rotko.net/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/dns/dot24.rotko.net/tcp/35314/wss/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/103.240.197.4/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/103.240.197.4/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/138.59.133.242/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/138.59.133.242/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/27.131.160.106/tcp/33314/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx",
        "/ip4/27.131.160.106/tcp/34314/ws/p2p/12D3KooWDJE2jiy1meN9BebkRUEv5eB6YQNNBT9cXtbCpT4wK8Bx"
    ]
altonen commented 9 months ago

I looked into the logs and there's definitely something weird happening. The external address 138.59.133.242 is observed by a GATOTECH node and only by that (at least in this short snippet).

What is weird is that boot-cr.gatotech.network, the address your node used to dial the GATOTECH node, resolves to 138.59.133.242 but then the GATOTECH node observes that as your node's external address.

sub-libp2p: Addresses of PeerId("12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w"): ["/dns/boot-cr.gatotech.network/tcp/33100", "/dns/boot-cr.gatotech.network/tcp/35100/wss", "/dns/boot-cr.gatotech.network/tcp/33100", "/dns/boot-cr.gatotech.network/tcp/35100/wss"]    
sub-libp2p: Libp2p => Dialing(PeerId("12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w"))    
libp2p_websocket::framed: Dialing websocket address: WsAddress { host_port: "boot-cr.gatotech.network:35100", path: "/", dns_name: Some(DnsName(DnsName(DnsName("boot-cr.gatotech.network")))), use_tls: true, tcp_addr: "/dns/boot-cr.gatotech.network/tcp/35100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w" }    
libp2p_dns: Dialing /ip4/138.59.133.242/tcp/35100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w    
libp2p_dns: Dialing /ip4/138.59.133.242/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w    
libp2p_swarm: Connection established: PeerId("12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w") Dialer { address: "/dns/boot-cr.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w", role_override: Dialer }; Total (peer): 1.    
...
sub-libp2p: Identified PeerId(...) => Info { public_key: ..., protocol_version: ..., agent_version: ..., listen_addrs: [...], protocols: [...], observed_addr: "/ip4/138.59.133.242/tcp/41500" }    

So looks like it's reporting its own address as your external address. Without the logs from the GATOTECH node it's very hard to say what the problem is. Maybe there's a malfunctioning proxy or something and the GATOTECH is reported the IP address of the DNS address it's behind (instead of your actual address), assumes that to be your address and reports it as the observed address.

We could introduce a mode in sc-network where external address confirmations are ignored. You could still specify external addresses for your node but any confirmations we receive from peers would be discarded. This could potentially help with your issue.

miloskriz commented 9 months ago

hello @altonen , @hitchhooker ,

Just to try shed more light on the issue, please consider the following information about boot-cr.gatotech.network.

HAPROXY config (redacted for brevity):

###
# HAPROXY CONFIGURATION FILE
###

global

###
# Standard Settings
###

   # Basic configuration
   log /dev/log    local0
   log /dev/log    local1 notice
   chroot /var/lib/haproxy
   stats socket /run/haproxy/admin.sock mode 600 level admin
   stats timeout 30s
   user  haproxy
   group haproxy
   daemon

   # Default SSL material locations
   ca-base /etc/ssl/certs
   crt-base /etc/ssl/private

###
# HTTP - Default Values
###

defaults
   log     global
   mode    http
   retries 3
   option  httpslog
   option  dontlognull
   option  forwardfor

###
# HTTP - HTTPS Frontends
###

frontend fe-ssl
   bind *:443 ssl crt /etc/ssl/private

   ## Evaluate ACLs (Access Control Lists) ##

   # Check if asking for Websites
   acl is_website   hdr(host) -i www.page.com

   # Check if asking for RPCs
   acl is_rpc       hdr(host) -i rpc.ibp.network -i sys.ibp.network -i rpc.dotters.network -i sys.dotters.network -i rpc.gatotech.network -i sys.gatotech.network

   # Discriminate paths for Polkadot chains
   acl is_dot       path_beg -i /polkadot
   acl is_dot_asset path_beg -i /asset-hub-polkadot   -i /statemint
   acl is_dot_collt path_beg -i /collectives-polkadot
   acl is_dot_bridg path_beg -i /bridge-hub-polkadot  -i /bridgehub-polkadot

   ## Organise backends ##

   # Websites
   use_backend be-webserver     if is_website

   # Polkadot
   use_backend be-dot-rpc       if is_rpc is_dot
   use_backend be-dot-asset-rpc if is_rpc is_dot_asset
   use_backend be-dot-collt-rpc if is_rpc is_dot_collt
   use_backend be-dot-bridg-rpc if is_rpc is_dot_bridg

###
# HTTP - HTTPS Backends
###

# Webserver backend
backend be-webserver
   server webserver 172.16.16.2:80 check

# Polkadot' chains backends

backend be-dot-rpc
   option http-server-close
   server dot-rpc1 172.16.16.101:9944 check
   server dot-rpc2 172.16.16.102:9944 check

backend be-dot-asset-rpc
   option http-server-close
   server dot-asset-rpc1 172.16.16.111:9944 check
   server dot-asset-rpc2 172.16.16.112:9944 check

backend be-dot-collt-rpc
   option http-server-close
   server dot-collt-rpc1 172.16.16.121:9944 check
   server dot-collt-rpc2 172.16.16.122:9944 check

backend be-dot-bridg-rpc
   option http-server-close
   server dot-bridg-rpc1 172.16.16.131:9944 check
   server dot-bridg-rpc2 172.16.16.132:9944 check

####
# HTTP - Bootnodes' listeners over P2P/Websockets
####

# Polkadot relay and system chains

listen li-dot-boot-p2pWS
   bind *:34100
   bind *:35100 ssl crt /etc/ssl/private
   server dot-boot-p2pWS 172.16.16.100:34100 check

listen li-dot-asset-boot-p2pWS
   bind *:34110
   bind *:35110 ssl crt /etc/ssl/private
   server dot-asset-boot-p2pWS 172.16.16.110:34110 check

listen li-dot-collt-boot-p2pWS
   bind *:34120
   bind *:35120 ssl crt /etc/ssl/private
   server dot-collt-boot-p2pWS 172.16.16.120:34120 check

listen li-dot-bridg-boot-p2pWS
   bind *:34130
   bind *:35130 ssl crt /etc/ssl/private
   server dot-bridg-boot-p2pWS 172.16.16.130:34130 check

###
# TCP MODE
###

###
# TCP - Default Values
###

defaults
   log     global
   mode    tcp
   retries 3
   option  tcplog
   option  dontlognull
   timeout connect    5s
   timeout client     5m
   timeout server     5m
   timeout queue      10s

####
# TCP - Listeners for Bootnodes over P2P
####

# Polkadot relay and system chains

listen li-dot-boot-p2p
   bind *:33100
   server dot-boot-p2p 172.16.16.100:33100 check

listen li-dot-asset-boot-p2p
   bind *:33110
   server dot-asset-boot-p2p 172.16.16.110:33110 check

listen li-dot-collt-boot-p2p
   bind *:33120
   server dot-collt-boot-p2p 172.16.16.120:33120 check

listen li-dot-bridg-boot-p2p
   bind *:33130
   server dot-bridg-boot-p2p 172.16.16.130:33130 check

####
# END HAPROXY CONFIGURATION FILE
####

POLKADOT config:

[Unit]
Description=Polkadot Node
After=network-online.target
Wants=network-online.target

[Service]
User=polkadot
Group=polkadot
ExecStart=/usr/local/bin/polkadot \
  --name GATOTECH😸DOT_BOOT \
  --chain polkadot \
  --base-path '/var/lib/polkadot/polkadot1' \
  --database paritydb \
  --state-pruning 256 \
  --log sync=warn,afg=warn,babe=warn \
  --telemetry-url 'wss://telemetry.gatotech.network/submit/ 1' \
  --telemetry-url 'wss://telemetry-backend.w3f.community/submit 1' \
  --telemetry-url 'wss://telemetry.polkadot.io/submit/ 1' \
  --listen-addr /ip6/::/tcp/33100 \
  --listen-addr /ip6/::/tcp/34100/ws \
  --listen-addr /ip4/0.0.0.0/tcp/33100 \
  --listen-addr /ip4/0.0.0.0/tcp/34100/ws \
  --public-addr /dns/boot.gatotech.network/tcp/33100 \
  --public-addr /dns/boot.gatotech.network/tcp/34100/ws \
  --public-addr /dns/boot.gatotech.network/tcp/35100/wss \
  --wasm-execution Compiled \
  --sync warp \
  --no-hardware-benchmarks \
  --rpc-external \
  --prometheus-external \
  --rpc-methods safe \
  --rpc-cors all

Restart=always
RestartSec=120

[Install]
WantedBy=multi-user.target

POLKADOT logs

Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 🥩 BEEFY not supported when warp syncing. Disabling BEEFY.
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 Parity Polkadot
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 ✌️  version 1.3.0-7c9fd83805c
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 ❤️  by Parity Technologies <admin@parity.io>, 2017-2023
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 📋 Chain specification: Polkadot
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 🏷  Node name: GATOTECH😸DOT_BOOT
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 👤 Role: FULL
Nov 29 12:12:53 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:52 💾 Database: ParityDb at /var/lib/polkadot/polkadot1/chains/polkadot/paritydb/full
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 Can't use warp sync mode with a partially synced database. Reverting to full sync mode.
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 🏷  Local node identity is: 12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 🔍 Discovered new external address for our node: /dns/boot.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 🔍 Discovered new external address for our node: /dns/boot.gatotech.network/tcp/34100/ws/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 🔍 Discovered new external address for our node: /dns/boot.gatotech.network/tcp/35100/wss/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Operating system: linux
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 CPU architecture: x86_64
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Target environment: gnu
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 CPU: AMD EPYC 7443 24-Core Processor
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 CPU cores: 4
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Memory: 3911MB
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Kernel: 5.15.0-88-generic
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Linux distribution: Ubuntu 22.04.3 LTS
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 💻 Virtual machine: yes
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 📦 Highest known block at #18379263
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 〽️ Prometheus exporter started at 0.0.0.0:9615
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 Running JSON-RPC server: addr=0.0.0.0:9944, allowed origins=["*"]
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWDbxW4TamqoyWsbeShddSf6cqaPREfz3Kayvg29A6A4Vy /ip4/172.16.17.75/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWJAVtaGXwiNzRVfSeEicy7FszRkdRJQdayn5z76nMxeRE /ip4/172.16.16.231/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMQYDeduU8h9nU9i8ou1evQqdEcaVFHEWCFZjexktWokA /ip4/172.16.17.64/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWPg8v8Tt8a4fYNWC3xHv3tvuLWveaJLWbAVApEThrL65i /ip4/172.16.17.65/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWPTaBVch24pzRnu2DgmZ6DivQ7F3vs5QjatcNDMXrMT1N /ip4/172.16.16.211/tcp/33211
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWPTaBVch24pzRnu2DgmZ6DivQ7F3vs5QjatcNDMXrMT1N /ip4/172.16.16.211/tcp/34211/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWHXTqm1kRdXdm5MbwjFhGHNkRFLPr737oYV4FaPDbp1Do /ip4/172.16.16.221/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQkVqVydoPtJDKEFSu6ZxPEmrPwGYxxLbFmeNJNEaEA11 /ip4/172.16.17.74/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMSW6hr8KcNBhGFN1bg8kYC76o67PnuDEbxRhxacW6dui /ip4/172.16.17.54/tcp/33310
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMSW6hr8KcNBhGFN1bg8kYC76o67PnuDEbxRhxacW6dui /ip4/172.16.17.54/tcp/34310/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWNtkdnUemAy813PrhWsWvRBukeuzWtmDBEcUKncK3UFff /ip4/172.16.16.131/tcp/34131/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWNtkdnUemAy813PrhWsWvRBukeuzWtmDBEcUKncK3UFff /ip4/172.16.16.131/tcp/33131
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWEDYFH4WNdNJRpMKJPL3mfYjpHWriNKp6hMzV6ojBcko6 /ip4/172.16.16.110/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWA7u9tk6GTUBJYV3JxiVV5E4GA9nLTMahGsDLnFidoi8v /ip4/172.16.17.55/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWBqQkcC98mTUMLNiC77xWDw9xoVscWpf7BukWHLKioZTH /ip4/172.16.16.150/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMtsJY3FnrqXF99fkarE592xkrMFYQccwccmpGsJXLxj2 /ip4/172.16.16.151/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWGZsa9tSeLQ1VeC996e1YsCPuyRYMipHQuXikPjcKcpVQ /ip4/172.16.16.120/tcp/34120/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWGZsa9tSeLQ1VeC996e1YsCPuyRYMipHQuXikPjcKcpVQ /ip4/172.16.16.120/tcp/33120
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWM8ACRFWWPWc7YF5nR6UFmMP63RmrooeMJKtCRb45kSek /ip4/172.16.16.111/tcp/33111
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWM8ACRFWWPWc7YF5nR6UFmMP63RmrooeMJKtCRb45kSek /ip4/172.16.16.111/tcp/34111/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWM9mRWjBWnv1NCiYutJ8q639ZS9nSTNKXrg5mFUGcr2jq /ip4/172.16.16.121/tcp/33121
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWM9mRWjBWnv1NCiYutJ8q639ZS9nSTNKXrg5mFUGcr2jq /ip4/172.16.16.121/tcp/34121/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWHXYe2tw7bbGfJFn1Hi4UXehTwcJtpCgBvSYMBZjJY43r /ip4/172.16.17.54/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWBVUXuupEjaLx17a2YkBG2PgbyBqhgLeDKYXWUKrqnd3Z /ip4/172.16.16.221/tcp/33221
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWBVUXuupEjaLx17a2YkBG2PgbyBqhgLeDKYXWUKrqnd3Z /ip4/172.16.16.221/tcp/34221/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooW9z76eZr3oY18XoarxFpJ54x7Qz6A5cCWZSGXgFmHio33 /ip4/172.16.16.231/tcp/33231
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooW9z76eZr3oY18XoarxFpJ54x7Qz6A5cCWZSGXgFmHio33 /ip4/172.16.16.231/tcp/34231/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMedtdBGiSn7HLZusHwafXkZAdmWD18ciGQBfS4X1fv9K /ip4/172.16.17.64/tcp/33320
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMedtdBGiSn7HLZusHwafXkZAdmWD18ciGQBfS4X1fv9K /ip4/172.16.17.64/tcp/34320/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWRMUYeWMPkadDG8baX9j1e95fspfp8MhPGym5BQza7Fm5 /ip4/172.16.16.210/tcp/34210/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWRMUYeWMPkadDG8baX9j1e95fspfp8MhPGym5BQza7Fm5 /ip4/172.16.16.210/tcp/33210
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWR9yPX2eJeB9rxcJWSTRgJ636PwpR63X1ThRFyPpt6LLf /ip4/172.16.16.201/tcp/33201
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWR9yPX2eJeB9rxcJWSTRgJ636PwpR63X1ThRFyPpt6LLf /ip4/172.16.16.201/tcp/34201/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKgwQfAeDoJARdtxFNNWfbYmcu6s4yUuSifnNoDgzHZgm /ip4/172.16.16.110/tcp/33110
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKgwQfAeDoJARdtxFNNWfbYmcu6s4yUuSifnNoDgzHZgm /ip4/172.16.16.110/tcp/34110/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQkrsNL26dp8ZExXNGTY4cApBxVJyn2JhZuJeT4bTM7oY /ip4/172.16.16.131/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWSUvQxfQSkz7DKsjcf1cheo1bca7JHgJLYdQrDontG7vK /ip4/172.16.16.152/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWJHG6qznPzTSEbuujHNcvyzBZcR9zNRPFcXWUaoVWZBEw /ip4/172.16.17.74/tcp/33330
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWJHG6qznPzTSEbuujHNcvyzBZcR9zNRPFcXWUaoVWZBEw /ip4/172.16.17.74/tcp/34330/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQgso7RrygppUFLMNMoJKev87SeJd3DwZqcimvvozsqU4 /ip4/172.16.16.250/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWJuhL4MqmzeKGBLpwntyxHuXkPjWpkUsMkaihaRXcfWZF /ip4/172.16.16.111/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWAA3DS4PWHoqRbVU3kFDuue3syij1Wb6TVkzv6DwFh4Su /ip4/172.16.16.220/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWPEbDvb6t8sUFxZrgRFxZYvHt31WLa6LX1gDuaC6SPn7U /ip4/172.16.17.56/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQUu53UmGWCSptyPPyVdJrWz1CD6PCqEH34GaMFreNHdu /ip4/172.16.17.76/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWSLoBv7Xej58gGu1hJHrvpFLaiS9ZbAy14tbFk3Xhmf4w /ip4/172.16.17.66/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFkn8AQfXjht83En41KQJcCFvWiwLq51CsSFviStVXV2o /ip4/172.16.16.120/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWByfCkLUzuMBJhVqb5SZxTHgGdwPzbJEk3t7gxDUakdi7 /ip4/172.16.16.220/tcp/33220
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWByfCkLUzuMBJhVqb5SZxTHgGdwPzbJEk3t7gxDUakdi7 /ip4/172.16.16.220/tcp/34220/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWELXYhLGLrmENAomxHLFNxKrGYKrdWnM2wb3WSFfUGQAN /ip4/172.16.16.212/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQiGe89cLGHW5vLk6QiStyF6a4wh3RWwn9hG2SbZCKbDy /ip4/172.16.16.210/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQgbpKXVzGxn2SmZyRrBFV7aM7cQdmZzB6xmr8TgJPCk9 /ip4/172.16.16.130/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFQFmg8UqAYLDNc2onySB6o5LLvpbx3eXZVqz9YFxAmXs /ip4/172.16.16.230/tcp/34230/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFQFmg8UqAYLDNc2onySB6o5LLvpbx3eXZVqz9YFxAmXs /ip4/172.16.16.230/tcp/33230
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWEfzsGtwaGV6foBZAc5PCQZoqbhNQsWPv9ku4shtuBBgF /ip4/172.16.16.232/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWCjBxfsadQSeBoyVu1oZ1jgS8PaC1foaaU2ngkE5pbcRr /ip4/172.16.16.122/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFdzWtMkMjceAYAYgp92hYnzzJSQkeSX2kiZsyxwmaSXs /ip4/172.16.16.101/tcp/34101/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFdzWtMkMjceAYAYgp92hYnzzJSQkeSX2kiZsyxwmaSXs /ip4/172.16.16.101/tcp/33101
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWF1jDz3TYDCYdDGM6tfhYG6z7QPbhAQzbBVKou75XjnPF /ip4/172.16.16.212/tcp/34212/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWF1jDz3TYDCYdDGM6tfhYG6z7QPbhAQzbBVKou75XjnPF /ip4/172.16.16.212/tcp/33212
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWErpRUAoJrJBQkZTeHHnm48i7sdNmquQnWVmdbWDAgFZq /ip4/172.16.16.132/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWLMfaDnfWCqYKHXedKkNtEPU7AaU39tQFddHgRbBmPRo9 /ip4/172.16.16.132/tcp/34132/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWLMfaDnfWCqYKHXedKkNtEPU7AaU39tQFddHgRbBmPRo9 /ip4/172.16.16.132/tcp/33132
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKNNSsw71KQvuiNWQBDatguAKuj9ysd5a7TBWPXfGBq4R /ip4/172.16.16.232/tcp/33232
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKNNSsw71KQvuiNWQBDatguAKuj9ysd5a7TBWPXfGBq4R /ip4/172.16.16.232/tcp/34232/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWNdnh9HyTFcgrAX2v2ibd39dQjaF86cJRcGbzpeVTCfPr /ip4/172.16.17.76/tcp/34332/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWNdnh9HyTFcgrAX2v2ibd39dQjaF86cJRcGbzpeVTCfPr /ip4/172.16.17.76/tcp/33332
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWS3QprY1zY2N5pwEA6wgZAmAN8Cvr3Tykx1WPTwpYFciw /ip4/172.16.16.222/tcp/33222
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWS3QprY1zY2N5pwEA6wgZAmAN8Cvr3Tykx1WPTwpYFciw /ip4/172.16.16.222/tcp/34222/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWSG4Q5rYRWp6sguELEcLzrdroYxCuV61ns9kA1U4sydLB /ip4/172.16.16.112/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKse5b2F6hHDNUwWviJxj5wu78aZpuNX5Xwm6FderpQ8n /ip4/172.16.16.202/tcp/34202/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWKse5b2F6hHDNUwWviJxj5wu78aZpuNX5Xwm6FderpQ8n /ip4/172.16.16.202/tcp/33202
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWBDg7u6dBEo82fJe4kyDJT3L2C8kYNYGNvuBkEPVryKby /ip4/172.16.16.102/tcp/33102
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWBDg7u6dBEo82fJe4kyDJT3L2C8kYNYGNvuBkEPVryKby /ip4/172.16.16.102/tcp/34102/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWF7NBnHXUcEWBaBboikn3DYGiEy9fA5UhzCSx5XzTKxLg /ip4/172.16.17.46/tcp/34302/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWF7NBnHXUcEWBaBboikn3DYGiEy9fA5UhzCSx5XzTKxLg /ip4/172.16.17.46/tcp/33302
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWFhy9JuCsont6fKcNbxq9nWrzSAvw8fCcDEw7Ax42dcaY /ip4/172.16.16.222/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMu2Q4HoTGNzUtAKng47s6rK5L3LCB6BMj5xjfZZWbbEx /ip4/172.16.17.66/tcp/33322
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWMu2Q4HoTGNzUtAKng47s6rK5L3LCB6BMj5xjfZZWbbEx /ip4/172.16.17.66/tcp/34322/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQgnmkVqsBqEHXAgdfbnSYgtb9EdLnto94G5XoLgNCgYW /ip4/172.16.17.56/tcp/33312
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWQgnmkVqsBqEHXAgdfbnSYgtb9EdLnto94G5XoLgNCgYW /ip4/172.16.17.56/tcp/34312/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWE6UQN1tr1qWimGz9seNGAG71VYUnRd2DJ261YV4aguqV /ip4/172.16.16.211/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWAidtH3DzPrs7YtKrjLXRJ3Tz9TY8Hvmos2XVeT7ocNvY /ip4/172.16.16.122/tcp/33122
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWAidtH3DzPrs7YtKrjLXRJ3Tz9TY8Hvmos2XVeT7ocNvY /ip4/172.16.16.122/tcp/34122/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWCnFzfEdd7MwUNrrDv66FuS2DM5MGuiaB4y48XS7qNjF6 /ip4/172.16.16.130/tcp/34130/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWCnFzfEdd7MwUNrrDv66FuS2DM5MGuiaB4y48XS7qNjF6 /ip4/172.16.16.130/tcp/33130
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWH2jfBmTGyRyxDHM574HXxPFhRdrv9EuNtrdLYv4CeKSX /ip4/172.16.16.121/tcp/30334/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWD3rcYuXrVX9LqvpyYharhCSNRoYBJGBMWRbkSSorVhzH /ip4/172.16.16.112/tcp/33112
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWD3rcYuXrVX9LqvpyYharhCSNRoYBJGBMWRbkSSorVhzH /ip4/172.16.16.112/tcp/34112/ws
Nov 29 12:12:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:57 discovered: 12D3KooWDr5BiSwLVP4ceRjeKu91LJT7NVtHZb2s4nnGrx85SVig /ip4/172.16.16.230/tcp/30334/ws
Nov 29 12:12:58 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:58 🔍 Discovered new external address for our node: /ip4/190.124.251.98/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:58 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:58 🔍 Discovered new external address for our node: /ip4/190.124.251.98/tcp/34100/ws/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:58 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:58 ✨ Imported #18379264 (0x427e…4e22)
Nov 29 12:12:58 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:58 🔍 Discovered new external address for our node: /dns/boot-cr.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:58 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:58 🔍 Discovered new external address for our node: /dns/boot-cr.gatotech.network/tcp/34100/ws/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:59 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:59 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:12:59 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:12:59 🔍 Discovered new external address for our node: /ip4/138.59.133.242/tcp/34100/ws/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w
Nov 29 12:13:00 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:00 ✨ Imported #18379265 (0xb0f8…7a2c)
Nov 29 12:13:02 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:02 💤 Idle (9 peers), best: #18379265 (0xb0f8…7a2c), finalized #18379262 (0x954c…31f8), ⬇ 76.8kiB/s ⬆ 33.1kiB/s
Nov 29 12:13:07 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:07 💤 Idle (13 peers), best: #18379265 (0xb0f8…7a2c), finalized #18379263 (0x1db5…1bb4), ⬇ 25.3kiB/s ⬆ 12.5kiB/s
Nov 29 12:13:08 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:08 ✨ Imported #18379266 (0x156e…7a54)
Nov 29 12:13:12 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:12 Report 12D3KooWG2WCdzfSLqtf5hT2CCmKggqbnzAAggsEaCXCA5ZBpZLF: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:12 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:12 ✨ Imported #18379267 (0x4abc…389e)
Nov 29 12:13:12 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:12 💤 Idle (11 peers), best: #18379267 (0x4abc…389e), finalized #18379264 (0x427e…4e22), ⬇ 1.0MiB/s ⬆ 140.2kiB/s
Nov 29 12:13:17 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:17 💤 Idle (15 peers), best: #18379267 (0x4abc…389e), finalized #18379265 (0xb0f8…7a2c), ⬇ 56.5kiB/s ⬆ 93.8kiB/s
Nov 29 12:13:18 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:18 ✨ Imported #18379268 (0x5f9c…cb65)
Nov 29 12:13:19 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:19 Report 12D3KooWBf6eVCXsKa5YJz2NQDeSpptm7FXF438MVfXiNm9sEWje: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:22 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:22 💤 Idle (17 peers), best: #18379268 (0x5f9c…cb65), finalized #18379265 (0xb0f8…7a2c), ⬇ 158.2kiB/s ⬆ 205.7kiB/s
Nov 29 12:13:24 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:24 ✨ Imported #18379269 (0xcc57…9500)
Nov 29 12:13:27 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:27 💤 Idle (14 peers), best: #18379269 (0xcc57…9500), finalized #18379267 (0x4abc…389e), ⬇ 148.7kiB/s ⬆ 95.0kiB/s
Nov 29 12:13:30 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:30 ✨ Imported #18379270 (0xb245…5672)
Nov 29 12:13:31 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:31 Report 12D3KooWK7CJZGdkbBi7a4xGcTX6b4zN4EfrLp5Ect2ayu5q4Hfa: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:32 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:32 💤 Idle (13 peers), best: #18379270 (0xb245…5672), finalized #18379267 (0x4abc…389e), ⬇ 128.4kiB/s ⬆ 111.4kiB/s
Nov 29 12:13:36 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:36 ✨ Imported #18379271 (0x8bc8…1edc)
Nov 29 12:13:36 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:36 ✨ Imported #18379271 (0x7c72…290a)
Nov 29 12:13:37 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:37 💤 Idle (13 peers), best: #18379271 (0x8bc8…1edc), finalized #18379268 (0x5f9c…cb65), ⬇ 163.5kiB/s ⬆ 105.8kiB/s
Nov 29 12:13:42 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:42 ✨ Imported #18379272 (0x9197…4d17)
Nov 29 12:13:42 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:42 💤 Idle (12 peers), best: #18379272 (0x9197…4d17), finalized #18379269 (0xcc57…9500), ⬇ 102.8kiB/s ⬆ 93.6kiB/s
Nov 29 12:13:43 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:43 Report 12D3KooWEfA89SinJid955uM9c8jXavud3JF2qrMmyuHV62Lyhwo: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:47 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:47 💤 Idle (16 peers), best: #18379272 (0x9197…4d17), finalized #18379269 (0xcc57…9500), ⬇ 92.6kiB/s ⬆ 611.4kiB/s
Nov 29 12:13:48 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:48 ✨ Imported #18379273 (0xf795…41c7)
Nov 29 12:13:49 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:49 Report 12D3KooWBqeJjxZZCAQunnDzz8dhTCukY9UpBGzxWLX4pVV7KH2c: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:50 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:50 Report 12D3KooWEag8zYiXmVDMeXQsAaSCC7uKiyDT4yMhPSrAVwBCKf37: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:13:52 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:52 💤 Idle (19 peers), best: #18379273 (0xf795…41c7), finalized #18379271 (0x8bc8…1edc), ⬇ 144.5kiB/s ⬆ 1.8MiB/s
Nov 29 12:13:54 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:54 ✨ Imported #18379274 (0x8a06…bcc4)
Nov 29 12:13:57 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:13:57 💤 Idle (16 peers), best: #18379274 (0x8a06…bcc4), finalized #18379271 (0x8bc8…1edc), ⬇ 94.2kiB/s ⬆ 1.4MiB/s
Nov 29 12:14:00 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:00 ✨ Imported #18379275 (0xbd8c…daaa)
Nov 29 12:14:01 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:01 Report 12D3KooWBetph5wciYnXoqrgsYxTUrG2kEdExhaGCEHbMe6ojVe1: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:14:02 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:02 Report 12D3KooWSC6iHnuHvVnorYugM6tyuKvTV9CQwSiNKpn3QKJdQtXC: -2147483648 to -2147483648. Reason: Same block request multiple times. Banned, disconnecting.
Nov 29 12:14:02 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:02 💤 Idle (15 peers), best: #18379275 (0xbd8c…daaa), finalized #18379272 (0x9197…4d17), ⬇ 193.9kiB/s ⬆ 1.5MiB/s
Nov 29 12:14:06 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:06 ✨ Imported #18379276 (0x632c…bde2)
Nov 29 12:14:06 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:06 ♻️  Reorg on #18379276,0x632c…bde2 to #18379276,0x133f…491b, common ancestor #18379275,0xbd8c…daaa
Nov 29 12:14:06 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:06 ✨ Imported #18379276 (0x133f…491b)
Nov 29 12:14:07 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:07 💤 Idle (18 peers), best: #18379276 (0x133f…491b), finalized #18379273 (0xf795…41c7), ⬇ 171.0kiB/s ⬆ 194.5kiB/s
Nov 29 12:14:08 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:08 ✨ Imported #18379277 (0x6551…0a23)
Nov 29 12:14:12 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:12 💤 Idle (18 peers), best: #18379277 (0x6551…0a23), finalized #18379274 (0x8a06…bcc4), ⬇ 85.9kiB/s ⬆ 106.0kiB/s
Nov 29 12:14:17 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:17 💤 Idle (22 peers), best: #18379277 (0x6551…0a23), finalized #18379275 (0xbd8c…daaa), ⬇ 101.2kiB/s ⬆ 200.8kiB/s
Nov 29 12:14:18 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:18 ✨ Imported #18379278 (0x4bd5…cd9f)
Nov 29 12:14:18 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:18 ✨ Imported #18379278 (0x7aae…993e)
Nov 29 12:14:19 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:19 Report 12D3KooWPTqGQQVWn9n3fJXm6M4XW9eDaJQGuxge53X3qtM9mmgH: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:14:20 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:20 Report 12D3KooWEy2M1YgvrhZCay1Bmn8cYZCP1wgHhDFbsxG23nQYdobV: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
Nov 29 12:14:22 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:22 💤 Idle (17 peers), best: #18379278 (0x4bd5…cd9f), finalized #18379276 (0x133f…491b), ⬇ 137.4kiB/s ⬆ 225.8kiB/s
Nov 29 12:14:24 dot-boot.gatotech.network polkadot[48059]: 2023-11-29 12:14:24 ✨ Imported #18379279 (0xd4be…afde)

I remain attentive...

Cheers!

Milos

altonen commented 9 months ago

@miloskriz

If you're in control of this GATOTECH node, are you able to run the node with -llibp2p,sub-libp2p=trace,libp2p_noise=OFF and posting the logs so I could take a look? If I run my node with --reserved-nodes /dns/boot.gatotech.network/tcp/33100/p2p/12D3KooWK4E16jKk9nRhvC4RfrDVgcZzExg8Q3Q2G7ABUUitks1w, I also get external address discovery for 138.59.133.242 so something doesn't make sense

miloskriz commented 9 months ago

Hello @altonen !

Done.. here are the logs of the first couple of minutes after restarting with the flags.

Hope it helps!

I remain attentive to further instructions!..

Cheers

Milos

altonen commented 9 months ago

@miloskriz

This is what I get when I grep logs for incoming connections for a node run on GCP:

2023-12-01 08:31:02.637 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/217.79.252.218/tcp/22405/ws    
2023-12-01 08:31:02.691 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/90.193.14.35/tcp/48974/ws    
2023-12-01 08:31:02.720 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/13.212.163.21/tcp/48950/ws    
2023-12-01 08:31:02.787 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/18.143.54.241/tcp/15577/ws    
2023-12-01 08:31:03.356 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/34.65.164.154/tcp/54748/ws    
2023-12-01 08:31:03.435 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/52.196.83.33/tcp/53676/ws    
2023-12-01 08:31:03.477 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/112.118.199.16/tcp/55017/ws    
2023-12-01 08:31:03.564 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/5.9.107.249/tcp/54292/ws    
2023-12-01 08:31:03.806 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/51.68.154.174/tcp/38658/ws    
2023-12-01 08:31:03.889 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/51.68.154.174/tcp/38660/ws    
2023-12-01 08:31:04.336 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/13.231.87.188/tcp/46298/ws    

and this is what I get when I grep the logs you provided:

2023-11-30 13:41:36.065 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46268/ws
2023-11-30 13:41:36.074 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46280/ws
2023-11-30 13:41:36.079 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46286/ws
2023-11-30 13:41:36.095 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46296/ws
2023-11-30 13:41:36.096 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46304/ws
2023-11-30 13:41:36.105 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46306/ws
2023-11-30 13:41:36.117 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46322/ws
2023-11-30 13:41:36.125 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46326/ws
2023-11-30 13:41:36.125 TRACE tokio-runtime-worker libp2p_websocket::framed: incoming connection from /ip4/138.59.133.242/tcp/46334/ws

I'm wondering if HAProxy is causing us trouble here. If you're load balancing TCP, maybe the client address is not correctly relayed to the Polkadot node and instead it gets a connection from HAProxy with the address it's bound to (138.59.133.242).

@PierreBesson @BulatSaif any insight?

altonen commented 9 months ago

@miloskriz

could you verify the TCP proxy is configured correctly and that it forwards clients to your Polkadot node with correct source IP address?

https://www.haproxy.com/documentation/haproxy-configuration-tutorials/client-ip-preservation/enable-proxy-protocol/ https://www.haproxy.com/blog/howto-transparent-proxying-and-binding-with-haproxy-and-aloha-load-balancer

BulatSaif commented 9 months ago

@miloskriz, How many interfaces the haproxy server has? Usually, haproxy has 2 interfaces public and private, for example, you receive a connection on a public interface 138.59.133.242 and proxy it via a private interface e.g 172.16.0.0/12 to 172.16.16.110. But according to the logs haproxy uses 138.59.133.242 interface to connect to 172.16.16.110. Do you have any ip-/nftables rules on the backend server?

miloskriz commented 9 months ago

hello @BulatSaif,

You are correct, the haproxy server is a VM with only one interface.. the communication between 138.59.133.242 and 172.16.16.100 is done at the router level.

both the public subnet 138.59.133.240/28 and the private (DMZ) 172.16.16.0/23 are in fact on my LAN side and I have enabled the firewall rules between them...

What do you think?

BulatSaif commented 9 months ago

What do you think?

@miloskriz, Good, at least we've identified the issue. I think the easiest solution is to add a private IP to the HAproxy server (you can add it to the same interface) and configure the server to use it to connect to the backend. Private IPs are ignored and will not be distributed in the network.

The correct solution would be to get one more IP and assign it directly to the server with the Substrate node.

stakeworld commented 9 months ago

Hi @hitchhooker @BulatSaif @altonen, i've been observing this behaviour for a while, i'm not sure if is "just" the haproxy thing.

There was previously some discussion on element if it could be some kind of mirroring by indexer services or something like that. Fact is that on all of my nodes (even at different providers) if I do a journalctl -u <nodename> | grep "Discovered new external address for our node" there are always multiple discoveries with the same id but different ip's.

These are for example the entries for today for a validator node. All the same ID but none of these ip's is from the node itself. No haproxy or other proxy i use.

Dec 08 01:04:25 polkadot[1382193]: 2023-12-08 01:04:25 🔍 Discovered new external address for our node: /ip4/203.96.179.109/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 07:04:25 polkadot[1382193]: 2023-12-08 07:04:25 🔍 Discovered new external address for our node: /ip4/203.96.179.106/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 08:04:25 polkadot[1382193]: 2023-12-08 08:04:25 🔍 Discovered new external address for our node: /ip4/69.197.49.20/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 09:04:25 polkadot[1382193]: 2023-12-08 09:04:25 🔍 Discovered new external address for our node: /ip4/69.197.58.40/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 13:04:33 polkadot[1382193]: 2023-12-08 13:04:33 🔍 Discovered new external address for our node: /ip4/213.27.32.157/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 14:04:31 polkadot[1382193]: 2023-12-08 14:04:31 🔍 Discovered new external address for our node: /ip4/94.131.106.207/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E Dec 08 18:04:26 polkadot[1382193]: 2023-12-08 18:04:26 🔍 Discovered new external address for our node: /ip4/45.67.35.181/tcp/30301/p2p/12D3KooWEwVMqog4VsnhpiGyWCKNmVJwvweGGwHU8xJVhrCTAu9E

Ip's seem from al around the world, traceroute doesn't show them very close / same network or something like that. It doesn't seem to impact functioning but it is strange.

miloskriz commented 9 months ago

hi @BulatSaif, @hitchhooker,

I can confirm that following the recommendation (to give the proxy machine a proper address in the internal LAN instead of relying in external router / firewall rules) seems to have solved the situation in which my public address was being added as node address everywhere...

On the discoveries made by @stakeworld it seems evident that several other operators may have same or similar situation with their setups...

I imagine one solution would be to track and hunt down these operators to alert them of the issue, or alternatively solve it via libp2p address discovery behaviour?

once again, thanks @BulatSaif for the eagle-eyed solution!

all the best!

Milos