search

elys-network / elys

Elys Network is the first All-In-One DEFI platform to join the Atom Economic Zone, backed by Informal Systems and the Cosmos Hub. Built on Cosmos and CometBFT, leveraging the latest blockchain technologies to provide a premier user experience. Visit our official site at https://elys.network
https://elys.network
Apache License 2.0
57 stars 51 forks source link

Statesync is issues/not working since v0.39.0 update #667

Open effofxprime opened 1 month ago

effofxprime commented 1 month ago

Attempting to statesync since v0.39.0 results in these errors from the following RPC nodes:

The nodes below are the only RPC nodes I am aware of setup for statesync. Elys official, Polkachu, Aveone, and itrocket.

The context deadline exceeded could possibly point to a setting update needed on these servers, like an extended RPC timeout, but im not sure.

I let statesync run for quite some time, and when it went to verify a group of blocks, it would always fail similar to below.

3:51PM INF error from light block request from primary, removing... error="post failed: Post \"https://rpc.elystestnet-1.elys.aviaone.com:443\": context deadline exceeded" height=8750898 module=light primary=http{https://rpc.elystestnet-1.elys.aviaone.com:443}
3:51PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
3:51PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.itrocket.net:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.itrocket.net:443}
3:51PM ERR error on light block request from witness, removing... error="post failed: Post \"https://rpc.testnet.elys.network:443\": context deadline exceeded" module=light primary=http{https://rpc.testnet.elys.network:443}
3:51PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[2,0,1]
3:51PM ERR Can't verify err="failed to obtain the header at height #8750898: post failed: Post \"https://rpc.testnet.elys.network:443\": context deadline exceeded" module=light
3:51PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8750898: post failed: Post \"https://rpc.testnet.elys.network:443\": context deadline exceeded" module=statesync
3:51PM INF Snapshot rejected format=3 hash="�I���Li�gt��\x1a�\x18\n��xȝ\v��d�_���\x12\x01" height=8740000 module=statesync
effofxprime commented 1 month ago

Statesync logs showing how it kept going through each snapshot height and rejecting it with the context deadline error response message.

2:43PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:43PM INF Discovered new snapshot format=3 hash="E\x01�\x11�� ��\x18\x0f\r���\x00�b\x06+\x1ff�^ ���P�\x10\x01" height=8749000 module=statesync
2:43PM INF Discovered new snapshot format=3 hash="\x1d\a\x1dQ�q�oG�\x18������G��Y�\x1e�-�\\\\��\x14�" height=8747000 module=statesync
2:43PM INF Discovered new snapshot format=3 hash=":�n�z\x01�}x�9����#J��^���+\r\x1bH\x11\aTm�" height=8746000 module=statesync
2:43PM INF Discovered new snapshot format=3 hash="��W^�\x14fq]\a�T+O�Y#z�e}0�G�R&�\x1e�M%" height=8745000 module=statesync
2:43PM INF Discovered new snapshot format=3 hash="5�eon �����r�\x19R��t\x1f���ъ%j\f튮��" height=8744000 module=statesync
2:43PM INF VerifyHeader hash=68F704FA741F7101134014208883789E4A59E05D06567ACAEE79E0B649C12596 height=8749001 module=light
2:43PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=2 numToDial=38
2:43PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.195.29:23656} 609c64cc50fb4ebbe7cae3347545d3950ea2c018 out}"
2:43PM INF service start impl="Peer{MConn{5.161.206.6:22056} 463805d557e309c599e25a1284c421919decec42 out}" module=p2p msg="Starting Peer service" peer=463805d557e309c599e25a1284c421919decec42@5.161.206.6:22056
2:43PM INF service start impl=MConn{5.161.206.6:22056} module=p2p msg="Starting MConnection service" peer=463805d557e309c599e25a1284c421919decec42@5.161.206.6:22056
2:43PM INF Discovered new snapshot format=3 hash="\x11�\rK��\v�W���\x05\f�q�����oy�Ε+<\x17?�\v" height=7677000 module=statesync
2:43PM INF Discovered new snapshot format=3 hash="����Ka%$����\x01�ER\x11�;vî54Δ\x12-�A�u" height=7676000 module=statesync
2:43PM INF service start impl="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}" module=p2p msg="Starting Peer service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:43PM INF service start impl=MConn{65.108.200.40:38656} module=p2p msg="Starting MConnection service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:43PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.200.40:38656} module=p2p peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:43PM INF service stop impl=MConn{65.108.200.40:38656} module=p2p msg="Stopping MConnection service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:43PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}"
2:43PM INF service stop impl="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}" module=p2p msg="Stopping Peer service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:44PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749921 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:44PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:44PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:44PM ERR Can't verify err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:44PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:44PM INF Snapshot rejected format=3 hash="E\x01�\x11�� ��\x18\x0f\r���\x00�b\x06+\x1ff�^ ���P�\x10\x01" height=8749000 module=statesync
2:44PM INF VerifyHeader hash=40D5F55E2BAB6672B56DE09ADDACD65EB50899B003EA66918805FCF7161740D5 height=8747001 module=light
2:44PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=3 numToDial=37
2:44PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.195.29:23656} 609c64cc50fb4ebbe7cae3347545d3950ea2c018 out}"
2:44PM INF service start impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Starting Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:44PM INF service start impl=MConn{65.108.231.124:38656} module=p2p msg="Starting MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:44PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.231.124:38656} module=p2p peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:44PM INF service stop impl=MConn{65.108.231.124:38656} module=p2p msg="Stopping MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:44PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}"
2:44PM INF service stop impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Stopping Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:44PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749921 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:44PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:44PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:44PM ERR Can't verify err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:44PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:44PM INF Snapshot rejected format=3 hash="\x1d\a\x1dQ�q�oG�\x18������G��Y�\x1e�-�\\\\��\x14�" height=8747000 module=statesync
2:44PM INF VerifyHeader hash=C3CC90320983320E97B3FF02984F29FCB61BCECD0F1B71B8EAC8834926D027C4 height=8746001 module=light
2:44PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=3 numToDial=37
2:44PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.195.29:23656} 609c64cc50fb4ebbe7cae3347545d3950ea2c018 out}"
2:45PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749922 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:45PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:45PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:45PM ERR Can't verify err="failed to obtain the header at height #8749922: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:45PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749922: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:45PM INF Snapshot rejected format=3 hash=":�n�z\x01�}x�9����#J��^���+\r\x1bH\x11\aTm�" height=8746000 module=statesync
2:45PM INF VerifyHeader hash=D85D180ED1E111AB34CD81508EA42089B2512D4B0C44C31C8BA6548BEE48B7F2 height=8745001 module=light
2:45PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=691
2:45PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=3 numToDial=37
2:45PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.195.29:23656} 609c64cc50fb4ebbe7cae3347545d3950ea2c018 out}"
2:45PM INF service start impl="Peer{MConn{65.21.198.100:21210} d1d43cc7c7aef715957289fd96a114ecaa7ba756 out}" module=p2p msg="Starting Peer service" peer=d1d43cc7c7aef715957289fd96a114ecaa7ba756@65.21.198.100:21210
2:45PM INF service start impl=MConn{65.21.198.100:21210} module=p2p msg="Starting MConnection service" peer=d1d43cc7c7aef715957289fd96a114ecaa7ba756@65.21.198.100:21210
2:45PM INF service start impl="Peer{MConn{65.108.106.168:10126} 57c605fa2f7796dd2371ab9ca412bcf9a57d3f71 out}" module=p2p msg="Starting Peer service" peer=57c605fa2f7796dd2371ab9ca412bcf9a57d3f71@65.108.106.168:10126
2:45PM INF service start impl=MConn{65.108.106.168:10126} module=p2p msg="Starting MConnection service" peer=57c605fa2f7796dd2371ab9ca412bcf9a57d3f71@65.108.106.168:10126
2:45PM INF service start impl="Peer{MConn{148.251.177.108:22056} ae29d8da169214e201c03789858b4228b56a004a out}" module=p2p msg="Starting Peer service" peer=ae29d8da169214e201c03789858b4228b56a004a@148.251.177.108:22056
2:45PM INF service start impl=MConn{148.251.177.108:22056} module=p2p msg="Starting MConnection service" peer=ae29d8da169214e201c03789858b4228b56a004a@148.251.177.108:22056
2:45PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.21.198.100:21210} module=p2p peer=d1d43cc7c7aef715957289fd96a114ecaa7ba756@65.21.198.100:21210
2:45PM INF service stop impl=MConn{65.21.198.100:21210} module=p2p msg="Stopping MConnection service" peer=d1d43cc7c7aef715957289fd96a114ecaa7ba756@65.21.198.100:21210
2:45PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.21.198.100:21210} d1d43cc7c7aef715957289fd96a114ecaa7ba756 out}"
2:45PM INF service stop impl="Peer{MConn{65.21.198.100:21210} d1d43cc7c7aef715957289fd96a114ecaa7ba756 out}" module=p2p msg="Stopping Peer service" peer=d1d43cc7c7aef715957289fd96a114ecaa7ba756@65.21.198.100:21210
2:45PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749940 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:45PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:45PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:45PM ERR Can't verify err="failed to obtain the header at height #8749940: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:45PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749940: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:45PM INF Snapshot rejected format=3 hash="��W^�\x14fq]\a�T+O�Y#z�e}0�G�R&�\x1e�M%" height=8745000 module=statesync
2:45PM INF VerifyHeader hash=270B8FBD43C077FB593176D09748583943B9F1B46223069C3137405C91CDB1CC height=8744001 module=light
2:45PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=5 numToDial=35
2:45PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.106.168:10126} 57c605fa2f7796dd2371ab9ca412bcf9a57d3f71 out}"
2:45PM INF service start impl="Peer{MConn{88.198.39.169:34656} a6085096ab5c44dacdea4c0ca83f194f29a5485a out}" module=p2p msg="Starting Peer service" peer=a6085096ab5c44dacdea4c0ca83f194f29a5485a@88.198.39.169:34656
2:45PM INF service start impl=MConn{88.198.39.169:34656} module=p2p msg="Starting MConnection service" peer=a6085096ab5c44dacdea4c0ca83f194f29a5485a@88.198.39.169:34656
2:45PM INF service start impl="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}" module=p2p msg="Starting Peer service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:45PM INF service start impl=MConn{176.9.82.221:22056} module=p2p msg="Starting MConnection service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:45PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{176.9.82.221:22056} module=p2p peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:45PM INF service stop impl=MConn{176.9.82.221:22056} module=p2p msg="Stopping MConnection service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:45PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}"
2:45PM INF service stop impl="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}" module=p2p msg="Stopping Peer service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:45PM INF Discovered new snapshot format=3 hash="�I���Li�gt��\x1a�\x18\n��xȝ\v��d�_���\x12\x01" height=8740000 module=statesync
2:46PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749920 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:46PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:46PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:46PM ERR Can't verify err="failed to obtain the header at height #8749920: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:46PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749920: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:46PM INF Snapshot rejected format=3 hash="5�eon �����r�\x19R��t\x1f���ъ%j\f튮��" height=8744000 module=statesync
2:46PM INF VerifyHeader hash=CDA29521C075AB7E7271530C0E482E52BE6C02431E1D03B1AE3A240F706D0D32 height=8740001 module=light
2:46PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=6 numToDial=34
2:46PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.106.168:10126} 57c605fa2f7796dd2371ab9ca412bcf9a57d3f71 out}"
2:46PM INF service start impl="Peer{MConn{65.108.124.43:38656} 8c971e7fed202339dc557c2170a5be125153436a out}" module=p2p msg="Starting Peer service" peer=8c971e7fed202339dc557c2170a5be125153436a@65.108.124.43:38656
2:46PM INF service start impl=MConn{65.108.124.43:38656} module=p2p msg="Starting MConnection service" peer=8c971e7fed202339dc557c2170a5be125153436a@65.108.124.43:38656
2:46PM INF Discovered new snapshot format=3 hash="\x05D��\x04��%�\x1ci\x12��1ՏwC��u��\x1aF�3#*��" height=8748000 module=statesync
2:46PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749920 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:46PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:46PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:46PM ERR Can't verify err="failed to obtain the header at height #8749920: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:46PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749920: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:46PM INF Snapshot rejected format=3 hash="�I���Li�gt��\x1a�\x18\n��xȝ\v��d�_���\x12\x01" height=8740000 module=statesync
2:46PM INF VerifyHeader hash=AFEC91FD6A5809D7A2CCD1D82DB2522700D87B5C466B32FF1218D77CCFC5A685 height=8748001 module=light
2:46PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=7 numToDial=33
2:46PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{148.251.177.108:22056} ae29d8da169214e201c03789858b4228b56a004a out}"
2:46PM INF service start impl="Peer{MConn{91.183.62.162:26656} 86987eeff225699e67a6543de3622b8a986cce28 out}" module=p2p msg="Starting Peer service" peer=86987eeff225699e67a6543de3622b8a986cce28@91.183.62.162:26656
2:46PM INF service start impl=MConn{91.183.62.162:26656} module=p2p msg="Starting MConnection service" peer=86987eeff225699e67a6543de3622b8a986cce28@91.183.62.162:26656
2:46PM INF service start impl="Peer{MConn{167.235.13.19:27656} 0f6914c83ae7eae97ec045ce518f11c567c8a2a0 out}" module=p2p msg="Starting Peer service" peer=0f6914c83ae7eae97ec045ce518f11c567c8a2a0@167.235.13.19:27656
2:46PM INF service start impl=MConn{167.235.13.19:27656} module=p2p msg="Starting MConnection service" peer=0f6914c83ae7eae97ec045ce518f11c567c8a2a0@167.235.13.19:27656
2:46PM INF Discovered new snapshot format=3 hash="\x03��x�?G�\U0004da74�=x\"6:�Y���D�\x1c\x11��L%�" height=8730000 module=statesync
2:46PM INF Discovered new snapshot format=3 hash="�\\�\x1e�Q�}���Y�~\x11�AC�\x0f\x19�\x1f����]�h�\x1b" height=6615000 module=statesync
2:47PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749933 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:47PM ERR Can't verify err="failed to obtain the header at height #8749933: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:47PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749933: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:47PM INF Snapshot rejected format=3 hash="\x05D��\x04��%�\x1ci\x12��1ՏwC��u��\x1aF�3#*��" height=8748000 module=statesync
2:47PM INF VerifyHeader hash=0F2170F8353A4FAE6091416F4780F338A8F8342EF3F488FAA83128621B0891E8 height=8730001 module=light
2:47PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=692
2:47PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:47PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{88.198.39.169:34656} a6085096ab5c44dacdea4c0ca83f194f29a5485a out}"
2:47PM INF service start impl="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}" module=p2p msg="Starting Peer service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:47PM INF service start impl=MConn{173.249.24.244:20273} module=p2p msg="Starting MConnection service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:47PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{173.249.24.244:20273} module=p2p peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:47PM INF service stop impl=MConn{173.249.24.244:20273} module=p2p msg="Stopping MConnection service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:47PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}"
2:47PM INF service stop impl="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}" module=p2p msg="Stopping Peer service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:47PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749921 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:47PM ERR Can't verify err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:47PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:47PM INF Snapshot rejected format=3 hash="\x03��x�?G�\U0004da74�=x\"6:�Y���D�\x1c\x11��L%�" height=8730000 module=statesync
2:47PM INF error from light block request from primary, replacing... error="light block not found" height=7677001 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM INF failed to fetch and verify app hash err="light block not found" module=statesync
2:47PM INF Snapshot rejected format=3 hash="\x11�\rK��\v�W���\x05\f�q�����oy�Ε+<\x17?�\v" height=7677000 module=statesync
2:47PM INF error from light block request from primary, replacing... error="light block not found" height=7676001 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM INF failed to fetch and verify app hash err="light block not found" module=statesync
2:47PM INF Snapshot rejected format=3 hash="����Ka%$����\x01�ER\x11�;vî54Δ\x12-�A�u" height=7676000 module=statesync
2:47PM INF error from light block request from primary, replacing... error="light block not found" height=6615001 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:47PM INF failed to fetch and verify app hash err="light block not found" module=statesync
2:47PM INF Snapshot rejected format=3 hash="�\\�\x1e�Q�}���Y�~\x11�AC�\x0f\x19�\x1f����]�h�\x1b" height=6615000 module=statesync
2:47PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:47PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:47PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{142.132.194.124:11004} 0b06ebe3437af5443ab8a4cf6881380fb29a35bb out}"
2:47PM INF service start impl="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}" module=p2p msg="Starting Peer service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:47PM INF service start impl=MConn{65.108.200.40:38656} module=p2p msg="Starting MConnection service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:47PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.200.40:38656} module=p2p peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:47PM INF service stop impl=MConn{65.108.200.40:38656} module=p2p msg="Stopping MConnection service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:47PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}"
2:47PM INF service stop impl="Peer{MConn{65.108.200.40:38656} 98143b5dca162ba726536d07a6af6500d3e6fe1e out}" module=p2p msg="Stopping Peer service" peer=98143b5dca162ba726536d07a6af6500d3e6fe1e@65.108.200.40:38656
2:47PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:48PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:48PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:48PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.124.43:38656} 8c971e7fed202339dc557c2170a5be125153436a out}"
2:48PM INF service start impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Starting Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:48PM INF service start impl=MConn{65.108.231.124:38656} module=p2p msg="Starting MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:48PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.231.124:38656} module=p2p peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:48PM INF service stop impl=MConn{65.108.231.124:38656} module=p2p msg="Stopping MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:48PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}"
2:48PM INF service stop impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Stopping Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:48PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:48PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:48PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:48PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{167.235.13.19:27656} 0f6914c83ae7eae97ec045ce518f11c567c8a2a0 out}"
2:48PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:48PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:48PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:48PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:48PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:48PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:48PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:49PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:49PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=692
2:49PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:49PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{88.198.39.169:34656} a6085096ab5c44dacdea4c0ca83f194f29a5485a out}"
2:49PM INF service start impl="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}" module=p2p msg="Starting Peer service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:49PM INF service start impl=MConn{173.249.24.244:20273} module=p2p msg="Starting MConnection service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:49PM INF service start impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Starting Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF service start impl=MConn{65.108.231.124:38656} module=p2p msg="Starting MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{173.249.24.244:20273} module=p2p peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:49PM INF service stop impl=MConn{173.249.24.244:20273} module=p2p msg="Stopping MConnection service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:49PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}"
2:49PM INF service stop impl="Peer{MConn{173.249.24.244:20273} 258f523c96efde50d5fe0a9faeea8a3e83be22ca out}" module=p2p msg="Stopping Peer service" peer=258f523c96efde50d5fe0a9faeea8a3e83be22ca@173.249.24.244:20273
2:49PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.231.124:38656} module=p2p peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF service stop impl=MConn{65.108.231.124:38656} module=p2p msg="Stopping MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}"
2:49PM INF service stop impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Stopping Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:49PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:49PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=9 numToDial=31
2:49PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{167.235.13.19:27656} 0f6914c83ae7eae97ec045ce518f11c567c8a2a0 out}"
2:49PM INF service start impl="Peer{MConn{169.155.171.162:36656} e726816f42831689eab9378d5d577f1d06d25716 out}" module=p2p msg="Starting Peer service" peer=e726816f42831689eab9378d5d577f1d06d25716@169.155.171.162:36656
2:49PM INF service start impl=MConn{169.155.171.162:36656} module=p2p msg="Starting MConnection service" peer=e726816f42831689eab9378d5d577f1d06d25716@169.155.171.162:36656
2:49PM INF service start impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Starting Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF service start impl=MConn{65.108.231.124:38656} module=p2p msg="Starting MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF service start impl="Peer{MConn{135.125.97.162:22056} 25ba965fee1b2800980524fc8d2f1394848f2b64 out}" module=p2p msg="Starting Peer service" peer=25ba965fee1b2800980524fc8d2f1394848f2b64@135.125.97.162:22056
2:49PM INF service start impl=MConn{135.125.97.162:22056} module=p2p msg="Starting MConnection service" peer=25ba965fee1b2800980524fc8d2f1394848f2b64@135.125.97.162:22056
2:49PM INF service start impl="Peer{MConn{45.87.104.39:27656} 3f9f633dc90131579b7e2d189306dc18c187d8ef out}" module=p2p msg="Starting Peer service" peer=3f9f633dc90131579b7e2d189306dc18c187d8ef@45.87.104.39:27656
2:49PM INF service start impl=MConn{45.87.104.39:27656} module=p2p msg="Starting MConnection service" peer=3f9f633dc90131579b7e2d189306dc18c187d8ef@45.87.104.39:27656
2:49PM INF Discovered new snapshot format=3 hash="a\x190Pmv���Y\n�A\n�H��U]��\x18�i@o�#���" height=8444000 module=statesync
2:49PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{65.108.231.124:38656} module=p2p peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF service stop impl=MConn{65.108.231.124:38656} module=p2p msg="Stopping MConnection service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}"
2:49PM INF service stop impl="Peer{MConn{65.108.231.124:38656} ae7191b2b922c6a59456588c3a262df518b0d130 out}" module=p2p msg="Stopping Peer service" peer=ae7191b2b922c6a59456588c3a262df518b0d130@65.108.231.124:38656
2:49PM INF VerifyHeader hash=EA5D206E426EAB4D6229A6CB96BBA2DE452577AF19178964554705B43176BB97 height=8444001 module=light
2:50PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=12 numToDial=28
2:50PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{148.251.177.108:22056} ae29d8da169214e201c03789858b4228b56a004a out}"
2:50PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:50PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:50PM INF service start impl="Peer{MConn{65.109.104.111:56102} 60939e5760138c1db7cd3c587780ab6a643638e1 out}" module=p2p msg="Starting Peer service" peer=60939e5760138c1db7cd3c587780ab6a643638e1@65.109.104.111:56102
2:50PM INF service start impl=MConn{65.109.104.111:56102} module=p2p msg="Starting MConnection service" peer=60939e5760138c1db7cd3c587780ab6a643638e1@65.109.104.111:56102
2:50PM INF service start impl="Peer{MConn{65.109.28.165:2010} 5a3fbbc0df045886623714e8b373168ba7a405b7 out}" module=p2p msg="Starting Peer service" peer=5a3fbbc0df045886623714e8b373168ba7a405b7@65.109.28.165:2010
2:50PM INF service start impl=MConn{65.109.28.165:2010} module=p2p msg="Starting MConnection service" peer=5a3fbbc0df045886623714e8b373168ba7a405b7@65.109.28.165:2010
2:50PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:50PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:50PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:50PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:50PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749926 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:50PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:50PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:50PM ERR Can't verify err="failed to obtain the header at height #8749926: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:50PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749926: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:50PM INF Snapshot rejected format=3 hash="a\x190Pmv���Y\n�A\n�H��U]��\x18�i@o�#���" height=8444000 module=statesync
2:50PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:50PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:50PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=14 numToDial=26
2:50PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.109.28.165:2010} 5a3fbbc0df045886623714e8b373168ba7a405b7 out}"
2:50PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:51PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:51PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=693
2:51PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=14 numToDial=26
2:51PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.106.168:10126} 57c605fa2f7796dd2371ab9ca412bcf9a57d3f71 out}"
2:51PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:51PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:51PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=14 numToDial=26
2:51PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{169.155.171.162:36656} e726816f42831689eab9378d5d577f1d06d25716 out}"
2:51PM INF service start impl="Peer{MConn{147.135.9.107:26656} caf6d78a00ae993fbdf8fff17fd8b9282766eef2 out}" module=p2p msg="Starting Peer service" peer=caf6d78a00ae993fbdf8fff17fd8b9282766eef2@147.135.9.107:26656
2:51PM INF service start impl=MConn{147.135.9.107:26656} module=p2p msg="Starting MConnection service" peer=caf6d78a00ae993fbdf8fff17fd8b9282766eef2@147.135.9.107:26656
2:51PM INF Discovered new snapshot format=3 hash="�cD��� 7�S�\x1c�fh�m]��7�\f�\t\f�`�7" height=8534000 module=statesync
2:51PM INF service start impl="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}" module=p2p msg="Starting Peer service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:51PM INF service start impl=MConn{176.9.82.221:22056} module=p2p msg="Starting MConnection service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:51PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{176.9.82.221:22056} module=p2p peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:51PM INF service stop impl=MConn{176.9.82.221:22056} module=p2p msg="Stopping MConnection service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:51PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}"
2:51PM INF service stop impl="Peer{MConn{176.9.82.221:22056} ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0 out}" module=p2p msg="Stopping Peer service" peer=ade4d8bc8cbe014af6ebdf3cb7b1e9ad36f412c0@176.9.82.221:22056
2:51PM INF VerifyHeader hash=0EFFDFC12C9621BBC9556D4143A3E31252303E07C261E2E0387E6CBB472B558C height=8534001 module=light
2:52PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=15 numToDial=25
2:52PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.109.28.165:2010} 5a3fbbc0df045886623714e8b373168ba7a405b7 out}"
2:52PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:52PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:52PM INF service start impl="Peer{MConn{49.12.150.42:26676} 6012544a6bbdcab033abf731418fcc3351c37cff out}" module=p2p msg="Starting Peer service" peer=6012544a6bbdcab033abf731418fcc3351c37cff@49.12.150.42:26676
2:52PM INF service start impl=MConn{49.12.150.42:26676} module=p2p msg="Starting MConnection service" peer=6012544a6bbdcab033abf731418fcc3351c37cff@49.12.150.42:26676
2:52PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:52PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:52PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:52PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:52PM INF error from light block request from primary, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" height=8749921 module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:52PM ERR error on light block request from witness, removing... error="post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light primary=http{https://elys-testnet-rpc.polkachu.com:443}
2:52PM ERR failed to remove witnesses err="no witnesses connected. please reset light client" module=light witnessesToRemove=[0]
2:52PM ERR Can't verify err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=light
2:52PM INF failed to fetch and verify app hash err="failed to obtain the header at height #8749921: post failed: Post \"https://elys-testnet-rpc.polkachu.com:443\": context deadline exceeded" module=statesync
2:52PM INF Snapshot rejected format=3 hash="�cD��� 7�S�\x1c�fh�m]��7�\f�\t\f�`�7" height=8534000 module=statesync
2:52PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:52PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:52PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=16 numToDial=24
2:52PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{88.198.39.169:34656} a6085096ab5c44dacdea4c0ca83f194f29a5485a out}"
2:52PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:53PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:53PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=693
2:53PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=16 numToDial=24
2:53PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{88.198.39.169:34656} a6085096ab5c44dacdea4c0ca83f194f29a5485a out}"
2:53PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:53PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:53PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=16 numToDial=24
2:53PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.109.104.111:56102} 60939e5760138c1db7cd3c587780ab6a643638e1 out}"
2:53PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:53PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:53PM INF service start impl="Peer{MConn{164.152.161.168:36656} e1b058e5cfa2b836ddaa496b10911da62dcf182e out}" module=p2p msg="Starting Peer service" peer=e1b058e5cfa2b836ddaa496b10911da62dcf182e@164.152.161.168:36656
2:53PM INF service start impl=MConn{164.152.161.168:36656} module=p2p msg="Starting MConnection service" peer=e1b058e5cfa2b836ddaa496b10911da62dcf182e@164.152.161.168:36656
2:53PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:53PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:53PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:53PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:53PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:54PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:54PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=17 numToDial=23
2:54PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{49.12.150.42:26676} 6012544a6bbdcab033abf731418fcc3351c37cff out}"
2:54PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:54PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:54PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=17 numToDial=23
2:54PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{148.251.177.108:22056} ae29d8da169214e201c03789858b4228b56a004a out}"
2:54PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:54PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:54PM INF service start impl="Peer{MConn{37.27.127.145:15356} 4f2ccdacad41a8bd64195ce196607c611bf568d7 out}" module=p2p msg="Starting Peer service" peer=4f2ccdacad41a8bd64195ce196607c611bf568d7@37.27.127.145:15356
2:54PM INF service start impl=MConn{37.27.127.145:15356} module=p2p msg="Starting MConnection service" peer=4f2ccdacad41a8bd64195ce196607c611bf568d7@37.27.127.145:15356
2:54PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:54PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:54PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:54PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:54PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:55PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:55PM INF Saving AddrBook to file book=/validator-home-4/elys/.elys/config/addrbook.json module=p2p size=693
2:55PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=18 numToDial=22
2:55PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.108.195.29:23656} 609c64cc50fb4ebbe7cae3347545d3950ea2c018 out}"
2:55PM INF service start impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Starting Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:55PM INF service start impl=MConn{195.3.221.9:27296} module=p2p msg="Starting MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:55PM INF service start impl="Peer{MConn{57.128.117.105:26656} 56570ed01748607f384e5ac2590945003eed0dd1 out}" module=p2p msg="Starting Peer service" peer=56570ed01748607f384e5ac2590945003eed0dd1@57.128.117.105:26656
2:55PM INF service start impl=MConn{57.128.117.105:26656} module=p2p msg="Starting MConnection service" peer=56570ed01748607f384e5ac2590945003eed0dd1@57.128.117.105:26656
2:55PM INF Connection is closed @ recvRoutine (likely by the other side) conn=MConn{195.3.221.9:27296} module=p2p peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:55PM INF service stop impl=MConn{195.3.221.9:27296} module=p2p msg="Stopping MConnection service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:55PM ERR Stopping peer for error err=EOF module=p2p peer="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}"
2:55PM INF service stop impl="Peer{MConn{195.3.221.9:27296} 5c2a752c9b1952dbed075c56c600c3a79b58c395 out}" module=p2p msg="Stopping Peer service" peer=5c2a752c9b1952dbed075c56c600c3a79b58c395@195.3.221.9:27296
2:55PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:55PM INF sync any module=statesync msg="Discovering snapshots for 15s"
2:55PM INF Ensure peers module=pex numDialing=0 numInPeers=0 numOutPeers=19 numToDial=21
2:55PM INF We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{65.109.28.165:2010} 5a3fbbc0df045886623714e8b373168ba7a405b7 out}"
2:55PM INF sync any module=statesync msg="Discovering snapshots for 15s"