0xPolygon / polygon-edge

A Framework for Building Ethereum-compatible Blockchain Networks
https://polygon.technology/solutions/polygon-edge/
Apache License 2.0
1.01k stars 531 forks source link

Block Can't Create & Sync #2076

Open avenbreaks opened 9 months ago

avenbreaks commented 9 months ago

Block Can't Create & Sync

Description

I can't connect to bootnodes and can't build new blocks, I'm running 4 nodes in the cloud, and tcp udp firewall is open but no response from polygon-edge. any suggestions ?

Your environment

Golang: Go 1.20 Polygon-Edge: v1.3.1 Firewall : All tcp udp opened

Logs

2024-01-04T09:17:51.136Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=2
2024-01-04T09:17:51.137Z [INFO]  polygon.server.ibft.consensus: round started: round=3
2024-01-04T09:17:51.137Z [DEBUG] polygon.server.ibft.consensus: enter: new round state
2024-01-04T09:17:51.138Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=3 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a
2024-01-04T09:19:13.138Z [DEBUG] polygon.server.ibft.consensus: exit: new round state
2024-01-04T09:19:13.138Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=3
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: round started: round=4
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-01-04T09:19:13.140Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=4 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a
avenbreaks commented 9 months ago

@Stefan-Ethernal

avenbreaks commented 9 months ago

Block Can't Create & Sync

Description

I can't connect to bootnodes and can't build new blocks, I'm running 4 nodes in the cloud, and tcp udp firewall is open but no response from polygon-edge. any suggestions ?

Your environment

Golang: Go 1.20 Polygon-Edge: v1.3.1 Firewall : All tcp udp opened

Logs

2024-01-04T09:17:51.136Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=2
2024-01-04T09:17:51.137Z [INFO]  polygon.server.ibft.consensus: round started: round=3
2024-01-04T09:17:51.137Z [DEBUG] polygon.server.ibft.consensus: enter: new round state
2024-01-04T09:17:51.138Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=3 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a
2024-01-04T09:19:13.138Z [DEBUG] polygon.server.ibft.consensus: exit: new round state
2024-01-04T09:19:13.138Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=3
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: round started: round=4
2024-01-04T09:19:13.139Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-01-04T09:19:13.140Z [DEBUG] polygon.server.ibft: validator message received: type=ROUND_CHANGE height=1 round=4 addr=0x2c855a9238a1CAe308d435183cCFb5a045522C5a

solved, but got issue on create contract using remix

Gas estimation failed
Gas estimation errored with the following message (see below). The transaction execution will likely fail. Do you want to force sending?
Returned error: opcode not found

What the best set the gas fee on chain?

RonTuretzky commented 9 months ago

wait when you go to the node rpc port in browser what do you get as a result? if the networking part works you should get something like

{"name":"","chain_id":,"version":""}

uri-lightblocks commented 8 months ago

@avenbreaks how did you solve the issue with nodes not creating new blocks? cc: @RonTuretzky , @Stefan-Ethernal I have the same issue. 4 nodes all are with --seal

2024-01-27T08:37:43.928Z [INFO]  polygon.server.polybft.consensus_runtime: Proposer calculated: height=1176037 round=2 address=0xd04Ddf207f8579a1C7466784027B90414735807E
2024-01-27T08:37:43.928Z [INFO]  polygon.server.polybft: we are the proposer
2024-01-27T08:38:23.927Z [ERROR] polygon.server.polybft: unable to build proposal
2024-01-27T08:38:23.927Z [INFO]  polygon.server.polybft: round timeout expired: round=2
2024-01-27T08:38:23.928Z [INFO]  polygon.server.polybft: round started: round=3

The only place I find the error unable to build proposal without any other text is in ibft, but I use polybft

the part from genesis.json

 "engine": {
            "polybft": {
                "initialValidatorSet": [
                    {
                        "address": "0xBB506E51b797674c08509527e3E607a75A20F0cF",
...
                    },
                    {
                        "address": "0xd04Ddf207f8579a1C7466784027B90414735807E",
...
                    },
                    {
                        "address": "0x7c8dc82c15abc3f69170C02fe3494281343D4e26",
...
                    },
                    {
                        "address": "0xe3C1bEFE56fEDaC226A177b40792bad8FA79C321",
...
                    }
                ],
spudgy commented 8 months ago

I am having the same issue, no new blocks Only round timeout

RonTuretzky commented 8 months ago

I am having the same issue, no new blocks Only round timeout

If you restart the binary, does proposer calculation happen then ~10 block rounds? @spudgy

spudgy commented 8 months ago

Not really, I'v reached full disk limit and since than my docker won't mint any new blocks even after cleaning up some space.

RonTuretzky commented 8 months ago

Not really, I'v reached full disk limit and since than my docker won't mint any new blocks even after cleaning up some space.

Share the errors ?

spudgy commented 8 months ago

I'm using v1.1.0


2024-02-15T20:51:55.258Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=0
2024-02-15T20:51:55.260Z [INFO]  polygon.server.ibft.consensus: round started: round=1
2024-02-15T20:51:55.261Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-02-15T20:51:59.921Z [INFO]  polygon.server.jsonrpc: Websocket connection established
2024-02-15T20:52:17.260Z [ERROR] polygon.server.ibft.consensus: unable to build proposal
2024-02-15T20:52:17.260Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=1
2024-02-15T20:52:17.262Z [INFO]  polygon.server.ibft.consensus: round started: round=2
2024-02-15T20:52:22.695Z [INFO]  polygon.server.jsonrpc: Websocket connection established

2024-02-15T20:53:28.017Z [INFO]  polygon.server.ibft.consensus: we are the proposer
2024-02-15T20:53:32.015Z [INFO]  polygon.server.ibft: executed txs: successful=0 failed=0 skipped=0 remaining=0
2024-02-15T20:53:32.018Z [INFO]  polygon.server.ibft: build block: number=935722 txs=0
2024-02-15T20:53:50.020Z [INFO]  polygon.server.ibft.consensus: round timeout expired: round=1
2024-02-15T20:53:50.022Z [INFO]  polygon.server.ibft.consensus: round started: round=2```
RonTuretzky commented 8 months ago

Did you try creating a backup and restoring to an earlier block? Also ibft has the regenesis command

doviethoang commented 17 hours ago

same issue with @spudgy pudgy Have you guys fixxed it ? Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.441Z [ERROR] polygon.server.ibft.consensus: unable to build proposal Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.441Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=2 Oct 17 04:29:27 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:29:27.442Z [INFO] polygon.server.ibft.consensus: round started: round=3 Oct 17 04:30:50 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:30:50.443Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=3 Oct 17 04:30:50 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:30:50.444Z [INFO] polygon.server.ibft.consensus: round started: round=4 Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.446Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=4 Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.447Z [INFO] polygon.server.ibft.consensus: round started: round=5 Oct 17 04:33:33 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:33.448Z [INFO] polygon.server.ibft.consensus: we are the proposer Oct 17 04:33:42 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:42.000Z [INFO] polygon.server.ibft: executed txs: successful=0 failed=0 skipped=0 remaining=0 Oct 17 04:33:42 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:33:42.000Z [INFO] polygon.server.ibft: build block: number=4058425 txs=0 Oct 17 04:38:56 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:38:56.448Z [INFO] polygon.server.ibft.consensus: round timeout expired: round=5 Oct 17 04:38:56 ip-172-24-10-32 polygon-edge[155360]: 2024-10-17T04:38:56.450Z [INFO] polygon.server.ibft.consensus: round started: round=6 I haved restart 3 validator nodes and still the same error