search

ethpandaops / checkpointz

An Ethereum beacon chain checkpoint sync provider
GNU General Public License v3.0
141 stars 31 forks source link

The Latest Finalized and Latest Justified Epoch and Block Roots do not appear on the UI. #161

Closed Faithtosin closed 8 months ago

Faithtosin commented 8 months ago

There have been issues with upgrading checkpointz to either v0.20.0 or v0.21.0 with the latest version of lodestar.

v0.19.2 does not have this issue but v0.20.0 and v0.21.0 both produce this error

v0.19.2 logs:

time="2024-03-25T18:27:18Z" level=info msg="loading config" cfgFile=/opt/checkpointz/config.yml
time="2024-03-25T18:27:18Z" level=error msg="Waiting for a healthy, non-syncing node before beginning.." error="no nodes found" module=beacon/default
time="2024-03-25T18:27:22Z" level=error msg="Subscriber error" error="finality not available" module=consensus/beacon topic=ready upstream="lodestar public"
time="2024-03-25T18:27:23Z" level=error msg="Waiting for a healthy, non-syncing node before beginning.." error="no nodes found" module=beacon/default
time="2024-03-25T18:27:28Z" level=error msg="Failed to check for genesis bundle" error="failed to store block: genesis time is unknown" module=beacon/default
time="2024-03-25T18:27:34Z" level=error msg="Failed to check for new serving checkpoint" error="failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:27:52Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=1 module=beacon/default slot=1290592
time="2024-03-25T18:28:08Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=2 module=beacon/default slot=1290592
time="2024-03-25T18:28:23Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=3 module=beacon/default slot=1290592
time="2024-03-25T18:28:38Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=4 module=beacon/default slot=1290592
time="2024-03-25T18:28:53Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=5 module=beacon/default slot=1290592
time="2024-03-25T18:28:53Z" level=error msg="No longer attempting to download historical block - too many failures" failure_count=5 module=beacon/default slot=1290592
time="2024-03-25T18:30:34Z" level=error msg="Failed to check for new serving checkpoint" error="failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:36:59Z" level=error msg="Failed to check for new serving checkpoint" error="failed to download and store deposit snapshot: status code: 404" module=beacon/default

v.21.0 logs:

time="2024-03-25T18:23:33Z" level=info msg="loading config" cfgFile=/opt/checkpointz/config.yml
time="2024-03-25T18:23:33Z" level=error msg="Waiting for a healthy, non-syncing node before beginning.." error="no nodes found" module=beacon/default
time="2024-03-25T18:23:37Z" level=error msg="Subscriber error" error="finality not available" module=consensus/beacon topic=ready upstream="lodestar public"
time="2024-03-25T18:23:37Z" level=error msg="Failed to check finality" error="failed to decide majority finality: no majority finality found" module=beacon/default node="lodestar public" reason=serving_updater
time="2024-03-25T18:23:37Z" level=error msg="Subscriber error" error="failed to decide majority finality: no majority finality found" module=consensus/beacon topic=finality_checkpoint_updated upstream="lodestar public"
time="2024-03-25T18:23:38Z" level=error msg="Waiting for a healthy, non-syncing node before beginning.." error="no nodes found" module=beacon/default
time="2024-03-25T18:23:43Z" level=error msg="Failed to check for serving checkpoint" error="head finalized checkpoint is unknown" module=beacon/default
time="2024-03-25T18:23:43Z" level=error msg="Failed to check for genesis bundle" error="failed to store block: genesis time is unknown" module=beacon/default
time="2024-03-25T18:23:54Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:23:58Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=1 module=beacon/default slot=1290592
time="2024-03-25T18:24:15Z" level=error msg="Failed to check for new serving checkpoint after finality checkpoint updated" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default node="lodestar public" reason=serving_updater
time="2024-03-25T18:24:15Z" level=error msg="Subscriber error" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=consensus/beacon topic=finality_checkpoint_updated upstream="lodestar public"
time="2024-03-25T18:24:15Z" level=error msg="Failed to check for new serving checkpoint after epoch change" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default node="lodestar public" reason=serving_updater
time="2024-03-25T18:24:16Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:24:26Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=2 module=beacon/default slot=1290592
time="2024-03-25T18:24:36Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:24:41Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=3 module=beacon/default slot=1290592
time="2024-03-25T18:24:56Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:24:56Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=4 module=beacon/default slot=1290592
time="2024-03-25T18:25:11Z" level=error msg="Failed to download historical block" error="invalid block" failure_count=5 module=beacon/default slot=1290592
time="2024-03-25T18:25:11Z" level=error msg="No longer attempting to download historical block - too many failures" failure_count=5 module=beacon/default slot=1290592
time="2024-03-25T18:25:16Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:25:36Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:25:56Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:26:16Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:26:36Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:26:56Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
time="2024-03-25T18:27:16Z" level=error msg="Failed to check for new serving checkpoint" error="failed to fetch bundle: failed to download and store deposit snapshot: status code: 404" module=beacon/default
Faithtosin commented 8 months ago

@samcm What do you think is causing this?

samcm commented 8 months ago

Ahh the deposit_snapshot method is required to serve a checkpoint now - I'm guessing Lodestar doesn't have support for this beacon api?

taxmeifyoucan commented 8 months ago

I can replicate this running lighthouse and Ephemery.

samcm commented 8 months ago

Fixed in v0.22.0!

Faithtosin commented 8 months ago

I can confirm the issue has been fixed. Thanks @samcm

nflaig commented 8 months ago

Ahh the deposit_snapshot method is required to serve a checkpoint now - I'm guessing Lodestar doesn't have support for this beacon api?

Just to clarify this, we don't support it and we currently don't plan to implement it as we already fully implemented EIP-6110 which obsoletes the API in Pectra. I guess could be useful to get historical deposits?

Thanks for fixing this on your end