search

sigp / lighthouse

Ethereum consensus client in Rust
https://lighthouse.sigmaprime.io/
Apache License 2.0
2.94k stars 746 forks source link

When using lighthouse in combination with Erigon, I have issues with Sepolia peers all the time #4408

Closed Aracki closed 4 weeks ago

Aracki commented 1 year ago

Description

When using lighthouse as Erigon CL, I have no other "lighthouse" clients as peers and also have lower number of peers compared to using ligthhouse as Geth CL. For Sepolia network this is a huge difference. For other networks it's not that problematic.

Version

Tried with v3.5.1, v4.1.0, v4.2.0

Present Behaviour

Two situations, tested with all 3 versions mentioned above.

  1. Lighthouse as CL for geth. More peers in general for all networks (30-50). Prysm as most common, after that Lighthouse and Nimbus.
  2. Lighthouse as CL for erigon. Less peers in general for Sepolia (0-8). Nimbus/Prysm most common, maybe Teku sometimes. But no lighthouse clients at all. If one appears it drops immediately, it's like it's dropping all lighthouse clients for some reason. This is the biggest issues for Sepolia, as for that network there are only few Nimbus/Prysm/Teku clients we are finding in network.

For monitoring peers I was using libp2p_peers_per_client metric. And this situation is happening for last several months already.

Expected Behaviour

I would expect lighthouse to behave almost the same nevertheless which EL client I am using.

divagant-martian commented 1 year ago

Do you think you could get some debug logs? Those would help to identify why peers are dropping

Aracki commented 1 year ago

Can you specify which exact DEBG logs you would like me to share? There are many of those.

Aracki commented 1 year ago

Here I've exported all the logs from the exact lighthouse with mentioned problem.

It is always stuck between one or two Nimbus/Prysm/Teku peers. No Lighthouse peers at all.

erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.606 DEBG Execution engine upcheck complete       state: Offline, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.846 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.846 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.975 DEBG Obtained peer's metadata                new_seq_no: 2310, peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.975 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679313, head_root: 0x2309…68f1, peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.975 DEBG Peer transitioned sync state            is_connected: true, their_finalized_epoch: 83726, their_head_slot: 2679313, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Synced, peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.975 INFO Sync state updated                      new_state: Synced, old_state: Stalled, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/bls_to_execution_change/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/sync_committee_contribution_and_proof/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/beacon_block/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/beacon_aggregate_and_proof/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/voluntary_exit/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/proposer_slashing/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 DEBG Subscribed to topic                     topic: /eth2/47eb72b3/attester_slashing/ssz_snappy, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:42.977 INFO Subscribed to topics                    topics: ["/eth2/47eb72b3/bls_to_execution_change/ssz_snappy", "/eth2/47eb72b3/sync_committee_contribution_and_proof/ssz_snappy", "/eth2/47eb72b3/beacon_block/ssz_snappy", "/eth2/47eb72b3/beacon_aggregate_and_proof/ssz_snappy", "/eth2/47eb72b3/voluntary_exit/ssz_snappy", "/eth2/47eb72b3/proposer_slashing/ssz_snappy", "/eth2/47eb72b3/attester_slashing/ssz_snappy"], service: network
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.183 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.184 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.319 DEBG Peer sent Goodbye                       client: Unknown, reason: Too many peers, peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.410 DEBG Identified Peer                         protocols: ["/ipfs/ping/1.0.0", "/meshsub/1.1.0", "/meshsub/1.0.0"], observed_address: "/ip4/34.83.11.226/tcp/34856", listening_addresses: ["/ip4/18.216.38.49/tcp/9000/p2p/16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW"], agent_version: teku/teku/v23.5.0/linux-x86_64/-privatebuild-openjdk64bitservervm-java-17, protocol_version: ipfs/0.1.0, peer: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.448 DEBG Obtained peer's metadata                new_seq_no: 5, peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.451 DEBG Peer disconnected                       peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.451 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679313, head_root: 0x2309…68f1, peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:43.451 DEBG Peer transitioned sync state            is_connected: false, their_finalized_epoch: 83726, their_head_slot: 2679313, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Synced, peer_id: 16Uiu2HAm6tBRd8J3P2FngRoRgNtBtK9SnWuKoXGeG1i3NcU3SgV9, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:45.000 DEBG Refused to advance head state           current_slot: 2679313, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:47.501 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:48.001 DEBG Running beacon chain per slot tasks     slot: Slot(2679314), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:48.001 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:50.787 DEBG Peer sent Goodbye                       client: Teku: version: v23.5.0, os_version: linux-x86_64, reason: Too many peers, peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:50.787 DEBG Peer disconnected                       peer_id: 16Uiu2HAkxxexUkjjh9rzPTkoqvT2jvdegLpC8GXp1s6euFeiHpmW, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:52.839 INFO UPnP not available                      error: IO error: Resource temporarily unavailable (os error 11), service: UPnP
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.000 WARN Low peer count                          peer_count: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.000 DEBG Slot timer                              sync_state: Synced, current_slot: 2679314, head_slot: 2679283, head_block: 0xc37b…2b40, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.000 INFO Synced                                  slot: 2679314, block:    …  empty, epoch: 83728, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, exec_hash: 0x9ac1…94cd (verified), peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.000 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: None, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.580 INFO Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.580 INFO Issuing forkchoiceUpdated               forkchoice_state: ForkchoiceState { head_block_hash: 0x9ac1f3eb7141e1dae93b2bd0e9d0f3de61ba6228388ed3320d3774c0643494cd, safe_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, finalized_block_hash: 0x0d0eeec972676a7f95cc8fb84d5e45499030fb9431ffeaa8463c8e5423fcbf05 }, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.581 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:54.581 DEBG Sync's view on execution engine state updated, new_state: Online, past_state: Offline, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:56.000 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:57.001 DEBG Refused to advance head state           current_slot: 2679314, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:02:59.500 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:00.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679315), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:00.000 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.000 WARN Low peer count                          peer_count: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.000 DEBG Slot timer                              sync_state: Synced, current_slot: 2679315, head_slot: 2679283, head_block: 0xc37b…2b40, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.000 INFO Synced                                  slot: 2679315, block:    …  empty, epoch: 83728, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, exec_hash: 0x9ac1…94cd (verified), peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.000 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: None, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.581 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:06.581 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:08.000 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:09.000 DEBG Refused to advance head state           current_slot: 2679315, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:11.500 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679316), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.001 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.448 DEBG Starting a new peer discovery query     wanted: 80, outbound: 0, target: 80, connected: 0, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Discovery query completed               peers_found: 4, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Starting a new peer discovery query     wanted: 76, outbound: 0, target: 80, connected: 0, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm7Q5sCKmW1GpxjNbzFfyqWkQXU972dgcXeqyVkG5v14NA, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAmFadhPneXGGGePEAgh1Qb53wja5AUKUNe5Nu2s9oezMAJ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm9GMJ9tVBrLaiCcwcorked7JToNzLR29YhpmnTYedxHWe, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.578 DEBG Starting a peer discovery request       target_peers: 16, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.858 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAmFadhPneXGGGePEAgh1Qb53wja5AUKUNe5Nu2s9oezMAJ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.858 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAmFadhPneXGGGePEAgh1Qb53wja5AUKUNe5Nu2s9oezMAJ, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.859 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAm7Q5sCKmW1GpxjNbzFfyqWkQXU972dgcXeqyVkG5v14NA, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.859 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/46.101.197.195/tcp/19114/p2p/16Uiu2HAm7Q5sCKmW1GpxjNbzFfyqWkQXU972dgcXeqyVkG5v14NA: : Multistream select failed: Multistream select failed: Protocol error: I/O error: Connection reset by peer (os error 104): I/O error: Connection reset by peer (os error 104): Connection reset by peer (os error 104))], peer_id: Some(PeerId("16Uiu2HAm7Q5sCKmW1GpxjNbzFfyqWkQXU972dgcXeqyVkG5v14NA")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.928 DEBG Peer sent Goodbye                       client: Unknown, reason: Fault, peer_id: 16Uiu2HAmFadhPneXGGGePEAgh1Qb53wja5AUKUNe5Nu2s9oezMAJ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.997 DEBG Peer disconnected                       peer_id: 16Uiu2HAmFadhPneXGGGePEAgh1Qb53wja5AUKUNe5Nu2s9oezMAJ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:12.997 INFO Sync state updated                      new_state: Stalled, old_state: Synced, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.166 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm9GMJ9tVBrLaiCcwcorked7JToNzLR29YhpmnTYedxHWe, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.166 DEBG Peer disconnected                       peer_id: 16Uiu2HAm9GMJ9tVBrLaiCcwcorked7JToNzLR29YhpmnTYedxHWe, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.166 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm9GMJ9tVBrLaiCcwcorked7JToNzLR29YhpmnTYedxHWe, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.361 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.361 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.520 DEBG Peer sent Goodbye                       client: Unknown, reason: Too many peers, peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.673 DEBG Obtained peer's metadata                new_seq_no: 5, peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.674 DEBG Peer disconnected                       peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.674 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679316, head_root: 0x081a…c7f4, peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:13.674 DEBG Peer transitioned sync state            is_connected: false, their_finalized_epoch: 83726, their_head_slot: 2679316, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Advanced, peer_id: 16Uiu2HAm2hh19TyebmftUvMXdnTtdfv14rJUTZijq9sjkMMxCzxr, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.000 WARN Low peer count                          peer_count: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.000 DEBG Slot timer                              sync_state: Stalled, current_slot: 2679316, head_slot: 2679283, head_block: 0xc37b…2b40, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.001 INFO Searching for peers                     current_slot: 2679316, head_slot: 2679283, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.001 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: None, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.582 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:18.582 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:20.000 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:21.000 DEBG Refused to advance head state           current_slot: 2679316, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:23.501 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:24.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679317), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:24.000 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.000 WARN Low peer count                          peer_count: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.000 DEBG Slot timer                              sync_state: Stalled, current_slot: 2679317, head_slot: 2679283, head_block: 0xc37b…2b40, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.000 INFO Searching for peers                     current_slot: 2679317, head_slot: 2679283, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.000 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: None, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.583 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:30.583 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:32.000 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:33.000 DEBG Refused to advance head state           current_slot: 2679317, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:35.500 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:36.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679318), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:36.000 DEBG No change in canonical head             head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.000 WARN Low peer count                          peer_count: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.000 DEBG Slot timer                              sync_state: Stalled, current_slot: 2679318, head_slot: 2679283, head_block: 0xc37b…2b40, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.000 INFO Searching for peers                     current_slot: 2679318, head_slot: 2679283, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 0, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.000 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: None, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.251 DEBG No new deposits found                   total_deposits: 403, latest_block: 1412239, service: deposit_contract_rpc
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.251 DEBG Downloading execution blocks            last: None, first: None, service: deposit_contract_rpc
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.251 DEBG No new execution blocks imported        cached_blocks: 8044, latest_block: 3778132, service: deposit_contract_rpc
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.251 DEBG Updated deposit contract cache          deposits: DepositCacheUpdateOutcome { logs_imported: 0 }, blocks: BlockCacheUpdateOutcome { blocks_imported: 0, head_block_number: Some(3778132) }, retry_millis: 60000, service: deposit_contract_rpc
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.447 DEBG Starting a new peer discovery query     wanted: 80, outbound: 0, target: 80, connected: 0, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.569 DEBG Updating gossipsub score parameters     active_validators: 1972, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.580 DEBG Execution client config is OK           service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.584 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.584 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Discovery query completed               peers_found: 10, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Starting a new peer discovery query     wanted: 70, outbound: 0, target: 80, connected: 0, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAmAhxK7aL9rCUadAFHpWYgEvWh68Sxepj6oU7gTQYdCatV, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm5LqVmv4UBW5GP8PQVYUUVsCVAVkVzuPjsjFmChiAtSeZ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAkzT3CyYgEMBDQmVuVv6XhpZA3n6RuUEgxpZSCnDLapnWj, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAmJrgawxBxgRtScj4xpsxjfhbV8dyZf7cMkCAexPxPnrYV, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm3UPfzGVp828ZaBptSgDD446Pstem65mUizeTfFP2LRa7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Dialing discovered peer                 peer_id: 16Uiu2HAm2wQVVGb8gjiSKyjxGGLaRSAoZfwvikH5ohHcCxZPj7yo, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.606 DEBG Starting a peer discovery request       target_peers: 16, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.663 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.664 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.667 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAmJrgawxBxgRtScj4xpsxjfhbV8dyZf7cMkCAexPxPnrYV, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.667 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/4.36.26.74/tcp/31740/p2p/16Uiu2HAmJrgawxBxgRtScj4xpsxjfhbV8dyZf7cMkCAexPxPnrYV: : Multistream select failed: Multistream select failed: Protocol error: I/O error: Connection reset by peer (os error 104): I/O error: Connection reset by peer (os error 104): Connection reset by peer (os error 104))], peer_id: Some(PeerId("16Uiu2HAmJrgawxBxgRtScj4xpsxjfhbV8dyZf7cMkCAexPxPnrYV")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.678 DEBG Obtained peer's metadata                new_seq_no: 0, peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.680 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.680 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.692 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679318, head_root: 0xc352…8462, peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.693 DEBG Peer transitioned sync state            is_connected: true, their_finalized_epoch: 83726, their_head_slot: 2679318, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Advanced, peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.693 DEBG New chain added to sync                 id: 18425055356888798182, from: 83726, to: 83728, end_root: 0xc352…8462, current_target: 83726, batches: 0, peers: 1, validated_batches: 0, state: Stopped, sync_type: Head, peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.693 DEBG New head chain started syncing          id: 18425055356888798182, from: 83726, to: 83728, end_root: 0xc352…8462, current_target: 83726, batches: 0, peers: 1, validated_batches: 0, state: Stopped, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.693 DEBG Requesting batch                        start_slot: 2679233, end_slot: 2679296, downloaded: 0, processed: 0, processed_no_penalty: 0, state: Downloading(16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, 0 blocks, 1), epoch: 83726, chain: 18425055356888798182, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.693 INFO Sync state updated                      new_state: Syncing Head Chain, old_state: Stalled, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.698 DEBG Obtained peer's metadata                new_seq_no: 0, peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.716 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679318, head_root: 0xc352…8462, peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.717 DEBG Peer transitioned sync state            is_connected: true, their_finalized_epoch: 83726, their_head_slot: 2679318, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Advanced, peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.717 DEBG Adding peer to known chain              id: 18425055356888798182, from: 83726, to: 83728, end_root: 0xc352…8462, current_target: 83726, batches: 1, peers: 1, validated_batches: 0, state: Syncing, sync_type: Head, peer_id: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.717 DEBG Requesting batch                        start_slot: 2679297, end_slot: 2679360, downloaded: 0, processed: 0, processed_no_penalty: 0, state: Downloading(16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, 0 blocks, 2), epoch: 83728, chain: 18425055356888798182, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.749 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAm2wQVVGb8gjiSKyjxGGLaRSAoZfwvikH5ohHcCxZPj7yo, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.749 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/35.182.108.146/tcp/13000/p2p/16Uiu2HAm2wQVVGb8gjiSKyjxGGLaRSAoZfwvikH5ohHcCxZPj7yo: : Multistream select failed: Multistream select failed: Protocol error: I/O error: Connection reset by peer (os error 104): I/O error: Connection reset by peer (os error 104): Connection reset by peer (os error 104))], peer_id: Some(PeerId("16Uiu2HAm2wQVVGb8gjiSKyjxGGLaRSAoZfwvikH5ohHcCxZPj7yo")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.879 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAm5LqVmv4UBW5GP8PQVYUUVsCVAVkVzuPjsjFmChiAtSeZ, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.879 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/54.75.182.155/tcp/13000/p2p/16Uiu2HAm5LqVmv4UBW5GP8PQVYUUVsCVAVkVzuPjsjFmChiAtSeZ: : Multistream select failed: Multistream select failed: Protocol error: I/O error: Connection reset by peer (os error 104): I/O error: Connection reset by peer (os error 104): Connection reset by peer (os error 104))], peer_id: Some(PeerId("16Uiu2HAm5LqVmv4UBW5GP8PQVYUUVsCVAVkVzuPjsjFmChiAtSeZ")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.968 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm3UPfzGVp828ZaBptSgDD446Pstem65mUizeTfFP2LRa7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.968 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm3UPfzGVp828ZaBptSgDD446Pstem65mUizeTfFP2LRa7, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:42.968 DEBG Peer disconnected                       peer_id: 16Uiu2HAm3UPfzGVp828ZaBptSgDD446Pstem65mUizeTfFP2LRa7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.162 DEBG Completed batch received                awaiting_batches: 1, blocks: 20, epoch: 83728, chain: 18425055356888798182, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.178 DEBG Identified Peer                         protocols: ["/meshsub/1.1.0", "/meshsub/1.0.0", "/eth2/beacon_chain/req/status/1/ssz_snappy", "/eth2/beacon_chain/req/goodbye/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/1/ssz_snappy", "/eth2/beacon_chain/req/ping/1/ssz_snappy", "/eth2/beacon_chain/req/metadata/2/ssz_snappy", "/eth2/beacon_chain/req/metadata/1/ssz_snappy", "/ipfs/id/1.0.0", "/ipfs/id/push/1.0.0"], observed_address: "/ip4/34.83.11.226/tcp/48664", listening_addresses: ["/ip4/44.238.0.46/tcp/9001", "/ip4/127.0.0.1/tcp/9001", "/ip4/172.20.58.155/tcp/9001", "/ip4/172.17.0.1/tcp/9001", "/ip4/172.18.0.1/tcp/9001"], agent_version: Lighthouse/v4.1.0-693886b/x86_64-linux, protocol_version: eth2/1.0.0, peer: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.198 DEBG Identified Peer                         protocols: ["/meshsub/1.1.0", "/meshsub/1.0.0", "/eth2/beacon_chain/req/status/1/ssz_snappy", "/eth2/beacon_chain/req/goodbye/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/1/ssz_snappy", "/eth2/beacon_chain/req/ping/1/ssz_snappy", "/eth2/beacon_chain/req/metadata/2/ssz_snappy", "/eth2/beacon_chain/req/metadata/1/ssz_snappy", "/ipfs/id/1.0.0", "/ipfs/id/push/1.0.0"], observed_address: "/ip4/34.83.11.226/tcp/39320", listening_addresses: ["/ip4/137.184.9.72/tcp/9000", "/ip4/127.0.0.1/tcp/9000", "/ip4/10.244.4.129/tcp/9000"], agent_version: Lighthouse/v3.5.0-0fb58a6/x86_64-linux, protocol_version: eth2/1.0.0, peer: 16Uiu2HAmT87cDQNLfjC5mdBCtQhzZYytYMoqPArLESjFuHKoPuUf, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.234 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.234 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.299 DEBG Connection established                  connection: Dialer, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.299 DEBG Sending Status Request                  fork_digest: [71, 235, 114, 179], finalized_epoch: 83725, finalized_root: 0x21b6…96b8, head_slot: 2679283, head_root: 0xc37b…2b40, peer: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.391 DEBG Obtained peer's metadata                new_seq_no: 0, peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.547 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679318, head_root: 0xc352…8462, peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.547 DEBG Peer transitioned sync state            is_connected: true, their_finalized_epoch: 83726, their_head_slot: 2679318, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Advanced, peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.547 DEBG Adding peer to known chain              id: 18425055356888798182, from: 83726, to: 83728, end_root: 0xc352…8462, current_target: 83726, batches: 2, peers: 2, validated_batches: 0, state: Syncing, sync_type: Head, peer_id: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.575 DEBG Obtained peer's metadata                new_seq_no: 0, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.575 DEBG Received Status Response                fork_digest: [71, 235, 114, 179], finalized_epoch: 83726, finalized_root: 0x4788…d9fb, head_slot: 2679318, head_root: 0xc352…8462, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: router
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.575 DEBG Peer transitioned sync state            is_connected: true, their_finalized_epoch: 83726, their_head_slot: 2679318, our_finalized_epoch: 83725, our_head_slot: 2679283, new_state: Advanced, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.575 DEBG Adding peer to known chain              id: 18425055356888798182, from: 83726, to: 83728, end_root: 0xc352…8462, current_target: 83726, batches: 2, peers: 3, validated_batches: 0, state: Syncing, sync_type: Head, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.701 DEBG Completed batch received                awaiting_batches: 0, blocks: 60, epoch: 83726, chain: 18425055356888798182, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.890 DEBG Identified Peer                         protocols: ["/meshsub/1.1.0", "/meshsub/1.0.0", "/eth2/beacon_chain/req/status/1/ssz_snappy", "/eth2/beacon_chain/req/goodbye/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_range/1/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/2/ssz_snappy", "/eth2/beacon_chain/req/beacon_blocks_by_root/1/ssz_snappy", "/eth2/beacon_chain/req/ping/1/ssz_snappy", "/eth2/beacon_chain/req/metadata/2/ssz_snappy", "/eth2/beacon_chain/req/metadata/1/ssz_snappy", "/ipfs/id/1.0.0", "/ipfs/id/push/1.0.0"], observed_address: "/ip4/34.83.11.226/tcp/35230", listening_addresses: ["/ip4/65.108.235.160/tcp/19000", "/ip4/127.0.0.1/tcp/19000", "/ip4/65.108.235.160/tcp/19000"], agent_version: Lighthouse/v4.0.1-a53830f/x86_64-linux, protocol_version: eth2/1.0.0, peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:43.937 DEBG Identified Peer                         protocols: ["/ipfs/ping/1.0.0", "/meshsub/1.1.0", "/meshsub/1.0.0"], observed_address: "/ip4/34.83.11.226/tcp/37370", listening_addresses: ["/ip4/170.64.250.88/tcp/9000/p2p/16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7"], agent_version: teku/teku/v23.6.0/linux-x86_64/-eclipseadoptium-openjdk64bitservervm-java-17, protocol_version: ipfs/0.1.0, peer: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:44.000 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:44.110 DEBG Peer sent Goodbye                       client: Teku: version: v23.6.0, os_version: linux-x86_64, reason: Too many peers, peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:44.110 DEBG Peer disconnected                       peer_id: 16Uiu2HAm5auQJdfuJ3Goj2XLNYT9ktwkLiHLxLmDyhrDT9GJLZK7, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:45.001 DEBG Refused to advance head state           current_slot: 2679318, head_slot: 2679283, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:46.246 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:47.055 DEBG Peer disconnected                       peer_id: 16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:47.078 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:47.501 DEBG Fork choice updated head                old_head: 0xc37b8f31e0ae24aca18a82d79515f04ab2c27c77082815f4393c2f6ff21e2b40, old_head_weight: Some(5280000000000), new_head: 0x91d3e90be806cd716fdec0d9c73178278a45864eb66e32692b93bb19cdc18473, new_head_weight: Some(1824000000000), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:47.534 DEBG Issuing engine_forkchoiceUpdated        current_slot: 2679318, head_block_root: 0x91d3e90be806cd716fdec0d9c73178278a45864eb66e32692b93bb19cdc18473, head_block_hash: 0xd567c294cd1e754bf45c9988c33d3412666680b4441fb50e1488f2e3e068d9dc, justified_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, finalized_block_hash: 0x0d0eeec972676a7f95cc8fb84d5e45499030fb9431ffeaa8463c8e5423fcbf05, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:47.998 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:48.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679319), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:48.000 DEBG Fork choice updated head                old_head: 0x91d3e90be806cd716fdec0d9c73178278a45864eb66e32692b93bb19cdc18473, old_head_weight: Some(1824000000000), new_head: 0x9968ad1636982a84a02b5a64d3a3f62fed26d9cce04ecfcab28695f03e64c821, new_head_weight: Some(0), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:48.563 DEBG Rejected gossip block                   slot: 2679319, graffiti: Lighthouse/v3.5.0-0fb58a6, error: ParentUnknown(parent_root:0xc352…8462), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:48.569 DEBG Unknown parent for gossip block         root: 0x4ef7fe002ddcf125f843a1ffe224f6a75be381633e3e97819eae6e3fbfded85f
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:49.016 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:49.394 DEBG Issuing engine_forkchoiceUpdated        current_slot: 2679319, head_block_root: 0x9968ad1636982a84a02b5a64d3a3f62fed26d9cce04ecfcab28695f03e64c821, head_block_hash: 0xfcca9d2eb0d843a851d2a3c61cdcf60bd7db2a0262c390cffce00e14b69defef, justified_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, finalized_block_hash: 0x0d0eeec972676a7f95cc8fb84d5e45499030fb9431ffeaa8463c8e5423fcbf05, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:52.607 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAkzT3CyYgEMBDQmVuVv6XhpZA3n6RuUEgxpZSCnDLapnWj, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:52.607 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/70.66.48.169/tcp/9200/p2p/16Uiu2HAkzT3CyYgEMBDQmVuVv6XhpZA3n6RuUEgxpZSCnDLapnWj: : Timeout has been reached)], peer_id: Some(PeerId("16Uiu2HAkzT3CyYgEMBDQmVuVv6XhpZA3n6RuUEgxpZSCnDLapnWj")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:52.607 DEBG Marking peer disconnected in DHT        peer_id: 16Uiu2HAmAhxK7aL9rCUadAFHpWYgEvWh68Sxepj6oU7gTQYdCatV, service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:52.607 DEBG Failed to dial address                  error: Failed to negotiate transport protocol(s): [(/ip4/54.154.0.248/tcp/30304/p2p/16Uiu2HAmAhxK7aL9rCUadAFHpWYgEvWh68Sxepj6oU7gTQYdCatV: : Timeout has been reached)], peer_id: Some(PeerId("16Uiu2HAmAhxK7aL9rCUadAFHpWYgEvWh68Sxepj6oU7gTQYdCatV")), service: libp2p
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.002 DEBG Slot timer                              sync_state: Syncing Head Chain, current_slot: 2679319, head_slot: 2679286, head_block: 0x9968…c821, finalized_epoch: 83725, finalized_root: 0x21b6…96b8, peers: 2, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.002 INFO Syncing                                 est_time: --, distance: 33 slots (6 mins), peers: 2, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.002 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: 3779668, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.560 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.585 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:54.585 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:56.001 DEBG Proposer prepare routine firing         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:56.349 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:57.000 DEBG Refused to advance head state           current_slot: 2679319, head_slot: 2679286, service: state_advance
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:58.001 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.500 DEBG Fork choice updated head                old_head: 0x9968ad1636982a84a02b5a64d3a3f62fed26d9cce04ecfcab28695f03e64c821, old_head_weight: Some(10688000000000), new_head: 0xbf4ccefea021dff5d4c7029c509dff7cb30ea64a4407113d17333e9588d24bfa, new_head_weight: Some(1792000000000), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.500 DEBG Fork choice justified                   old_epoch: 83726, old_root: 0x4788065a3ef156a3ca0ccff3d26fa9cb44aa5b55a7e9d50ad442eb24f6d7d9fb, new_epoch: 83727, new_root: 0x6e8f16186badc0657cf1d8f666a5419ffd86170f767afc6607644d68ffab95a4, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.500 DEBG Fork choice finalized                   old_epoch: 83725, old_root: 0x21b63ed26bedd5ce779a83205dc278bfc98477bc7e464606ac043c64d60996b8, new_epoch: 83726, new_root: 0x4788065a3ef156a3ca0ccff3d26fa9cb44aa5b55a7e9d50ad442eb24f6d7d9fb, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.574 DEBG Snapshot cache pruned                   remaining_roots: [], new_len: 0, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.575 DEBG Database consolidation started          service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.575 DEBG Issuing engine_forkchoiceUpdated        current_slot: 2679319, head_block_root: 0xbf4ccefea021dff5d4c7029c509dff7cb30ea64a4407113d17333e9588d24bfa, head_block_hash: 0x1a151135e0de2fd2b3db01219f84cf0e37d9613171524eaa74547d20513275f1, justified_block_hash: 0x49aaf5dfa6dfcdb2206809935c6f5c996c3d65cc10633e2e28deec8b73c89078, finalized_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.597 DEBG Starting database pruning               new_finalized_epoch: 83726, old_finalized_epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.597 DEBG Extra pruning information               head_count: 1, new_finalized_root: 0x4788065a3ef156a3ca0ccff3d26fa9cb44aa5b55a7e9d50ad442eb24f6d7d9fb, old_finalized_root: 0x21b63ed26bedd5ce779a83205dc278bfc98477bc7e464606ac043c64d60996b8, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.669 DEBG Database pruning complete               service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.669 DEBG Freezer migration started               slot: 2679232, service: freezer_db
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.673 DEBG Freezer migration complete              slot: 2679232, service: freezer_db
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.673 DEBG Database consolidation complete         service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:03:59.866 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.000 DEBG Running beacon chain per slot tasks     slot: Slot(2679320), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.001 DEBG Fork choice updated head                old_head: 0xbf4ccefea021dff5d4c7029c509dff7cb30ea64a4407113d17333e9588d24bfa, old_head_weight: Some(3552000000000), new_head: 0xd31b3d2b615c19373eead62aa3fda0e9e297461a16a42ae097b9390e1176be58, new_head_weight: Some(1760000000000), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.565 DEBG Rejected gossip block                   slot: 2679320, graffiti: Lighthouse/v3.5.0-0fb58a6, error: ParentUnknown(parent_root:0x4ef7…d85f), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.568 DEBG Unknown parent for gossip block         root: 0xd97ff8a6b9c987e047fc7f2e12fb0dce7e8c6ccfda196d213d37ff88cdda4385
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.568 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x4ef7…d85f, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 1, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:00.992 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:01.048 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xc352…8462, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 2, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:01.541 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x081a…c7f4, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 3, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:01.883 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xc697…0fef, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 4, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:02.053 DEBG Eth1Cache: cache miss                   epoch: 83725, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:02.196 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xab50…fbec, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 5, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:02.537 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x2309…68f1, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 6, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:02.882 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x8d4b…48c0, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 7, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:03.145 DEBG Eth1Cache: cache miss                   epoch: 83726, service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:03.145 DEBG Fork choice updated head                old_head: 0xd31b3d2b615c19373eead62aa3fda0e9e297461a16a42ae097b9390e1176be58, old_head_weight: Some(7039000000000), new_head: 0xef13687925909c2a142af6e24655fecd2e1d0b6a26de5f9300af017b3764029d, new_head_weight: Some(0), service: beacon
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:03.196 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x71a3…5c3c, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 8, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:03.528 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xc9c7…8cd7, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 9, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:03.864 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x4e26…4bba, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 10, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:04.204 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x211a…f213, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 11, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:04.542 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x0bca…47b0, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 12, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:04.869 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xf041…6453, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 13, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:05.206 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xb453…062d, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 14, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:05.351 DEBG Issuing engine_forkchoiceUpdated        current_slot: 2679320, head_block_root: 0xd31b3d2b615c19373eead62aa3fda0e9e297461a16a42ae097b9390e1176be58, head_block_hash: 0xd34d7c3241bd604e5b81959961dc2e26b21e830bd45ec717bc7058d203c3f4bd, justified_block_hash: 0x49aaf5dfa6dfcdb2206809935c6f5c996c3d65cc10633e2e28deec8b73c89078, finalized_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:05.526 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x2295…675d, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 15, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:05.871 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0xa755…8c51, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 16, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.000 DEBG Slot timer                              sync_state: Syncing Head Chain, current_slot: 2679320, head_slot: 2679296, head_block: 0xef13…029d, finalized_epoch: 83726, finalized_root: 0x4788…d9fb, peers: 2, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.000 INFO Syncing                                 est_time: 0 mins, speed: 0.83 slots/sec, distance: 24 slots (4 mins), peers: 2, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.000 DEBG Eth1 cache sync status                  ready: true, voting_target_timestamp: 1687850336, latest_cached_timestamp: 1687864632, latest_cached_block_number: 3778132, eth1_head_block: 3779668, service: slot_notifier
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.170 DEBG Issuing engine_forkchoiceUpdated        current_slot: 2679320, head_block_root: 0xef13687925909c2a142af6e24655fecd2e1d0b6a26de5f9300af017b3764029d, head_block_hash: 0x731a727a43d1a32cae34ecba4356195583bc19fd62c53ec751da9dd8125239ad, justified_block_hash: 0x49aaf5dfa6dfcdb2206809935c6f5c996c3d65cc10633e2e28deec8b73c89078, finalized_block_hash: 0x73a58c41c4bd238f52db616a417f19bdad02ef80c3b4eb435a2cac606d34395d, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.171 DEBG Batch processed                         service: sync, processed_blocks: 60, last_block_slot: 2679296, chain: 18425055356888798182, first_block_slot: 2679233, batch_epoch: 83726
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.172 DEBG Batch processing result                 client: Lighthouse: version: v4.1.0-693886b, os_version: x86_64-linux, batch_epoch: 83726, start_slot: 2679233, end_slot: 2679296, downloaded: 0, processed: 0, processed_no_penalty: 0, state: Processing(16Uiu2HAm1rUrF4H1gwCKNb5orSZX7EkpbmC3GEwx9EN46ah37YZ2), result: Success { was_non_empty: true }, chain: 18425055356888798182, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.196 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x2b81…db96, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 17, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.532 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x5ec3…dbf6, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 18, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.586 DEBG Execution engine online                 service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:06.586 DEBG Execution engine upcheck complete       state: Synced, service: exec
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:07.256 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x5379…debf, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 19, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:07.579 DEBG Requesting parent                       chain_hash: 0xd97f…4385, request: parent, hash: 0x1163…29db, downloading_peer: 16Uiu2HAmABzX2SYgX4akDvBYDQo8Jp2EiEQRmmAhytJmNmbHu6AF, failed_downloads: 0, failed_processing: 0, downloaded_blocks: 20, service: sync
erigon-sepolia-1 erigon-sepolia-lighthouse Jun 27 17:04:08.000 DEBG Proposer prepare routine firing         service: beacon
michaelsproul commented 4 weeks ago

Closing as stale. Current versions shouldn't have this issue as we've updated the Sepolia bootnodes.