search

hyperledger / besu

An enterprise-grade Java-based, Apache 2.0 licensed Ethereum client https://wiki.hyperledger.org/display/besu
https://www.hyperledger.org/projects/besu
Apache License 2.0
1.44k stars 764 forks source link

Measure time to sync using post-merge checkpoint sync #6566

Closed siladu closed 1 week ago

siladu commented 5 months ago

https://consensyssoftware.atlassian.net/wiki/spaces/PEG/pages/398894661969/Checkpoint+Sync+from+Recent+Block

siladu commented 4 months ago

dev-elc-besu-teku-mainnet-simon-pmcp-24.1.2-teku-1

Total sync time: 6 hours, 23 minutes

Finished worldstate snapsync with nodes 355747846 (healed=841721) duration 6:20:27,139

{"@timestamp":"2024-02-20T02:41:29,754","level":"INFO","thread":"main","class":"CheckpointDownloaderFactory","message":"Checkpoint sync start with block 19265927 and hash 0x9bf13fbcd7a99b5ebe0b0567a58435046338663e3eb9a560060af3afa0493dcd","throwable":""}
...
{"@timestamp":"2024-02-20T02:41:30,651","level":"INFO","thread":"main","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19255403 (0x39a9b79ebfa7892eac51751a8d304e0b77f6516a43ed3c5e5bce16c3f18b4197). State root 0xd53c543777e237cc35f8dd5fc67a7c6546601c2e52b77387de4bf723bc9c793e pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-20T02:42:32,341","level":"INFO","thread":"EthScheduler-Services-3 (batchPersistAccountData)","class":"SnapsyncMetricsManager","message":"Worldstate download progress: 0.00%, Peer count: 2","throwable":""}
...
...
{"@timestamp":"2024-02-20T08:53:08,728","level":"INFO","thread":"EthScheduler-Services-3 (batchPersistAccountData)","class":"SnapsyncMetricsManager","message":"Worldstate download progress: 99.99%, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:53:18,560","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapWorldDownloadState","message":"Running world state heal process from peers with pivot block 19267801","throwable":""}
{"@timestamp":"2024-02-20T08:54:08,750","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 123494 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:55:08,811","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 235490 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:56:08,925","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 310040 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:57:08,931","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 431652 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:58:08,936","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 564646 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T08:59:09,005","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 692054 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:00:09,012","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 824858 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:01:57,798","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 355747846 (healed=841721) duration 6:20:27,139.","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,105","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"PipelineChainDownloader","message":"PipelineChain download complete","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,118","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"DefaultSynchronizer","message":"Sync completed successfully with pivot block 19267801","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,119","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"BesuControllerBuilder","message":"Initial sync done, unsubscribe forkchoice supplier","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,120","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"TransactionPoolFactory","message":"Enabling transaction handling following initial sync","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,120","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"BlockPropagationManager","message":"Block propagation was running, then ttd reached","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,120","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"DefaultSynchronizer","message":"Stopping block propagation.","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,121","level":"INFO","thread":"EthScheduler-Services-48 (importBlock)","class":"DefaultSynchronizer","message":"Stopping the pruner.","throwable":""}
{"@timestamp":"2024-02-20T09:02:00,965","level":"INFO","thread":"vert.x-worker-thread-0","class":"BackwardSyncContext","message":"Starting a new backward sync session","throwable":""}
{"@timestamp":"2024-02-20T09:02:42,923","level":"INFO","thread":"ForkJoinPool.commonPool-worker-79","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 1.02% completed, imported 1 blocks of at least 98 (current head 19267802, target head 19267899). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,408","level":"INFO","thread":"ForkJoinPool.commonPool-worker-79","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,570","level":"WARN","thread":"ForkJoinPool.commonPool-worker-79","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xb3bbcee5304cb71f13a287969dc128028477aa1408f9c754b250d052077d238c","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,570","level":"WARN","thread":"ForkJoinPool.commonPool-worker-79","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xb3bbcee5304cb71f13a287969dc128028477aa1408f9c754b250d052077d238c","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,570","level":"WARN","thread":"ForkJoinPool.commonPool-worker-79","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xb3bbcee5304cb71f13a287969dc128028477aa1408f9c754b250d052077d238c","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,570","level":"WARN","thread":"ForkJoinPool.commonPool-worker-79","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xb3bbcee5304cb71f13a287969dc128028477aa1408f9c754b250d052077d238c","throwable":""}
{"@timestamp":"2024-02-20T09:02:50,570","level":"WARN","thread":"ForkJoinPool.commonPool-worker-79","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xb3bbcee5304cb71f13a287969dc128028477aa1408f9c754b250d052077d238c","throwable":""}
{"@timestamp":"2024-02-20T09:03:00,232","level":"INFO","thread":"vert.x-worker-thread-0","class":"BackwardSyncContext","message":"Starting a new backward sync session","throwable":""}
{"@timestamp":"2024-02-20T09:03:01,422","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"BackwardSyncStep","message":"Backward sync phase 1 of 2 completed, downloaded a total of 200 headers. Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:03:09,000","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 1.08% completed, imported 1 blocks of at least 93 (current head 19267813, target head 19267905). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:03:23,294","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 12.77% completed, imported 12 blocks of at least 94 (current head 19267824, target head 19267906). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:03:36,486","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 25.26% completed, imported 24 blocks of at least 95 (current head 19267836, target head 19267907). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:03:46,719","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 40.63% completed, imported 39 blocks of at least 96 (current head 19267851, target head 19267908). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:03:56,854","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 57.73% completed, imported 56 blocks of at least 97 (current head 19267868, target head 19267909). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:04:07,163","level":"INFO","thread":"nioEventLoopGroup-3-1","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 72.45% completed, imported 71 blocks of at least 98 (current head 19267883, target head 19267910). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:04:17,838","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 84.85% completed, imported 84 blocks of at least 99 (current head 19267896, target head 19267911). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:04:28,203","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 99.00% completed, imported 99 blocks of at least 100 (current head 19267911, target head 19267912). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:04:28,686","level":"INFO","thread":"ForkJoinPool.commonPool-worker-81","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2 completed, imported a total of 100 blocks. Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:04:28,686","level":"INFO","thread":"ForkJoinPool.commonPool-worker-81","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T09:04:38,344","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,267,913 / 229 tx / 16 ws / base fee 37.05 gwei / 22,658,942 (75.5%) gas / (0x739c9aec53c9bc0cf4b7b87fb25b231783174303234182233d0f548b126af9fc) in 1.015s. Peers: 25","throwable":""}
siladu commented 4 months ago

dev-elc-besu-prysm-mainnet-simon-pmcp-24.1.2-prysm-eip-4881

Total sync time: 6 hours, 13 minutes

Finished worldstate snapsync with nodes 355749652 (healed=822623) duration 6:5:36,772.

{"@timestamp":"2024-02-20T03:43:08,733","level":"INFO","thread":"main","class":"CheckpointDownloaderFactory","message":"Checkpoint sync start with block 19265927 and hash 0x9bf13fbcd7a99b5ebe0b0567a58435046338663e3eb9a560060af3afa0493dcd","throwable":""}
...
{"@timestamp":"2024-02-20T03:43:10,017","level":"INFO","thread":"main","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19266175 (0x92b691150e32c79fefcbcd5131b0a8e694992111b1215aad749ceda669bb2b3a). State root 0x5d367e48302ffb30feac175ccdf5f8b585a3e603f896add9379e2f8c1eab1a69 pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-20T03:46:11,154","level":"INFO","thread":"EthScheduler-Services-3 (batchPersistAccountData)","class":"SnapsyncMetricsManager","message":"Worldstate download progress: 0.00%, Peer count: 9","throwable":""}
...
...
{"@timestamp":"2024-02-20T09:41:33,402","level":"INFO","thread":"EthScheduler-Services-3 (batchPersistAccountData)","class":"SnapsyncMetricsManager","message":"Worldstate download progress: 99.98%, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:41:41,401","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapWorldDownloadState","message":"Running world state heal process from peers with pivot block 19268053","throwable":""}
{"@timestamp":"2024-02-20T09:42:33,414","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 112810 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:43:33,416","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 253235 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:44:33,427","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 395420 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:45:33,909","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 533375 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:46:33,913","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 666726 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:47:33,918","level":"INFO","thread":"EthScheduler-Services-26 (batchPersistTrieNodeData)","class":"SnapsyncMetricsManager","message":"Healed 821565 world state trie nodes, Peer count: 25","throwable":""}
{"@timestamp":"2024-02-20T09:48:46,799","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 355749652 (healed=822623) duration 6:5:36,772.","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,277","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"PipelineChainDownloader","message":"PipelineChain download complete","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,288","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"DefaultSynchronizer","message":"Sync completed successfully with pivot block 19268053","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,288","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"BesuControllerBuilder","message":"Initial sync done, unsubscribe forkchoice supplier","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,288","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"TransactionPoolFactory","message":"Enabling transaction handling following initial sync","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,289","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"BlockPropagationManager","message":"Block propagation was running, then ttd reached","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,289","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"DefaultSynchronizer","message":"Stopping block propagation.","throwable":""}
{"@timestamp":"2024-02-20T09:48:50,290","level":"INFO","thread":"EthScheduler-Services-5 (importBlock)","class":"DefaultSynchronizer","message":"Stopping the pruner.","throwable":""}
{"@timestamp":"2024-02-20T09:49:00,481","level":"INFO","thread":"vert.x-worker-thread-0","class":"BackwardSyncContext","message":"Starting a new backward sync session","throwable":""}
{"@timestamp":"2024-02-20T09:54:55,822","level":"INFO","thread":"nioEventLoopGroup-3-7","class":"BackwardSyncStep","message":"Backward sync phase 1 of 2 completed, downloaded a total of 1871 headers. Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:54:57,089","level":"INFO","thread":"ForkJoinPool.commonPool-worker-99","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 1.28% completed, imported 1 blocks of at least 78 (current head 19268054, target head 19268131). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,522","level":"INFO","thread":"ForkJoinPool.commonPool-worker-99","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,786","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,786","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,786","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,786","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:03,787","level":"WARN","thread":"ForkJoinPool.commonPool-worker-99","class":"MergeCoordinator","message":"Internal error, backward sync completed but failed to import finalized block 0xf307a7a013252c0c583a61d0693e224ae98733c1daa5a1b8edfdb42aeb043638","throwable":""}
{"@timestamp":"2024-02-20T09:55:12,987","level":"INFO","thread":"vert.x-worker-thread-0","class":"BackwardSyncContext","message":"Starting a new backward sync session","throwable":""}
{"@timestamp":"2024-02-20T09:55:13,037","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncStep","message":"Backward sync phase 1 of 2 completed, downloaded a total of 200 headers. Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:14,398","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 0.99% completed, imported 1 blocks of at least 101 (current head 19268062, target head 19268162). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:24,721","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 19.80% completed, imported 20 blocks of at least 101 (current head 19268081, target head 19268162). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:34,896","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 36.27% completed, imported 37 blocks of at least 102 (current head 19268098, target head 19268163). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:45,051","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 51.46% completed, imported 53 blocks of at least 103 (current head 19268114, target head 19268164). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:55:55,200","level":"INFO","thread":"nioEventLoopGroup-3-5","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 66.35% completed, imported 69 blocks of at least 104 (current head 19268130, target head 19268165). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:56:05,411","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 82.86% completed, imported 87 blocks of at least 105 (current head 19268148, target head 19268166). Peers: 18","throwable":""}
{"@timestamp":"2024-02-20T09:56:15,613","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2, 97.17% completed, imported 103 blocks of at least 106 (current head 19268164, target head 19268167). Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:56:16,943","level":"INFO","thread":"ForkJoinPool.commonPool-worker-100","class":"BackwardSyncContext","message":"Backward sync phase 2 of 2 completed, imported a total of 106 blocks. Peers: 25","throwable":""}
{"@timestamp":"2024-02-20T09:56:16,944","level":"INFO","thread":"ForkJoinPool.commonPool-worker-100","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T09:56:25,423","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,268,168 / 186 tx / 16 ws / base fee 37.50 gwei / 13,407,960 (44.7%) gas / (0x8414e732a294ac3b2a46eb4ec52dc85147ee58fda7d8216aa8face4a95a3bdae) in 0.611s. Peers: 25","throwable":""}
siladu commented 4 months ago

Test with 50 peers?

siladu commented 4 months ago

dev-elc-besu-prysm-mainnet-simon-pmcp-24.1.2-prysm

Total sync time: 7 hours, 45 minutes

Finished worldstate snapsync with nodes 355895137 (healed=968074) duration 7:34:30,404.

{"@timestamp":"2024-02-20T02:44:58,915","level":"INFO","thread":"main","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19265857 (0x2db176c764cd875d61f0f00025c1e7e5ca700c8bd5ba5aeec54094a255e97038). State root 0x4cd5aab3370ac4a5335d004d4bc3b148f8c27a1048e61b0a7f2331039c8bdc00 pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-20T10:19:29,331","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 355895137 (healed=968074) duration 7:34:30,404.","throwable":""}
...
{"@timestamp":"2024-02-20T10:28:56,599","level":"INFO","thread":"ForkJoinPool.commonPool-worker-208","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T10:29:01,745","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,268,326 / 121 tx / 16 ws / base fee 33.64 gwei / 10,733,067 (35.8%) gas / (0xa415d73e60bb7f80339e825366692594cc5a4e750781528110c6d426c6d673a9) in 0.520s. Peers: 25","throwable":""}
siladu commented 4 months ago

dev-elc-besu-teku-mainnet-simon-pmcp-24.1.2-teku-2

Total sync time: 8 hours, 38 minutes

Finished worldstate snapsync with nodes 355703808 (healed=784500) duration 8:8:31,831

{"@timestamp":"2024-02-20T02:42:53,799","level":"INFO","thread":"main","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19265857 (0x2db176c764cd875d61f0f00025c1e7e5ca700c8bd5ba5aeec54094a255e97038). State root 0x4cd5aab3370ac4a5335d004d4bc3b148f8c27a1048e61b0a7f2331039c8bdc00 pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-20T10:51:25,680","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 355703808 (healed=784500) duration 8:8:31,831.","throwable":""}
...
{"@timestamp":"2024-02-20T11:19:51,943","level":"INFO","thread":"ForkJoinPool.commonPool-worker-219","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-20T11:20:00,655","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,268,577 / 92 tx / 16 ws / base fee 31.65 gwei / 8,986,419 (30.0%) gas / (0x5767459510668618a9c220fa7c5b25779838c703f0f10eaca742c0eaa50deb21) in 0.526s. Peers: 25","throwable":""}
siladu commented 4 months ago

Test with 50 peers?

dev-elc-besu-teku-mainnet-simon-pmcp-24.1.2-teku-50-peers-1

Total sync time: 7 hours, 46 minutes

Finished worldstate snapsync with nodes 356122558 (healed=904849) duration 7:43:10,870.

{"@timestamp":"2024-02-22T07:29:25,381","level":"INFO","thread":"nioEventLoopGroup-3-2","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19281593 (0x0f9996684ace22c8b2ae0b7e58bb143e531079d2706ec535508fb2d18f6a2a9e). State root 0x3ed6288ba3a9486909a4b7d9a444393c06d2d4dfd9f16993c05aa2433df7a824 pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-22T15:12:36,284","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 356122558 (healed=904849) duration 7:43:10,870.","throwable":""}
...
{"@timestamp":"2024-02-22T15:15:21,418","level":"INFO","thread":"ForkJoinPool.commonPool-worker-260","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-22T15:15:25,514","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,283,972 / 127 tx / 16 ws / base fee 62.73 gwei / 11,485,082 (38.3%) gas / (0x495ffdaa1ed37f64de3c72c0f8ad61bc909a97d34ec5f66f0d4c40d121128f20) in 0.509s. Peers: 49","throwable":""}

dev-elc-besu-teku-mainnet-simon-pmcp-24.1.2-teku-50-peers-2

Total sync time: 6 hours, 31 minutes

Finished worldstate snapsync with nodes 355998921 (healed=788195) duration 6:25:28,570

{"@timestamp":"2024-02-22T07:27:29,427","level":"INFO","thread":"nioEventLoopGroup-3-3","class":"SnapWorldStateDownloader","message":"Downloading world state from peers for pivot block 19281593 (0x0f9996684ace22c8b2ae0b7e58bb143e531079d2706ec535508fb2d18f6a2a9e). State root 0x3ed6288ba3a9486909a4b7d9a444393c06d2d4dfd9f16993c05aa2433df7a824 pending requests 0","throwable":""}
...
{"@timestamp":"2024-02-22T13:52:58,020","level":"INFO","thread":"EthScheduler-Services-36 (requestCompleteTask)","class":"SnapsyncMetricsManager","message":"Finished worldstate snapsync with nodes 355998921 (healed=788195) duration 6:25:28,570.","throwable":""}
...
{"@timestamp":"2024-02-22T13:58:27,918","level":"INFO","thread":"ForkJoinPool.commonPool-worker-76","class":"BackwardSyncAlgorithm","message":"Current backward sync session is done","throwable":""}
{"@timestamp":"2024-02-22T13:58:38,556","level":"INFO","thread":"vert.x-worker-thread-0","class":"AbstractEngineNewPayload","message":"Imported #19,283,595 / 180 tx / 16 ws / base fee 46.16 gwei / 14,830,521 (49.4%) gas / (0xa7c6479042bca3acb551d2965a2c6a43c639cbb991bcb21f2e22ca18fa43c92f) in 0.713s. Peers: 50","throwable":""}