paradigmxyz / reth

Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust
https://reth.rs/
Apache License 2.0
3.78k stars 1.02k forks source link

Blind spot observability bodies stage, chunked chain import from file #8422

Open emhane opened 3 months ago

emhane commented 3 months ago

Describe the bug

In release mode, bodies stage enters an observability blind spot. This is not the case when import command runs in debug mode, then progress is steadily reported.

After entering the 3rd pipeline or so, the bodies stage appears to get stuck reporting a certain percentage.

The command completes successfully in release mode however after 6 hours (12 hours in debug mode).

Steps to reproduce

$ RUST_LOG=reth::cli,downloaders,sync=trace import-op <file-with-100-million-rlp-encoded-blocks> 

(same goes for import --no-state)

Node logs

logs-release-import-blocks.txt

Platform(s)

Linux (x86)

What version/commit are you on?

66c072c92819fdf1857152865c32d51d8800b25d

What database version are you on?

Current database version: 2
Local database version: 2

Which chain / network are you on?

optimism mainnet

What type of node are you running?

Archive (default)

What prune config do you use, if any?

No response

If you've built Reth from source, provide the full command you used

cargo build --profile release --bin op-reth --features optimism

Code of Conduct

github-actions[bot] commented 2 months ago

This issue is stale because it has been open for 21 days with no activity.

koraykoska commented 1 month ago

Happens to me as well running op-reth