search

paradigmxyz / cryo

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes
Apache License 2.0
1.12k stars 97 forks source link

Changing `compression` algorithm makes `cryo` error #166

Open davidgasquez opened 8 months ago

davidgasquez commented 8 months ago

Version cryo 0.3.1-10-g5a1a3bf

Platform Linux cac8122b2ebc 6.6.9-arch1-1 #1 SMP PREEMPT_DYNAMIC Tue, 02 Jan 2024 02:28:28 +0000 x86_64 x86_64 x86_64 GNU/Linux

Description You can run cryo with the defaul compression like this:

cryo transactions --contract "0x03506eD3f57892C85DB20C36846e9c808aFe9ef4" \
    --output-dir data \
    --overwrite \
    -b 18940000:18950000 \
    --rpc https://eth.merkle.io

It'll work and generate the files. If you run cryo with other compression, it'll fail. E.g: snappy.

cryo transactions --contract "0x03506eD3f57892C85DB20C36846e9c808aFe9ef4" \
    --output-dir data \
    --overwrite \
    --compression snappy \
    -b 18940000:18950000 \
    --rpc https://eth.merkle.io

This is the error summary returned:

error summary
─────────────
(errors in 10 chunks)
- Collect failed: block not found (10x)