Hi, I got this error when running the archive node

keienWang commented 2 weeks ago

Downloaded all snapshot data and exported it as mdbx.dat
Replace the mdbx.dat in the previous chaindata directory with the mdbx.dat
./erigon --chain=bsc --datadir /data/bscdata/

ubuntu 22:04 32 RAM 8T SSD

zlacfzy commented 1 week ago

Have you check the checksum?

dedsxc commented 6 days ago

The procedure to unzip the compressed snapshot seems wrong on the readme. What it works for me so far:

cat $(seq -f "erigon_data_$SNAPSHOT_VERSION.lz4.%03g" 0 7) > erigon_data.lz4
lz4 -qd -c erigon_data.lz4 > $CONFIG_DIR/chaindata/mdbx.dat

zlacfzy commented 5 days ago

The procedure to unzip the compressed snapshot seems wrong on the readme. What it works for me so far:
cat $(seq -f "erigon_data_$SNAPSHOT_VERSION.lz4.%03g" 0 7) > erigon_data.lz4
lz4 -qd -c erigon_data.lz4 > $CONFIG_DIR/chaindata/mdbx.dat

The latest version works too? Actually we change the way just spilt the db before compress it. So just need decompress and then cat to a mdbx file.

testbugsec2022 commented 5 days ago

The decompression failed and the file does not exist. However, the file does exist. I don’t understand why. Can you explain it?

root@bscnode:/data2/bscsnap/bscall# lz4 -qd -c erigon_data.lz4 > /data/bscdata/chaindata/mdbx.dat erigon_data.lz4: No such file or directory root@bscnode:/data2/bscsnap/bscall# ls -al erigon_data.lz4 -rw-r--r-- 1 root root 3455216109676 Jul 3 14:04 erigon_data.lz4 root@bscnode:/data2/bscsnap/bscall#

testbugsec2022 commented 5 days ago

The procedure to unzip the compressed snapshot seems wrong on the readme. What it works for me so far:
cat $(seq -f "erigon_data_$SNAPSHOT_VERSION.lz4.%03g" 0 7) > erigon_data.lz4
lz4 -qd -c erigon_data.lz4 > $CONFIG_DIR/chaindata/mdbx.dat
The latest version works too? Actually we change the way just spilt the db before compress it. So just need decompress and then cat to a mdbx file.

I am using version 0520. Is there something wrong with this version? The md5 values are all verified and there is no problem.

testbugsec2022 commented 5 days ago

5983392858e54bf40e05853294399303 erigon_data_20240520.lz4.000 14ac48c4f866c6f754ac3a2c661d6eb4 erigon_data_20240520.lz4.001 9cd5075e8e611a35c44eec3cd31305f0 erigon_data_20240520.lz4.004 c7c95f96200d35b81e52d50f8ed52ebf erigon_data_20240520.lz4.002 2f2d918363c992bb9254dd6504d8a541 erigon_data_20240520.lz4.003 0bd256afaf42bfb4b163354142cfda0d erigon_data_20240520.lz4.005 4f31de846555841326fa04ccd00b5b67 erigon_data_20240520.lz4.006 e2750053a2656b6cbaf743459480c144 erigon_data_20240520.lz4.007

zlacfzy commented 4 days ago

5983392858e54bf40e05853294399303 erigon_data_20240520.lz4.000 14ac48c4f866c6f754ac3a2c661d6eb4 erigon_data_20240520.lz4.001 9cd5075e8e611a35c44eec3cd31305f0 erigon_data_20240520.lz4.004 c7c95f96200d35b81e52d50f8ed52ebf erigon_data_20240520.lz4.002 2f2d918363c992bb9254dd6504d8a541 erigon_data_20240520.lz4.003 0bd256afaf42bfb4b163354142cfda0d erigon_data_20240520.lz4.005 4f31de846555841326fa04ccd00b5b67 erigon_data_20240520.lz4.006 e2750053a2656b6cbaf743459480c144 erigon_data_20240520.lz4.007

Try this:

lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]
cat "erigon_data_20240520"* > mdbx.dat

testbugsec2022 commented 4 days ago

lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]

root@bscnode:/data2/bscsnap# /usr/bin/lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7] erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]: is not a regular file

zlacfzy commented 3 days ago

lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]

root@bscnode:/data2/bscsnap# /usr/bin/lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7] erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]: is not a regular file

You need do that one by one. lz4 -d erigon_data_20240520.lz4.000 and then lz4 -d erigon_data_20240520.lz4.001

testbugsec2022 commented 3 days ago

lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]

root@bscnode:/data2/bscsnap# /usr/bin/lz4 -d erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7] erigon_data_20240520.lz4.[0]..erigon_data_20240520.lz4.[7]: is not a regular file

You need do that one by one. lz4 -d erigon_data_20240520.lz4.000 and then lz4 -d erigon_data_20240520.lz4.001

Thank you Please provide the sha256 of mdbx.dat of 0520. Thanks

zlacfzy commented 13 hours ago

31fdebebe89ab25bf5842fa2055428a14281c8279ce2499eef93fece5a94deea

bnb-chain / bsc-snapshots

Hi, I got this error when running the archive node #366