Took hours to download mainnet-beta snapshot - Githubissues

aws-samples / aws-blockchain-node-runners

Run blockchain nodes on cloud

https://aws-samples.github.io/aws-blockchain-node-runners/

MIT No Attribution

55 stars 47 forks source link

Took hours to download mainnet-beta snapshot #139

Open lubao opened 1 week ago

lubao commented 1 week ago

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

Reducing time to download snapshot Downloading snapshot from known validator can take hours to finish since the speed is low.

Describe the solution you would like

Adding downloading snapshot in user-data script. Following is a sample script

cd /var/solana/data/ledger
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/snapshot.tar.bz2
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/incremental-snapshot.tar.bz2
sed -i "s/--log -/--no-snapshot-fetch --log -/g" /home/solana/bin/validator.sh
cd -

leverage https://github.com/c29r3/solana-snapshot-finder
TBD

Describe alternatives you have considered

Additional context

frbrkoala commented 3 days ago

Thank you for suggestion! Will explore it as an add-on feature for Solana. Depending on location, snapshot download time varies. For the last couple of tests it took 1.5-2 hours to download the snapshot the default way. How long does it take to do it with the suggested script?