Improve snapshot restoration for blockchain node charts

graphops / launchpad-charts

Helm Charts for deploying Web3 applications into Kubernetes

https://docs.graphops.xyz

Apache License 2.0

16 stars 11 forks source link

Improve snapshot restoration for blockchain node charts #116

Open chriswessels opened 1 year ago

chriswessels commented 1 year ago

[ ] Update docker-builds/init-toolkit with a suite of download and extraction tools
[ ] Allowing specifying custom script (with env vars for things like the persistent data path) in the initContainer that handles snapshot restoration
[ ] Update documentation to show handling common formats with aria2c or other tools
[ ] Document how download-resumption works

matthewdarwin commented 1 year ago

Also support downloading from S3 bucket, which would require AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY

matthewdarwin commented 1 year ago

Also support zstd and lz4 compression. Different snapshot providers use different compression algorithms. (They probably also use different directory layouts, additional challenge)