Rework snapshot generation

NebraLtd / hm-miner

Helium Miner Container

https://nebra.io/hnt

MIT License

16 stars 16 forks source link

Rework snapshot generation #6

Closed vpetersson closed 3 years ago

vpetersson commented 3 years ago

Currently, the snapshot-bumper is running on a VPS. We need to do a few changes to this:

Rewrite the code base
Make it run in a GitHub Action using on.schedule hourly (or similar)
Generate the new docker.config and copy it to GCP or similar automatically

robputt commented 3 years ago

https://github.com/NebraLtd/hm-block-tracker/pull/1

shawaj commented 3 years ago

@robputt on the above linked PR/repo it says

After discussion with Helium core team it appears we do not need to maintain our own S3 repository with snapshots, they already provide a public repository for snapshots which vendors can utilise, see https://snapshots.helium.wtf/mainnet/snap-.

Do you know how frequently this is updated? Presumably it's only when a new blessed block is released?

robputt commented 3 years ago

@shawaj looks like it is more frequent than this, according to Hakeem there is also some API where you can query snapshot data. Asking for more info as it's not documented at docs.helium.com

robputt commented 3 years ago

robputt commented 3 years ago

https://github.com/NebraLtd/hm-block-tracker/pull/4

robputt commented 3 years ago

I think this is done.

Uses upstream blessed block and snapshots
Dynamically builds docker.config via CI every hour and publishes to Google Cloud Storage