search

lbryio / lbry-docker

This repository will be for Dockerfiles for the various LBRY packages.
https://hub.docker.com/u/lbry/
MIT License
11 stars 7 forks source link

Chainquery: Upload baseline SQL database seed to lbryio S3 container. #15

Closed Leopere closed 1 year ago

Leopere commented 6 years ago

This will likely have to come as a question to the end user during initial setup to offer the user the ability to download our latest snapshot database checkpoint of the LBRY checkpoint.

This stuff, should we decide to, would be GPG signed as well as the repository itself.

Leopere commented 6 years ago

I need to zip and ship the base SQL seed and then run a sha256 sum on it, then what I'll do rather than downloading the entire blob to my local just GPG sign the seed's hash.

Leopere commented 6 years ago

The 14Gb data.zip sha256sum data.zip 6c456f3c3687fab98b1bb3869578ccae1e5ccfd351f8907b3870d204a21ea82e data.zip

nikooo777 commented 5 years ago

am I needed for something? can I unassign this from me?

Leopere commented 5 years ago

This is mostly ready we just need to debug the mysql configuration issue and then automation can be setup for uploading latest checkpoint data. This requires time from both @Leopere and @tiger5226

tiger5226 commented 5 years ago

Sounds good! I think we need a bash script here to make sure we upload every x blocks, so the seed doesnt get too far behind. Is that done?

Leopere commented 5 years ago

I've added two functions to the quick-bootstrap.sh here.

It won't pick a specific number of blocks I was just thinking a cronjob in one of the LBRY dev nodes that uploads things automatically on a schedule.

tiger5226 commented 5 years ago

yeah, blocks are 2.5 minutes apart on average so we can backup once a week and that should be fine.