emo-bon / MetaGOflow

MGnify oriented implementation for the Marine Genomic Observatories oriented pipeline, developed in the framework of an EOSC-Life funded project
https://metagoflow.readthedocs.io
Apache License 2.0
7 stars 7 forks source link

Database integrity: checking md5sums #6

Open cymon opened 1 year ago

cymon commented 1 year ago

Do the databases downloaded with the download_dbs.sh script have md5sums we could check against? With the dbs being so big, it was taking > 10 hours to download and I would be very concerned about downloads being interupted/corrupted...

hariszaf commented 1 year ago

We will make sure that the script has only the databases that are required. Beyond that, there is no much we can do about the internet connection issue. Checksums are pre-calculated and mentioned in the default.yml.