search

grp-bork / spire_contribute

3 stars 0 forks source link

Missing files for download #15

Closed nongiga closed 1 week ago

nongiga commented 1 week ago

Hi there,

When I try to download the mags there is ~5% that give me Internal Server Error. I attached a list. spire_genomes_missing_urls.txt The rest of the downloads work perfectly. Could you solve this? image

fullama commented 1 week ago

Are you at Columbia university? Someone from there brought down our databases because of a crazy number of requests per second downloading every mag.

fullama commented 1 week ago

but you are right in the broken links - ill reply here when they are fixed - thanks for finding them

fullama commented 1 week ago

The issues should be fixed now.. everything that should be accessible now is..

If you are going to download them all though maybe dial it back a bit so it doesnt overload the server again.

Thanks! A

FYI there was also a single file per study with the same mags on each study page - might be a bit late for that now though :-/