search

ESPRI-Mod / synda

ESGF Downloader (this is a deprecated repository, the tool has now moved to https://github.com/ESGF/esgf-download)
https://espri-mod.github.io/synda/
21 stars 11 forks source link

Synda reset marks failed file downloads as `already installed` #202

Open Zeitsperre opened 2 years ago

Zeitsperre commented 2 years ago

I just ran into this bug today:

$ synda install -s synda_selection_cordex-nam_20220621.txt
8 file(s) will be added to the download queue.
Once downloaded, 547.2 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
8 file(s) enqueued
You can follow the download using 'synda watch' and 'synda queue' commands

$ synda queue

status      count  size
done        67992  14.7 TB
error           8  547.2 MB

$ synda install -s synda_selection_cmip6_20220901.txt 
INFO: 'day' value has been associated with 'frequency' facet.
INFO: Nothing to install (matching files are already installed or waiting in the download queue). To monitor transfers status and progress, use 'synda queue' command.

$ synda reset

$ synda install -s synda_selection_cmip6_20220901.txt 
INFO: 'day' value has been associated with 'frequency' facet.
INFO: Nothing to install (matching files are already installed or waiting in the download queue). To monitor transfers status and progress, use 'synda queue' command.

$ synda queue

status      count  size
done        67992  14.7 TB

It seems that once one has called synda reset, the errored files cannot be marked again for download. Is the only way to undo this to clean out my database?