search

qbicsoftware / postman-cli

A client software for dataset request and download from openBIS
MIT License
2 stars 1 forks source link

Feature request: automatically retry download with mismatching checksums #125

Closed FriederikeHanssen closed 1 year ago

FriederikeHanssen commented 2 years ago

For WGS data I quite frequently run into the issue that some of the fastq files have mismatching checksums after download, presumably the download failed. It would be great if qpostman could try to download these files again to reduce chasing these files and manually retrying them.

KochTobi commented 1 year ago

Dear @FriederikeHanssen As of version 1.3.0 you can restart the download command. This will skip files present in the output directory and provide you with a summary after the tool finished. I hope this resolves your issue?

FriederikeHanssen commented 1 year ago

Hi! Sounds great. I had in mind, that qpostman could auto try again (i.e. when running larger downloads over the weekend). Similar maybe to how nextflow resubmits failed jobs a fixed number of times. But this is already great :)

KochTobi commented 1 year ago

The behaviour fix includes an internal retry (3 times) before reporting a file as not downloaded properly.

FriederikeHanssen commented 1 year ago

sweet!