bokulich-lab / q2-fondue

Functions for reproducibly Obtaining and Normalizing Data re-Used from Elsewhere
BSD 3-Clause "New" or "Revised" License
20 stars 6 forks source link

Save fetched sequences before space issue #62

Closed adamovanja closed 2 years ago

adamovanja commented 2 years ago

As a plugin user, I would like get-sequences and get-all to exit with the previously fetched sequences shortly before it fails with a space issue and fails to return anything (OSError: [Errno 28] No space left on device). This could be implemented by closing the q2fondue execution when nearly all available storage (e.g. 95%) is used up.

Note: This can be tested on projectID PRJEB3079 that requires 230-270 GiB to be downloaded.