search

franciscozorrilla / metaGEM

:gem: An easy-to-use workflow for generating context specific genome-scale metabolic models and predicting metabolic interactions within microbial communities directly from metagenomic data
https://franciscozorrilla.github.io/metaGEM/
MIT License
189 stars 41 forks source link

Suggestion: Remove temporary output of CrossMapParallel #97

Closed Xentrics closed 2 years ago

Xentrics commented 2 years ago

CrossMapParallel creates a lot of data on the scratch drive without ever removing - or needing - it. For only 81 samples, it caused over 30TB temporal garbage. Instead, after successful completion of the rule, the temp directories should be removed from scratch folder.

franciscozorrilla commented 2 years ago

Completely agree, thanks for the contribution. Although the intermediate files can be useful in some cases, most users will not be using them and indeed this will likely eat up all of the users storage space.