search

ewels / clusterflow

A pipelining tool to automate and standardise bioinformatics analyses on cluster environments.
https://ewels.github.io/clusterflow/
GNU General Public License v3.0
97 stars 27 forks source link

Change downloads module behaviour #55

Closed ewels closed 9 years ago

ewels commented 9 years ago

Currently, the downloads module takes URL and filename as parameters on the command line when called. It'd be better to do this as regular filenames in the run file - less parameters, also other modules will know how many files we're starting with.

ewels commented 9 years ago

I think this is due to the logic involved with the way that all downloads have to run in series, but run groups can be kicked off when a set of files have finished downloading? It's pretty confusing. Anyway, should be at least be able to print downloaded filenames to the run file even if they are ignored by the actual download module.

ewels commented 9 years ago

Done in https://github.com/ewels/clusterflow/commit/04d3e4191de4ab9afcb8e3cbc393bef8f5d9f44c

Not tested yet, but should work.