panoptes-organization / panoptes

Monitor computational workflows in real time
MIT License
64 stars 17 forks source link

Investigate option to get a unique snakemake id for each workflow run #100

Open fgypas opened 3 years ago

fgypas commented 3 years ago

Is your feature request related to a problem? Please describe. Let's say that we have a snakemake pipeline that has 30 steps, and let's assume that after 10 steps an error appears. After the pipeline fix, if we run again the pipeline one would assume that it resumes at step 11. What is happening at the moment is that it generates a new workflow id with 20 steps.

Describe the solution you'd like The solution would be to recognize that this is the same pipeline and not something different. Maybe based on the root directory of the pipeline?

fgvieira commented 6 months ago

What if it was based on the name? This way, you only had to run it again with the same name:

snakemake [...] --wms-monitor-arg name=test