search

AustralianSynchrotron / lightflow

A lightweight, distributed workflow system
https://australiansynchrotron.github.io/lightflow/
BSD 3-Clause "New" or "Revised" License
101 stars 18 forks source link

add `signal.is_completed(dag_name)`? #13

Open jrmlhermitte opened 6 years ago

jrmlhermitte commented 6 years ago

Hi, I have a DAG that generates many other DAG's. I would like it to generate at most N running DAG's. Is there a way to check within a PythonTask is a DAG is complete or not? I think something like signal.is_complete(dag_name) would be sufficient.

Note, that I don't want to call signal.join_dags(dag_names) since I don't know which DAGs will complete first. thanks!