C2SM / Sirocco

AiiDA based Weather and climate workflow tool
1 stars 0 forks source link

Enable graph visualization purely from "graph" section #2

Closed GeigerJ2 closed 1 month ago

GeigerJ2 commented 5 months ago

From my understanding, the "graph" section under "scheduling" is fully sufficient to define the graph, as it defines the tasks, their frequency, inputs, outputs, dependencies, etc. This is in a rather abstract manner, and tasks and data nodes are being made explicit by providing paths to executables and files / folders in the "runtime" section. However, these are, in principle, not needed to define the abstract graph initially. Therefore, I propose to enable graph creation purely from the "graph" section.

Like this, users can create and iterate on the workflow they want to run in an abstract manner, without even having to think about any runtime parameters or where scripts / files will eventually be located.

leclairm commented 5 months ago

The graph is almost sufficient but not quite. There is info we need from the runtime section, typically if input data already exists.

leclairm commented 1 month ago

That is outdated now and done through parsing/unrolling

agoscinski commented 1 month ago

Just for context: This is an older issue from the time we called cycles in the yaml file graph.