A DAG can be split up into multiple subparts and registered separately. At execution time, you can create a call for each subcomponent using the dry_run flag of the call_dag method and then chain the DAG calls together using the continuation argument of call_dag.
Chained continuations will be sent back to the scheduler, which will then schedule the next portion of the DAG to be executed.
A DAG can be split up into multiple subparts and registered separately. At execution time, you can create a call for each subcomponent using the
dry_run
flag of thecall_dag
method and then chain the DAG calls together using thecontinuation
argument ofcall_dag
.Chained continuations will be sent back to the scheduler, which will then schedule the next portion of the DAG to be executed.