As far as prefect is concerned, the Flow Atom "task" is completed when the object is initialized, not when the flow_atom.task_body is called, so the prefect UI thinks all of the tasks complete very quickly upon starting a pipeline. This is less than ideal for visibility and logging and such.
Do we instantiate a /second/ task that is the object invocation? Or is there a way to change how prefect logs the completion of a task? Or some third other thing?
pgulley
commented
8 months ago
As far as prefect is concerned, the Flow Atom "task" is completed when the object is initialized, not when the
flow_atom.task_bodyis called, so the prefect UI thinks all of the tasks complete very quickly upon starting a pipeline. This is less than ideal for visibility and logging and such.Do we instantiate a /second/ task that is the object invocation? Or is there a way to change how prefect logs the completion of a task? Or some third other thing?