Closed timorleph closed 5 months ago
Please make sure the following happened
lgtm, nice change in the add_unit function but a little risky :P
What makes it a little risky?
What makes it a little risky?
I think @kostekIV means that it will no longer remove the units from the cache immediately after they are being processed by the dag
component, which was a nice property to have (no need to remember to call finished_processing
outside of dag
). It's not really that risky, since the cache cannot create different outputs if it's not cleaned, worst case scenario it would use a tad more memory.
Make the unit saving into a pipeline, to simplify the semantics of units being officially added to the Dag.