Lineage tracing support for codegen

tugraz-isds / systemds

An open source ML system for the end-to-end data science lifecycle

Apache License 2.0

37 stars 20 forks source link

Lineage tracing support for codegen #109

Closed phaniarnab closed 4 years ago

phaniarnab commented 4 years ago

Note:

Not totally sure if the location of lineage construction is right. Please have a look.
This patch supports only a few hop types. Will add more in the future.

mboehm7 commented 4 years ago

LGTM - thanks @phaniarnab. I did just some minor cleanups: reset visit flags before recursion, missing setVisited in rConstructLineageFromHops, caching via class name not hop ID, and Sebastian's comments (TODOs, license).