The Spline agent does not support column-level lineage tracking in expand operations. So, if my sql contains "grouping", or "with cube", the column lineage will be lost after expand.
Feature
Add OperationNodeBuilder to deal with spark expand operation.
Example [Optional]
Proposed Solution [Optional]
Solution Ideas
I add a ExpandNodeBuilder class in package za.co.absa.spline.harvester.builder.plan, which has almost the same code as UnionNodeBuilder
I modified the class OperationNodeBuilderFactory, to deal with expand operators.
Background
The Spline agent does not support column-level lineage tracking in expand operations. So, if my sql contains "grouping", or "with cube", the column lineage will be lost after expand.
Feature
Add OperationNodeBuilder to deal with spark expand operation.
Example [Optional]
Proposed Solution [Optional]
Solution Ideas