search

HamaWhiteGG / flink-sql-lineage

The Lineage Analysis system for FlinkSQL supports advanced syntax such as Watermark, UDTF, CEP, Windowing TVFs, and CTAS.
Apache License 2.0
366 stars 164 forks source link

Field lineage returns an incorrect result #45

Closed gitfortian closed 1 year ago

gitfortian commented 1 year ago
3caab04148176390b55b9d072f2a25f b30f119d0598b8a654ac6dc1af821a6

as shown above, table demo_log_12 field dt and hh should be from table demo_log_10 field dt and hh but acutually item_id and behavior returned

HamaWhiteGG commented 1 year ago

I modified the overall scheme of lineage parsing, namely Parse field lineage from Original RelNode, not the Optimized RelNode.

you can see the same test case https://github.com/HamaWhiteGG/flink-sql-lineage/blob/release-4.0.0/lineage-flink1.16.x/src/test/java/com/hw/lineage/flink/paimon/PaimonTest.java

image