tokern / data-lineage

Generate and Visualize Data Lineage from query history
https://tokern.io/data-lineage/
MIT License
307 stars 44 forks source link

Support for Hive/Impala/SparkSQL based Tables #10

Open STHITAPRAJNAS opened 4 years ago

STHITAPRAJNAS commented 4 years ago

It would be nice to have support of more databases. May be a generic JDBC way or including pluggable 3rd party drivers.

vrajat commented 4 years ago

Definitely. Right now every database has a different method to get query history. For example, Hive or SparkSQL itself does not show query history.

I am wondering if I should also build a module to capture queries from these data engines.