hortonworks-spark / spark-atlas-connector

A Spark Atlas connector to track data lineage in Apache Atlas
Apache License 2.0
263 stars 149 forks source link

Spark 3 Support #326

Open semeteycoskun opened 7 months ago

semeteycoskun commented 7 months ago

Hello,

Does this repo output (spark-atlas-connector_2.11-0.1.0-SNAPSHOT.jar) support spark 3.X?

It's mentioned that "To use this connector, you will require a latest version of Spark (Spark 2.3+), because most of the features only exist in Spark 2.3.0+." but not clear to me for 3.X?

Thank you, Kind Regards.