hortonworks-spark / spark-atlas-connector

A Spark Atlas connector to track data lineage in Apache Atlas
Apache License 2.0
264 stars 149 forks source link

Exclude Hadoop dependencies from Beeju #256

Closed HeartSaVioR closed 5 years ago

HeartSaVioR commented 5 years ago

I've seen version conflict between Spark's Hadoop dependency and Beeju's Hadoop dependency. (This is actually observed when we change the version of Spark.)

We might have to get rid of Beeju if Spark and Beeju are being conflicted and we are forced to choose one. In other words, to leverage Beeju, tests should run correctly even if we exclude Hadoop dependencies from Beeju.