search

hortonworks-spark / spark-atlas-connector

A Spark Atlas connector to track data lineage in Apache Atlas
Apache License 2.0
263 stars 149 forks source link

Spark-atlas-connector 1.1 is not working #277

Closed davidmanukian closed 4 years ago

davidmanukian commented 4 years ago

I've setup HDP 3.1 where includes Apache Atlas 1.1 and Apache Spark 2.3. I started to setup a connector and made everything as in readme, i.e I copied atlas-application.properties and put in $SPARK_HOME/conf, then I run the script for creating models: "java -cp "/jars/*:/conf:spark-atlas-connector_2.11-0.1.0-SNAPSHOT.jar" com.hortonworks.spark.atlas.types.SparkAtlasModel --interactive-auth" and I copied a zeppelin example and run it. Job worked but nothing appeared in the atlas.