search

hortonworks-spark / spark-atlas-connector

A Spark Atlas connector to track data lineage in Apache Atlas
Apache License 2.0
264 stars 149 forks source link

can't load file atlas-application.properties #284

Closed romandata closed 4 years ago

romandata commented 4 years ago
  1. I put the atlas-application.properties to $SPARK_HOME/conf at all of spark node .
  2. bin/spark-shell --jars spark-atlas-connector_2.11-0.1.0-SNAPSHOT.jar --conf spark.extraListeners=com.hortonworks.spark.atlas.SparkAtlasEventTracker --conf spark.sql.queryExecutionListeners=com.hortonworks.spark.atlas.SparkAtlasEventTracker --conf spark.sql.streaming.streamingQueryListeners=com.hortonworks.spark.atlas.SparkAtlasStreamingQueryEventTracker --files conf/atlas-application.properties .
  3. add atlas-application.properties into atlas-intg-2.0.0.jar and spark-atlas-connector_2.11-0.1.0-SNAPSHOT.jar .

but, it is error of Failed to load application properties when I start spark application.

What should I do? please...

RonBarabash commented 4 years ago

@DataRoman did u managed to fix this? can u please share the solution?