search

etsy / statsd-jvm-profiler

Simple JVM Profiler Using StatsD and Other Metrics Backends
MIT License
330 stars 93 forks source link

Problems with injecting the profiler to Spark Application #53

Open gevago01 opened 5 years ago

gevago01 commented 5 years ago

Hello,

I am running spark-submit as follows

spark-submit --packages com.etsy:statsd-jvm-profiler:2.1.0 --deploy-mode cluster --master spark://14.16.47.27:7077 --class par.met.TS --conf spark.executor.extraJavaOptions=-Xss100m --conf "spark.executor.extraJavaOptions=-javaagent:statsd-jvm-profiler-2.1.0-jar-with-dependencies.jar=server=myInfluxServer,port=8086,reporter=InfluxDBReporter,database=profiler,username=profiler,password=profiler" --num-executors 3 myAppJar

but executors keep failing with the following messages:

stderr: Error opening zip file or JAR manifest missing : statsd-jvm-profiler-2.1.0-jar-with-dependencies.jar

stdout: Error occurred during initialization of VM agent library failed to init: instrument

Any help appreciated. Thank you, Giannis

NoamShaish commented 5 years ago

I had the same issue when downloading this jar. two options:

  1. try downloading again
  2. clone source and pack locally