Closed tonglin0325 closed 2 years ago
spark sunmit command: spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client /usr/lib/spark/examples/jars/spark-examples_2.11-2.4.7-amzn-1.jar 1000 --package com.banzaicloud:spark-metrics_2.11:2.4-1.0.5 --jars /home/hadoop/spark-metrics_2.11-2.4-1.0.5.jar,/home/hadoop/simpleclient-0.8.1.jar,/home/hadoop/simpleclient_dropwizard-0.8.1.jar,/home/hadoop/simpleclient_pushgateway-0.8.1.jar,/home/hadoop/simpleclient_common-0.8.1.jar,/home/hadoop/collector-0.12.0.jar,/home/hadoop/snakeyaml-1.26.jar --conf spark.metrics.conf=/home/hadoop/metrics.properties --conf spark.jars.packages=com.banzaicloud:spark-metrics_2.11:2.4-1.0.5
but there is no metrics reported to pushgateway
spark sunmit command: spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client /usr/lib/spark/examples/jars/spark-examples_2.11-2.4.7-amzn-1.jar 1000 --package com.banzaicloud:spark-metrics_2.11:2.4-1.0.5 --jars /home/hadoop/spark-metrics_2.11-2.4-1.0.5.jar,/home/hadoop/simpleclient-0.8.1.jar,/home/hadoop/simpleclient_dropwizard-0.8.1.jar,/home/hadoop/simpleclient_pushgateway-0.8.1.jar,/home/hadoop/simpleclient_common-0.8.1.jar,/home/hadoop/collector-0.12.0.jar,/home/hadoop/snakeyaml-1.26.jar --conf spark.metrics.conf=/home/hadoop/metrics.properties --conf spark.jars.packages=com.banzaicloud:spark-metrics_2.11:2.4-1.0.5
but there is no metrics reported to pushgateway