-
23/09/20 13:47:13 ERROR AsyncEventQueue: Listener QuboleJobListener threw an exception
java.lang.AssertionError: assertion failed: MergedOn tables must have the same values for the onColumn!
-
https://books.japila.pl/apache-spark-internals/metrics/MetricsServlet/
- Master doesnt have any memory heap metrics
- driver has only heap/non-heap for itself, nothing for executors
- couldnt find wor…
-
hi ,
I spark-submit with the below arguments on my emr cluster (EMR release 6.6.0).
` --packages "io.github.saurabhchawla100:spark-radiant-sql:1.0.4,io.github.saurabhchawla100:spark-radiant-cor…
-
Hi I have recently started Learning SparkLens and trying to generate one sample json file for my SparkApplication and I'm using below spark Submit Command.
spark-submit
--conf spark.extraListeners…
-
i have a pyspark program.
spark 2.4.0 , hadoop 3.0.0
use spark-submit --jars sparklens-0.3.2-s_2.11.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf spark.sparklens.re…
ghost updated
3 years ago
-
Hi, I am Trying to Implement sparklens for streaming Application. I am able to do the same for spark Batch Application by adding below additional line in my batch application spark submit command.
…
-
I am planning to keep sparklens running for each job providing me statics for each job so that later on I can compare different metrics across different jobs.
Wanted to figure out what is the overhea…
-
We see lot of connection refused errors
In large clusters, the spark performance is getting degraded when the driver gets launched in worker nodes.
-
Hi.
I am new to Dr. Elephant and I would love to make it a permanent tool in our solution. For info, I have requested to join the Google Groups (https://groups.google.com/forum/#!forum/dr-elephant…
-
Hi There,
We are running spark-lens with the application itself, and we also want to check the offline directory to generate JSON but there is no directory, named /tmp/sparklens, found after the ap…