Closed rogerrogeryau closed 2 years ago
Hi, thanks for reporting this. Can you please provide more context on when/where you encounter the error message?
Does the Python example provided with sparkmesure work for you? You can run it as:
bin/spark-submit --packages ch.cern.sparkmeasure:spark-measure_2.12:0.21 <path_to_examples>/test_sparkmeasure_python.py
Closing for lack of activity.
This error appears when the user fails to set --packages
as a spark flag
self.stagemetrics = self.sc._jvm.ch.cern.sparkmeasure.StageMetrics(self.sparksession._jsparkSession) TypeError: 'JavaPackage' object is not callable
issue is hit when I spark-submit the .py script to emr.