search

mspnp / spark-monitoring

Monitoring Azure Databricks jobs
MIT License
212 stars 177 forks source link

JsonProtocol.sparkEventToJson deprecated in newer Spark versions #229

Closed msetodev closed 9 months ago

msetodev commented 10 months ago

https://github.com/mspnp/spark-monitoring/blame/00cbc739b0f22374a91975160dd34ed4b1009892/src/spark-listeners/src/main/scala/org/apache/spark/listeners/UnifiedSparkListener.scala#L69

JsonProtocol.sparkEventToJson does not exist in Spark 3.4.1, so Maven fails to compile this project due to this line in UnifiedSparkListener.scala

Can someone please fix?