LucaCanali / sparkMeasure

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.
Apache License 2.0
690 stars 144 forks source link

add ability to specify saveMode while writing spark results. #34

Closed kudhru closed 3 years ago

kudhru commented 3 years ago

This is required if someone wants to allow spark to overwrite existing stagemetrics results file.

LucaCanali commented 3 years ago

LGTB. Merged, Thanks!