This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.
Application start and end metrics are really helpful to measure job and executor scheduling delays especially in static allocated spark jobs. The dynamic allocation config is also useful to understand delays for specific categories.
LucaCanali
commented
2 months ago
Application start and end metrics are really helpful to measure job and executor scheduling delays especially in static allocated spark jobs. The dynamic allocation config is also useful to understand delays for specific categories.