Log4j2 was seen as the superior logging library compared to default log4j v1 provided by Spark, which has already reached its end of life. As it turns out, using a separate logging library only increases maintenance effort without clear benefits. Therefore, default logging from Spark should be used and the log4j2 dependency removed.
Log4j2 was seen as the superior logging library compared to default log4j v1 provided by Spark, which has already reached its end of life. As it turns out, using a separate logging library only increases maintenance effort without clear benefits. Therefore, default logging from Spark should be used and the log4j2 dependency removed.