Add summary metrics including driver resources

[DzMakatun]

Add summary metrics which include resources allocated to driver. It is needed for proper monitoring of cluster load and total resource usage by application.

suggested metrics:

• total_cores_w_driver
• total_memory_w_driver
• total_core_cost_w_driver
• total_memory_cost_w_driver

[DzMakatun]

when not explicitly set, driver memory and cores are missing in sparkProperties

attempt.aggs.allexecutors.driver.totalCores is always 0 when master yarn. For master local it shows all cores at the edge node.

so far it looks like there is no reliable way to get this data from Spark History

[DzMakatun]

attempt.environment.sparkProperties.spark.executor.memory is also missing when not set explicitly in Spark submit.

[DzMakatun]

To properly estimate total resource allocation, including driver and executor memory integration with external service e.g. YARN is needed.