Add casting for memory overheads

AbsaOSS / spot

Aggregate and analyze Spark history, export to elasticsearch, visualize and monitor with Kibana.

Apache License 2.0

5 stars 0 forks source link

Add casting for memory overheads #50

Closed DzMakatun closed 3 years ago

DzMakatun commented 3 years ago

Add parse_to_bytes for spark_driver_memoryOverhead, spark_executor_memoryOverhead, spark_yarn_driver_memoryOverhead, spark_yarn_executor_memoryOverhead in _cast_sparkProperties_dict. The default unit should be carefully investigated (likely MB).