AbsaOSS / spot

Aggregate and analyze Spark history, export to elasticsearch, visualize and monitor with Kibana.
Apache License 2.0
5 stars 0 forks source link

Investigate timezone issues #69

Closed DzMakatun closed 2 years ago

DzMakatun commented 3 years ago

As the datetime values are transfered between multiple components: Spark History, Menas, Spot, elasticsearch and Kibana, the timezone transformations may be incorrect. For axample, the Kibana page often shows some jobs as completed 3 hours in future.

A detailed investigation and debugging is needed.