AbsaOSS / spot

Aggregate and analyze Spark history, export to elasticsearch, visualize and monitor with Kibana.
Apache License 2.0
5 stars 0 forks source link

24 handle malformed runs #25

Closed DzMakatun closed 4 years ago

DzMakatun commented 4 years ago

24 Some of the records can be inconsistent due to external services (e.g Spark History Server error)

and raise exceptions during processing. Such exceptions are now handled and corresponding records are stored in a separate collection along with error messages. This will make tracking new possible issues easier.