Some run objects in Spark History are missing important properties. Processing of such objects lead to unexpected errors. It does not seem feasible to add all possible checks for every used property. Instead the idea is to handle exceptions caused by such records and store error messages to a separate ES collection. This would allow to investigate such errors and distinguish Spot bugs from Spark History or Menas issues.
Some run objects in Spark History are missing important properties. Processing of such objects lead to unexpected errors. It does not seem feasible to add all possible checks for every used property. Instead the idea is to handle exceptions caused by such records and store error messages to a separate ES collection. This would allow to investigate such errors and distinguish Spot bugs from Spark History or Menas issues.