Publish processing metrics for L1B

[skymandr]

📋 Info

Every time processing is run, publish metrics (if not development).

Metrics should include:

• number of incoming records [Value]
• number of outgoing records [Value]
• possibly also one metric for each error code with count [Value]

with metadata:

• processing time [Timestamp]
• quantity [Dimension]
• bucket name [Dimension]

A good solution is to use https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/cloudwatch/client/put_metric_data.html

An alternative is to log the data in a structured way and pick it up in a metric that way.

See also: https://github.com/innosat-mats/level1a/issues/55

🏁 DoD

• [ ] Metrics posted from Level1B processing

[skymandr]

Any other things needed in the metrics, @Kernl67 and @OleMartinChristensen ?

[Kernl67]

If the data is processed successfully, but some errors/warnings are raised, is it possible to get a metric about that without having to check the error flags for each image ?

[skymandr]

I don't know how many error flags there are and how they work, so take this with a pinch of salt, but I think that should be doable, if you think it worthwhile.