Discuss: FTL specific otel metrics

TBD54566975 / ftl

FTL - Towards a 𝝺-calculus for large-scale systems

Apache License 2.0

18 stars 6 forks source link

Discuss: FTL specific otel metrics #1786

Open wesbillman opened 3 weeks ago

wesbillman commented 3 weeks ago

Are there FTL specific metrics that we should implement to help us debug issues with customer modules running on FTL?

Some random thoughts to get us started

Anything pubsub related? retries? latencies?
FSM?

We have calls and GRPC stuff pretty well covered, but want to make sure we are happy with the telemetry we have implemented.

alecthomas commented 3 weeks ago

We definitely don't have sufficient custom metrics. We basically need to instrument everything - secret/config accesses, database successes/errors, pubsub, etc.