apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
36.61k stars 14.17k forks source link

Support of host.name in OTEL metrics #42425

Closed howardyoo closed 1 week ago

howardyoo commented 2 weeks ago

Description

Currently there is no attribute 'host.name' that is part of the metrics data emitted from Airflow, which may cause confusion when monitoring airflow metrics.

Use case/motivation

In order to more properly identify airflow instances running on a host environment, we may need to have this common sementic covention (host.name) be available. (more info: https://opentelemetry.io/docs/specs/semconv/resource/host/) Currently, because the metric does not have any attributes, in case there are multiple airflow instances emitting metrics, it may not be easy to distinguish them, unless explicitly defining it.

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

howardyoo commented 1 week ago

Thank you!