kestra-io / kestra

:zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...
https://kestra.io
Apache License 2.0
13.94k stars 1.2k forks source link

OpenTelemetry support for workflows #6149

Open grozdz opened 4 days ago

grozdz commented 4 days ago

Feature description

Hi All,

I have a generic suggestion about traces. In our setup, we trigger Kestra workflows from our microservices which are instrumented with Open Telemetry. This way we can observe how requests go through our infrastructure. It would be great to add possibility to instrument workflows and send traces to Open Telemetry collector, so we can see Kestra workflow as part of traces and service graph. I was told on Slack that there is no such feature so far, so I'm proposing it.

Best regards, Grzegorz

loicmathieu commented 4 days ago

Hi, Small question to pinpoint this feature request. Do you want a Kestra workflow execution to be a single span for the whole execution or to have one span per tasks?

grozdz commented 3 days ago

Hi, I think it would be great to have possibility to choose, e.g. parameterize it per flow. In our case certain flows are more complex than others, so it would be great to have visibility per task. But single span would be great option too.