Open ThomasVitale opened 2 months ago
User application may be configured to disable (not enable/suppress/sample-out/drop) HTTP/gRPC/underlying protocol.
That's the main reason that OTel uses kind client, but also one of the reasons to have server.address|port
and error.type
on the LLM spans/metrics.
Other reasons to report server.address|port
and error.type
on LLM telemetry are:
@lmolkova thank you for sharing more details about how those attributes would be used, it was helpful. I have updated the table with a better description of the current adoption state and suggestion for future changes.
Considering that most Spring applications will have HTTP metrics and traces enabled, and that adding those HTTP attributes would require a major refactoring of the framework (including considerations for avoiding a raise in the time series due to information duplications), I think it would be beneficial to hear from the community a bit more about their observability needs and use cases that would require those additional attributes before making any change.
In any case, I'd like to point out the overview above is to keep track of the work I've been doing right now as a contributor to this project for the initial observability support in Spring AI. It's not an official or even comprehensive roadmap, and it's definitely not a final task. It's a start :)
took your demo for a spin. ping back when you've span events as I'll be interested to take a second look.
OFFTOPIC: @codefromthecrypt what tool do you use for the traces?
@piotrooo https://github.com/ymtdzzz/otel-tui otherwise known as "missing 1000 github stars". It is technically an otel collector extension, bundled for convenience into one binary.
Based on the Semantic Conventions 1.27.0. See docs. This issue is to keep track of the work I've been doing for the Spring AI initial adoption of the OpenTelemetry Semantic Conventions for GenAI Operations.
Traces
Span Names
{gen_ai.operation.name}
{gen_ai.request.model}
Span Kinds
Span Attributes
Event Names
Event Attributes
Metrics
Metric: Token Usage
Metric: Operation Duration