Open codefromthecrypt opened 1 month ago
Hey @codefromthecrypt, thanks for this and good callout. This project actually pre-dates the gen_ai
experimental conventions and as such you are right, they do not align. We are planning on getting involved with the working groups that are making progress and reconciling the differences with our conventions. Thanks for the very helpful links - appreciate it.
Thanks @mikeldking for the feedback and hope to see you around the #otel-llm-semconv-wg slack or any SIG meetings.
Describe the bug As a first timer, I tried the openai instrumentation, and sent a trace to a local collector (using ollama as the backend). Then I compared the output with llm semantics defined by otel. I noticed some incompatibilities and some attributes not yet defined.
compatible: none
incompatible:
gen_ai.prompt
)gen_ai.completion
)not yet defined in the standard:
To Reproduce You can use a program like this:
Expected behavior I would expect semantics to extend, not clash with otel LLM ones. Ack this is a moving target as the otel ones change frequently.
Screenshots
Example collector log
Desktop (please complete the following information):
Additional context
The otel semantics are defined by "Semantic Conventions: LLM" and folks doing the changes there are frequently on the slack channel, in case you have any questions. I personally haven't yet made any changes to the LLM semantics.
https://github.com/open-telemetry/community?tab=readme-ov-file#specification-sigs