Arize-ai / openinference

Auto-Instrumentation for AI Observability
https://arize-ai.github.io/openinference/
Apache License 2.0
146 stars 22 forks source link

[DSPy] Capture messages, token counts in the instrumentation #532

Open mikeldking opened 1 week ago

mikeldking commented 1 week ago

Token counts can be missing since the DSPy instrumentor only instruments the LM module but should attempt to capture the tokens as part of the instrumentation process for all built-in llms