search

traceloop / openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
https://www.traceloop.com/openllmetry
Apache License 2.0
261 stars 26 forks source link

🚀 Feature: OpenTelemetry Metrics #185

Open nirga opened 6 months ago

nirga commented 6 months ago

Which component is this feature for?

All Packages

🔖 Feature description

Some values, like token usage, are better reported (also) as otel metrics. We should update all instrumentations to send metrics as well as traces.

🎤 Why is this feature needed ?

More ways to use the outputted data. Observability platforms can use metrics to set alerts on or to create dashboards.

✌️ How do you aim to achieve this?

Similar to the issue in OpenLLMetry - https://github.com/traceloop/openllmetry/issues/251 This needs to be researched and defined. Please consult on slack before starting to work on this.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

Are you willing to submit PR?

None

detunjiSamuel commented 5 months ago

Hey, I would love to work on this issue.

nirga commented 5 months ago

Sounds good @detunjiSamuel! You can look at the python project we've already done some work there in the SDK and the OpenAI instrumentation

deepshahcode commented 3 months ago

I would be glad to work on this issue.

nirga commented 3 months ago

Amazing @deepshahcode! Let me know if you need any help