search

traceloop / openllmetry

Open-source observability for your LLM application, based on OpenTelemetry
https://www.traceloop.com/openllmetry
Apache License 2.0
1.51k stars 111 forks source link

🚀 Feature: Support runpod.ai #785

Open nirga opened 2 months ago

nirga commented 2 months ago

Which component is this feature for?

All Packages

🔖 Feature description

Add support for instrumenting calls to runpod.ai

🎤 Why is this feature needed ?

Complete our coverage of LLM use cases.

✌️ How do you aim to achieve this?

Similar to the Replicate instrumentation

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

Are you willing to submit PR?

None

arjunbhut commented 2 months ago

Hey @nirga , Can i pick this up ? I am first time contributor , if you can help me with some context it would be really helpful

nirga commented 2 months ago

Hey @arjunbhut welcome! Sure. It's building an instrumentation for runpod.ai SDK, similar to ones we have for OpenAI SDK or Anthropic. You can start by looking at their docs and creating a small app that calls them and get the result. Then, you can copy one of the existing instrumentations we have here and modify it to support the APIs you called in the sample app. Join our slack and ping me there if you need more help - https://traceloop.com/slack

Benedikt-Wolf commented 1 week ago

Hey @arjunbhut, are you still working on this?