search

traceloop / openllmetry

Open-source observability for your LLM application, based on OpenTelemetry
https://www.traceloop.com/openllmetry
Apache License 2.0
1.89k stars 169 forks source link

🚀 Feature: Tracing support for Amazon SageMaker endpoints #1660

Open bobbywlindsey opened 2 months ago

bobbywlindsey commented 2 months ago

Which component is this feature for?

All Packages

🔖 Feature description

Add tracing support for Amazon SageMaker endpoints

🎤 Why is this feature needed ?

Developers may deploy a variety of LLMs as endpoints on Amazon SageMaker. They'd query these endpoints using the InvokeEndpoint API to retrieve the LLM response.

✌️ How do you aim to achieve this?

  1. Create opentelemetry-instrumentation-sagemaker package
  2. Create instrumentation for the sagemaker-runtime service and patch the invoke_endpoint method.
  3. Create span for the request.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

Are you willing to submit PR?

Yes I am willing to submit a PR!

nirga commented 2 months ago

Yes @bobbywlindsey! We've been wanting to do this for a while! I see that you want to work on this, let me know how can I help!