Closed sabrenner closed 5 months ago
Adds auto-instrumentation to the serverless layer for LLM Observability. Now, in order to enable LLM Observability for auto-instrumented integrations (OpenAI, LangChain, Bedrock, and Anthropic), set DD_LLMOBS_ENABLED=1, along with:
DD_LLMOBS_ENABLED=1
DD_LLMOBS_ML_APP=<YOUR_ML_APP> DD_API_KEY=<YOUR_DATADOG_API_KEY> DD_SITE=<YOUR_DATADOG_SITE>
LLM Observability documentation is available for full instrumentation instructions.
Enable easy onboarding and auto-instrumentation experience with LLM Observability in a serverless environment.
Built the layer and tested against a lambda handler. Verified that
What does this PR do?
Adds auto-instrumentation to the serverless layer for LLM Observability. Now, in order to enable LLM Observability for auto-instrumented integrations (OpenAI, LangChain, Bedrock, and Anthropic), set
DD_LLMOBS_ENABLED=1
, along with:LLM Observability documentation is available for full instrumentation instructions.
Motivation
Enable easy onboarding and auto-instrumentation experience with LLM Observability in a serverless environment.
Testing Guidelines
Built the layer and tested against a lambda handler. Verified that
Types of Changes
Check all that apply