search

newrelic / newrelic-java-agent

The New Relic Java agent
Apache License 2.0
202 stars 144 forks source link

Java APM agent: AI Monitoring - Support for Converse and ConverseStream methods #2056

Open doshidhaval opened 1 month ago

doshidhaval commented 1 month ago

Is your feature request related to a problem? Please describe.

The Converse API for Bedrock provides a consistent approach to trigger different models and has quite a few advantages over the InvokeModel APIs. Currently only the InvokeModel is instrumented.

Feature Description

Add AIM instrumentation for AWS SDK Bedrockruntime Converse and ConverseStream API

Describe Alternatives

Additional context

Priority

Please help us better understand this feature request by choosing a priority from the following options: Really Want

workato-integration[bot] commented 1 month ago

https://new-relic.atlassian.net/browse/NR-315369

jasonjkeller commented 1 month ago

https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html

https://newrelic.slack.com/archives/C05DWELBP0F/p1726868512084289