[feature request] Traces with Bedrock Converse API (+Claude 3)

gregwchase commented 3 months ago

Is your feature request related to a problem? Please describe. When running evals with Claude v3, the OpenInference library doesn't support Anthropic's message api (it assumes "prompt" is in the invoke_model call, which is only true for Claude 2

Describe the solution you'd like

Ability to have traces with Claude 3

Describe alternatives you've considered

Currently reverted to using Claude 2 for now.

Additional context Add any other context or screenshots about the feature request here.

mikeldking commented 3 months ago

Just confirming this is using Bedrock @gregwchase @gabe0912

gregwchase commented 3 months ago

@mikeldking Confirmed - access is via Bedrock.

Arize-ai / openinference

[feature request] Traces with Bedrock Converse API (+Claude 3) #531