FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
31.81k stars 16.58k forks source link

[BUG] AWS ChatBedrock/Tool agent error #3513

Open jorge-henao opened 1 week ago

jorge-henao commented 1 week ago

Describe the bug

AWS ChatBedrock throws error "output values have 1 keys, you must specify an output key or pass only 1 key as output" or "Unsupported message content format" error.

image image image

To Reproduce Steps to reproduce the behavior:

Connect Tool Agent to AWS ChatBedrock Setup AWS credentials with access to Anthropic Bedrock models Select a supported model from cross-region inference profiles (https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-support.html) .

Note: if you choose an Anthropic model model from the drop down it throws another error: Failed to access underlying url 'bedrock-runtime.us-east-1.amazonaws.com': got 400 Bad Request: {"message":"Invocation of model ID anthropic.claude-3-5-sonnet-20241022-v2:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model."}

image

Expected behavior The proper model dialog response and function calling

Screenshots

image image image

Flow If applicable, add exported flow in order to help replicating the problem.

Setup

Flowise 2.1.3.

Additional context Add any other context about the problem here.

HenryHengZJ commented 1 week ago

Will be fixed in the next upgrade: https://github.com/FlowiseAI/Flowise/pull/3517