search

Aider-AI / aider

aider is AI pair programming in your terminal
https://aider.chat/
Apache License 2.0
20.76k stars 1.91k forks source link

Claude Sonnet 3.5 V2 not working with AWS Bedrock #2120

Open KoStard opened 2 hours ago

KoStard commented 2 hours ago

Issue

aider --model 'anthropic.claude-3-5-sonnet-20241022-v2:0'
/ask hello

Tokens: 2.0k sent, 0 received. Cost: $0.0060 message, 
$0.0060 session.

and similar commands seem to just wait for the response but doesn't actually show one.

With the older version it works correctly:

aider --model anthropic.claude-3-5-sonnet-20240620-v1:0
> /ask hello                                           

Hello! How can I assist you with the code in your git  
repository today? Is there a specific question you have
about any of the files or functionality?               

Tokens: 2.0k sent, 31 received. Cost: $0.0064 message, 
$0.0064 session.

I updated aider-chat and litellm.

Version and model info

Model: anthropic.claude-3-5-sonnet-20241022-v2:0 with diff edit format, infinite output Git repo: .git with 111 files Repo-map: using 1024 tokens, auto refresh VSCode terminal detected, pretty output has been disabled.

paul-gauthier commented 2 hours ago

Thanks for trying aider and filing this issue.

Don't update litellm. Aider pins its versions to work with known, tested versions of the required packages.

https://aider.chat/docs/troubleshooting/imports.html

Try a clean install and see if it works better for you.