Closed JGalego closed 4 weeks ago
This PR adds support for the following models available on Amazon Bedrock:
Build image
docker build --rm -f Dockerfile -t acr .
Set up AWS credentials
# See https://litellm.vercel.app/docs/providers/bedrock export AWS_REGION_NAME=... export AWS_ACCESS_KEY_ID=... export AWS_SECRET_ACCESS_KEY=...
Start image
docker run -it $(env | grep AWS_ | xargs printf ' -e %s') -p 3000:3000 -p 5000:5000 acr
Start web UI
cd /opt/auto-code-rover/demo_vis/ sed -i 's/gpt-4-0125-preview/bedrock\/anthropic.claude-3-sonnet-20240229-v1:0/g' main.py bash run.sh
Head over to [http://localhost:3000]()
Click 💡 Try example? 💡
Click 🚀 Boot Now! 🚀
Hi @JGalego , I tested the model driver today. Only added Claude 2 to the patch just for completeness sake. Looks good, thanks for the contribution!
Overview
This PR adds support for the following models available on Amazon Bedrock:
Instructions
Build image
Set up AWS credentials
Start image
Start web UI
Head over to [http://localhost:3000]()
Click 💡 Try example? 💡
Click 🚀 Boot Now! 🚀