search

run-llama / llama_index

LlamaIndex is a data framework for your LLM applications
https://docs.llamaindex.ai
MIT License
36.85k stars 5.28k forks source link

[Feature Request]: Add Support for Claude 3.5 Sonnet V2 #16681

Closed chrismgonzalez closed 3 weeks ago

chrismgonzalez commented 3 weeks ago

Feature Description

With the latest release of Claude Sonnet 3.5 V2, it would be nice to have this supported in the the llama-index-llms-bedrock-converse package. It supports messages and tool use, so we can use it with those existing features of the package.

For good measure, we can update the llama-index-llms-bedrock, as well.

Reason

One could in theory download the package, update the model, and bundle it. But that only works for an individual. Not ideal!

Value of Feature

It adds the latest foundation model from Anthropic for Amazon Bedrock into the library. This will enable those of us on developing greenfield applications the ability to use the latest models.

chrismgonzalez commented 3 weeks ago

I'm happy to take on this task! I can get a PR going by end of week.

logan-markewich commented 3 weeks ago

The above PR will release a new version of both the bedrock and bedrock converse integration packages when it merges. Added support for the new sonnet model