run-llama / llama_index

LlamaIndex is a data framework for your LLM applications
https://docs.llamaindex.ai
MIT License
36.74k stars 5.27k forks source link

Bedrock Cross-Region support #16955

Open csotomon opened 1 day ago

csotomon commented 1 day ago

Description

The latest versions of Claude and Llama models now support Cross-Region inferences, which require adding the region prefix to the model identifier. This fix enables the use of this feature by adapting our model handling to include the regional prefix.

Fixes # (issue) n/a

New Package?

Did I fill in the tool.llamahub section in the pyproject.toml and provide a detailed README.md for my new integration or package?

Version Bump?

Did I bump the version in the pyproject.toml file of the package I am updating? (Except for the llama-index-core package)

Type of Change

How Has This Been Tested?

Your pull-request will likely not be merged unless it is covered by some form of impactful unit testing.

Suggested Checklist:

csotomon commented 1 day ago

Should we also update bedrock converse?

I don't know what is bedrock converse, I checked the code in my project and now I can use the Claude 3.5 V2 without problem

csotomon commented 19 hours ago

@logan-markewich can U approve this MR?

For next week I will make a code refactoring for simplify the library maintenance.