Closed yhou-uk closed 39 minutes ago
Hello @yhou-uk! I'm here to help you with any bugs, questions, or contributions. Let's tackle this together!
To address the issue of the missing Mistral Large 2 model ID in the utils.py
files for both Bedrock and Bedrock-Converse, you can manually add the model ID to the BEDROCK_MODELS
dictionary in the respective utils.py
files. This will allow the LlamaIndex package to recognize and use the Mistral Large 2 model.
Here's a general approach to resolve this:
Locate the utils.py
Files:
llama-index-integrations/llms/llama-index-llms-bedrock/llama_index/llms/bedrock/utils.py
llama-index-integrations/llms/llama-index-llms-bedrock-converse/llama_index/llms/bedrock_converse/utils.py
Add the Model ID:
utils.py
file, find the BEDROCK_MODELS
dictionary.BEDROCK_MODELS = {
# ... existing models ...
"mistral.mistral-large-2407-v1:0": <context_size>, # Replace <context_size> with the appropriate value
}
Test the Changes:
This workaround should enable the use of the Mistral Large 2 model until an official update is made to the LlamaIndex package.
To continue talking to Dosu, mention @dosu.
Yea as dosu mentioned, please do feel free to make a PR!
Bug Description
The Mistral Large 2 model is available in the AWS US West region via Bedrock and Bedrock Converse. The model ID is not included in below files so far:
Version
0.11.20
Steps to Reproduce
Currently Mistral Large 2 model cannot be used in the LlamaIndex package. It gives an error: 'Unknown model: mistral.mistral-large-2407-v1:0'. ... A workaround is to add the model ID in the your local files, such as: ~/anaconda3/envs/python3/lib/python3.10/site-packages/llama_index/llms/bedrock_converse.utils.py
Relevant Logs/Tracbacks
No response