search

run-llama / llama_index

LlamaIndex is a data framework for your LLM applications
https://docs.llamaindex.ai
MIT License
35.85k stars 5.08k forks source link

[Feature Request]: Add MistralAI foundations models to Bedrock integrations #11625

Closed chrismgonzalez closed 3 months ago

chrismgonzalez commented 7 months ago

Feature Description

Add support for MistralAI foundation models in the llama-index-integrations/llms/llama-index-llms-bedrock package.

Model IDs:

Reference

Reason

AWS just added Mistral 7b Instruct and 8x7b Instruct to the Bedrock API. The current version of Llama-Index does not support these models.

Value of Feature

These 2 models are significantly cheaper to use on Bedrock compared to other models. This seems like a fairly low effort change as it is just adding their ModelIDs to the package.

dosubot[bot] commented 7 months ago

It seems like you've got this under control, if you want help or have specific questions, let me know what I can do for you!

#### About Dosu This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant. If you want to continue the conversation, start your reply with @dosu-bot.