search

aws-samples / bedrock-claude-chat

AWS-native chatbot using Bedrock + Claude (+Mistral)
MIT No Attribution
828 stars 304 forks source link

Mistral models support #253

Closed hustshawn closed 5 months ago

hustshawn commented 5 months ago

Issue #, if available:

Description of changes:

Added Mistral models end-to-end support. Currently Mistral 7b and Mistral 8x7b are supported. Example effect in UI like below.

image

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

hustshawn commented 5 months ago

In addition to the comments in the codes, please add or modify:

  • Make it configrable in cdk.json.

    • like enableMistral, default is False

    • if False, the model options should not be showing on the chat screen.

  • Add documents on README.md

    • Add some explanation in Others section.

    • Please emphasize that this sample is not fully support mistral.

    • for example, prompt examples are based on claude.

Thank you in adnvance!

This has been addressed with latest commit.

hustshawn commented 5 months ago

Late night here, I will add mistral-large models support tomorrow. added support for Mistral large with latest commit.

hustshawn commented 5 months ago

@statefb as all comments are resolved, would you please merge it?

statefb commented 5 months ago

LGTM!