search

aws-neuron / transformers-neuronx

Apache License 2.0
88 stars 25 forks source link

Support for Mistral-7B model #50

Closed henghui-zhu-amazon closed 4 months ago

henghui-zhu-amazon commented 9 months ago

Hi AWS Neuron team,

It would be great to have Mistral-7B model support since its performance is better than LLAMA2 and it is with a better license. Will this model be on the roadmap?

Best, Henry

aws-taylor commented 9 months ago

Hello @henghui-zhu-amazon,

Mistral is on our internal roadmap - we'll be adding a roadmap item to Github soon and will update this issue with a reference.

-Taylor

gsnaws commented 6 months ago

Beta support added in 2.16 release - https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/index.html#latest-neuron-release

jimburtoft commented 6 months ago

Instructions on how to compile and use are available at https://huggingface.co/aws-neuron/Mistral-neuron

aws-rhsoln commented 4 months ago

Please check the support added in 2.16 release. Closing the ticket. PLease reopen if you still see the issue.