search

mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k stars 835 forks source link

Improve mistral inference #199

Closed patrickvonplaten closed 1 month ago

patrickvonplaten commented 1 month ago

Improve as per comments here: https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407/discussions/12