search

mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k stars 835 forks source link

Does mistral-instruct-7b support fast transformer deployment #64

Open lebronjamesking opened 10 months ago

lebronjamesking commented 10 months ago

Hi there, As per title, when and how mistral-instruct-7b support fast transformer deployment? This would be very helpful as llama2-chat already support ft.