Adding Mistral-7B support

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD 3-Clause "New" or "Revised" License

5.35k stars 484 forks source link

Closed Artyom17 closed 4 months ago

Artyom17 commented 4 months ago

Implementing for issue #38 to support https://huggingface.co/mistralai models (non-MoE).

Somewhat related to PR #63, but there a different version is getting added.

Chillee commented 4 months ago

Thank you!