search

dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.29k stars 227 forks source link

need mixtral offload for NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO #19

Open githubpradeep opened 10 months ago