search

dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.28k stars 223 forks source link

Update build_model.py #27

Open fire717 opened 4 months ago

fire717 commented 4 months ago

change model_name to arg so we can input local dir like "/model/xxx/Mix..." to load without network.