dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.28k stars 223 forks source link

Some refactoring #5

Closed lavawolfiee closed 6 months ago

lavawolfiee commented 6 months ago

Mostly, fixed some style issues and typings