dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.29k stars 227 forks source link

Some refactoring #5

Closed lavawolfiee closed 11 months ago

lavawolfiee commented 11 months ago

Mostly, fixed some style issues and typings