search

dvmazur / mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops
MIT License
2.29k stars 225 forks source link

Trition Issues in Running the Code Locally #31

Closed amangupt01 closed 5 months ago

amangupt01 commented 5 months ago

Hey, thanks for sharing the code for the repository. I ran into the following issue while trying to run the code on a remote server:

Screenshot 2024-04-10 at 10 15 09 PM

Can you suggest a possible resolution for the issue?

amangupt01 commented 5 months ago

Nvm, I found the specific kernel code is not meant to be run on a v100 GPU