search

paperswithcode / galai

Model API for GALACTICA
Apache License 2.0
2.68k stars 276 forks source link

Why is CUDA is required for pytorch? #49

Closed blair0011 closed 1 year ago

blair0011 commented 1 year ago

Please remove the CUDA requirement or export the model in a device agnostic format like ONNX. Some people just want to try out your models but their systems may not have a compatible Nvidia GPU.

mkardas commented 1 year ago

Hi @blair0011, can you check with galai version 1.1.0? You can load the model to RAM with load_model(..., num_gpus=0).

Pepe-Marquez commented 1 year ago

Hi @mkardas, I could perfectly load the 'mini' setting num_gpus=0. Thanks

blair0011 commented 1 year ago

I found the issue it was because WSL needed an update and conversion of my VM to version 2. Now everything works. Thanks