search

Paperspace / ml-in-a-box

Machine learning tool-set for Paperspace VMs
54 stars 23 forks source link

Possible to bundle Ollama? #12

Open mchiang0610 opened 11 months ago

mchiang0610 commented 11 months ago

Hi,

I'm one of the maintainers of Ollama. We'll be releasing an official Linux build with Nvidia GPU support out of the box.

Would this be something of interest?

joshua-paperspace commented 7 months ago

Hi @mchiang0610,

Yes this could be of interest to us. If you can pass along an details to installing the linux build with Nvidia GPU support that would be helpful and we can asses during the next image upgrade.

anjanesh commented 6 months ago

So right now, until "official Linux build with Nvidia GPU" is out, can we install Ollama on paperspace manually ? I too am interested in running Ollama on paperspace.

joshua-paperspace commented 6 months ago

HI @anjanesh,

Yes, you can absolutely install it on any machine you spin up. We will add an Ollama install on our MLiaB environment next time we do a refresh