search

ollama / ollama-python

Ollama Python library
https://ollama.com
MIT License
2.69k stars 221 forks source link

gpu not worked, only cpu. How to solve it? #119

Closed moeAlice closed 2 months ago

moeAlice commented 2 months ago

Thank you for an such excellent library.

I meet a strange problem. While I run the ollama or rust api, my cpu worked, not my gpu(4060ti 16g).

I ever tried Chatbox and the gpu worked. And with the same machine but only cpu worked while I tried the rust api via python.

Maybe there were some configuration or parameters needed to be set?

moeAlice commented 2 months ago

Ok.. After updating Ollama, gpu works now.