search

ollama / ollama-python

Ollama Python library
https://ollama.com
MIT License
2.69k stars 221 forks source link

GPU- Utilization freezing #142

Open ankitvirla opened 1 month ago

ankitvirla commented 1 month ago

sometime, GPU- Util memory is freezing, when I'm using mistral through ollama-python . Creating a host using "Client" method.

image

sometime GPU util reaching to 93%, and everything hanging.

image

is there anyone who faced the same issue, any solution for the same.

Thanks.