search

ollama / ollama-python

Ollama Python library
https://ollama.com
MIT License
2.67k stars 220 forks source link

OLLAMA Python, Why can't I use all the threads on the CPU? #167

Open HamzaYslmn opened 1 month ago

HamzaYslmn commented 1 month ago

image

I analyzed the problem in depth. I get faster responses when I use the terminal, something is wrong with Python. Just use E-cores and its too slow.

I HAVE:

i9 - 13980HX 24 Core - 32 Thread

HamzaYslmn commented 1 month ago

When I test with the GPU, there is a 30% speed difference between running from Python and running from Terminal. Why is this problem happening?