Setting which GPU to use with PyTorch

ollama / ollama-python

Ollama Python library

https://ollama.com

MIT License

2.71k stars 223 forks source link

Open merlinlikethewizard opened 4 months ago

merlinlikethewizard commented 4 months ago

Is there a way (or could there be) to select which GPU to run on when generating chat responses?

mxyng commented 4 months ago

This library doesn't use pytorch so I'm not sure what you're asking