nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.77k stars 7.71k forks source link

How can I view how much of my GPU resources ChatGPT4All is using? #3184

Open AudioAnchorite opened 1 week ago

AudioAnchorite commented 1 week ago

I understand that I can do this using OpenLit, which I have installed, but the documentation only shows how to monitor stats for other projects when I want to see chat.exe's usage of my GPU. nvidia-smi command shows that "something" is using a large amount of VRAM when running chat.exe, but doesn't go into any details about anything, since GhatGPT4All doesn't seem to directly use the VRAM, etc.

kalle07 commented 1 day ago

GPU-Z

https://www.techpowerup.com/gpuz/