search

SillyTavern / SillyTavern-Extras

Extensions API for SillyTavern.
GNU Affero General Public License v3.0
563 stars 133 forks source link

GPU Selection #243

Closed tyrael0315 closed 5 months ago

tyrael0315 commented 5 months ago

Hello. I have a problem. For the life of me, I can't select the GPU I want to load the Silly Tavern Extras server. I have two GPUs installed one 4060ti 16GB (cuda:0) and one 1080ti 11 GB (cuda:1). I used the --cuda-device argument with 'x', "x", x,=x with all the previous variants, it always switches back to cpu. And yes, --cuda argument works fine, it find the 4060ti (cuda:0) and loads on it normally, but I want to load it on the 1080ti (cuda:1). Is there a syntax error on my side? Is there any special way to write this --cuda-device argument with its parameter?

Specs: OS Windows 11 CPU i7-8700k RAM 32GB GPU 1 4060ti 16GB (cuda:0) GPU 2 1080ti 11 GB (cuda:1)

Thank you in advance!

tyrael0315 commented 5 months ago

On further testing, to be able to select the GPU you wish to use, the command line needs the argument "--cuda", followed by "--cuda-device cuda:x" (where x stands for the GPU that you wish to select 0,1, etc.)