AugmentedRealityCat
commented
2 years ago I have been able to select a specific GPU by adding this line to the webui-user.bat file, (on the line just after the set COMMANDLINE_ARGS=) :
set CUDA_VISIBLE_DEVICES=1
Bear in mind that usually your main GPU will be device #0, the second will be #1, and so on and so forth. In the example above I am using my second GPU, so #1 (just like Supergreg) . If you wanted to use your 4th GPU, then you would use this line:
set CUDA_VISIBLE_DEVICES=3
This was never documented specifically for Automatic1111 as far as I can tell - this is coming from the initial Stable Diffusion branch launched in august, and since Automatic1111 was based on that code, I thought it might just work. And it did !
One caveat: Windows GPU monitoring via the Task Manager performance tab will reflect the use of VRAM on that GPU, but not the computing part, for some unknown reason. Now I look at its temperature to check if it's working hard or not.
jtoy
Chris7c0
flybfree
travisscottwilder
48design
chunyu-li
Mytrea
StudioDUzes
Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
My problem is that I have 4 GPU's that i'd like to load balance the requests with, which in my mind could be achieved by running multiple instances and load balancing with nginx to different ports (i.e 7860, 7861, 7862, 7863) If i could start the UI with a GPU indicator, they would all use different GPU's.
Describe the solution you'd like A clear and concise description of what you want to happen.
A launch parameter i.e --gpu[x]
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered. Parallelization support Additional context Add any other context or screenshots about the feature request here.