papuSpartan / stable-diffusion-webui-distributed

Chains stable-diffusion-webui instances together to facilitate faster image generation.
181 stars 14 forks source link

Multiple workers function until I change the resolution of the output on the master server. #33

Closed cul8rmom1 closed 2 months ago

cul8rmom1 commented 2 months ago

Awesome extension. I have copied the entire install directory between all of the machines to make sure everything is apples to apples. This is the start command line on the 2 remote workers. set COMMANDLINE_ARGS= --theme dark --xformers --listen --api --api-server-stop.

Running windows 10/11 with all virus scan/firewall etc turned off.

Everything works great until... image

I can do the benchmark and it runs on all nodes. image image image All good in the hood. Now I change the resolution. Then it says "DISTRIBUTED | DEBUG distributed has nothing to do, returning control to webui distributed.py:303" image

I turn complimentary back on and it creates a crap ton of extra on the slower nodes. image

I will jump in discord and see who says what. Let me know if there is any other information I can provide.

Thanks!!

papuSpartan commented 2 months ago

I can't go through this all immediately. However, know that you should only need the extension installed on a single instance. The other instances merely need their api exposed so that you can add them in the main instance.

papuSpartan commented 2 months ago

The solution in this case was to increase batch size before iterations/batch count