support multithread merge

wkpark / sd-webui-model-mixer

Checkpoint model mixer/merger extension

GNU Affero General Public License v3.0

100 stars 4 forks source link

Closed wkpark closed 9 months ago

wkpark commented 11 months ago

The speed of block-level merging is usually faster than normal merging, but If you want to get more speed, enable multithreaded merging

Settings -> Model Mixer -> Use Multithread merge if the number of elements is greater than this size (default:500, 0: turn off) Tasks per thread: default 1

wkpark commented 9 months ago

we don't have to use multithread merge anymore.

with the use of torch.lerp() about ~2~3x faster than before
with the use of the partial U-Net, Clip (textencoder, BASE) update, the speed of merging has been reduced significantly