Closed w-e-w closed 1 year ago
The problem happens inside the UNet instead of the VAE. It should be a problem related to the TOME extension instead of the Tiled VAE extension.
A similar issue has been proposed here. Refer to this for help: https://github.com/dbolya/tomesd/issues/37
in the upcoming 1.3 webui update we will introduced a future called "token merging" https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/9256 this feature is currently available in the dev branch
tldr
Tiled VAE
won't work whentoken merging
is enabledduring testing of dev branch I found that when token merging is enabled Tiled VAE seems to be not functionally probably and not reducing vram
this is just a preliminary issue report I haven't dug into the issue yet and potential solution just want to notify you that the issue will exist in the updcooming update
when trying to generate larger images that need Tiled VAE to not out of memory, if "token merging" is enabled will result in out of memory, as if it is not tiled.
Tiled VAE will still function as normal if "token merging" is disabled
not sure what it would take to solve the issue, maybe it requires changes on webui
the following out of memory error log was encountered when trying to generate 3840x2400 image on 3090 24G with
token merging
enabled, (alsoxformers
) the same issue is also reproduced on a 1650 4G when generate 2048x2048 image withtiled vae
andtoken merging
enabled at the same time