search

pkuliyi2015 / multidiffusion-upscaler-for-automatic1111

Tiled Diffusion and VAE optimize, licensed under CC BY-NC-SA 4.0
Other
4.78k stars 337 forks source link

It seems that Lora cannot work on multi diffusion's sub region. #80

Open ApprenticeF opened 1 year ago

ApprenticeF commented 1 year ago

I add ,in region1's prompt, while in region2's prompt,but they are not work.

strielia commented 1 year ago

Do you enable the highres. fix function？ It seems this extension isn't compatible with LORA in highres.fix, no matter where you add the , even in main promt. If hires. fix is enabled, LORA seems to work on the sampling steps, but be disabled when upscale steps begin. Those drawn by LORA in sampling steps would be redraw into something related to the promts left.

ApprenticeF commented 1 year ago

Yes, I enabled the highres.fix and i saw the phenomenon that the lora character was changed to another one when upscaling. So, is this extension can compatible with highres.fix and lora in the future? Thanks.

strielia commented 1 year ago

I'm not the author of this extension, so just wait for the reply from author. But in another issue the author said that no plan for it. The author recommands to do a img to img for upscaleing, and I have try it. Just send the lowres result to IMGtoIMG and put the promt in the same place when you generated the lowres picture and set the upscaling params, the upscaling result is almost the same as highres. fix.

But any way it's not convenient as highres. fix.

For me, I used the highres. fix because I can't generate picture as large as 1024x1536 directly, no good result is found. I don't know if it is the problem of my 1660TI GPU or the model I used (AOM2H) is not suitable of large picture.

ApprenticeF commented 1 year ago

Thanks for your reply

pkuliyi2015 commented 1 year ago

A better upscale technique is updated in place of highres.fix. I may consider how can I bind the two together..

ApprenticeF commented 1 year ago

Hello, did multidiffusion-upscaler extension compatible with the better upscale technique that you referred?

zethfoxster commented 9 months ago

this produces hot garbage no matter what you do when using loras and also have you noticed if you use negative embeds it will apply it as a positive prompt instead of negative? yeah, im promptly uninstalling this mess.