search

rohitgandikota / sliders

Concept Sliders for Precise Control of Diffusion Models
https://sliders.baulab.info
MIT License
774 stars 64 forks source link

SDXL Training #88

Open Benji4564 opened 2 months ago

Benji4564 commented 2 months ago

Hello (again ;) ), your pretrained checkpoints as well a multiple slider work very well, but I have proplems training my own. I used your sample prompts and settings for textsliders, but there where no change in the result. All generated images look the same.

chabrarahul commented 2 months ago

Hello,

In the paper figure 14, it is tested that strengths of edits in the range (-3 to 3) for the slider values (CLIP score and LPIPS). I wanted to know why did you choose max till 3. Does it depend on the guidance ? In the prompt-age-slider-GPT.yaml default guidance is 4. Does the sliders strength will be maximum at 4 ? The thing is when I tested slider for various values it was not showing the desired changed at slider value 4 so I have to increase and then finally at 7 or 8 it was showing me changes. Is that possible even if the guidance is set to 4 it still can show beyond 4 ?

Benji4564 commented 2 months ago

I think I more or less fixed the problem, but found another. The SDXL training works, but you cannot add other loras with the pipe.load_lora_weights function, because thenn you only get the same image

chabrarahul commented 2 months ago

Hey @Benji4564 , How did you solve the training issue ? I am also the same issue where there is not effect after training.

liujingwen-bmil commented 2 weeks ago

I am also the same issue where there is not effect after training, Is there any good solution?