[BUG] Flux Lora training - sample image

[kalle07]

seems that if i generate sample images while the training, the lora is not used so it works it generates images with the prompt i wrote but the image always the same if i take the same seed if i use the lora seperate in compfy or webforge it works

[TheIronDev]

I am finding that the Lora is being used for me.

I pulled in the latest code from last night, and saw that the lora is used, but the sample images were not as good as what I saw in ai-toolkit.

If you're like me and used the config that SECourses suggested, the learning rate might be too low. I'm running another test but with a higher learning rate to see if the samples converge faster.

My Samples Screenshot:

Epoch 10

Epoch 200

Another thought, is maybe Guidance_Scale is off? I didn't see a setting in Kohya..

[kalle07]

i dont have the newest josn but learning is 0.0005 (original was 0.00005) also the image is generated two times faster than in webfroge_ui (same resolution) same image size and no change after 10% after 20% and so on