kohya-ss / sd-scripts

Apache License 2.0
5.31k stars 880 forks source link

any plans to support training for OpenFlux? #1766

Open huxian0402 opened 2 weeks ago

huxian0402 commented 2 weeks ago

@kohya-ss @lansing @rockerBOO @akx @tsukimiya @wkpark Would you consider supporting training for OpenFlux? The OpenFlux model link is: https://huggingface.co/ostris/OpenFLUX.1. Given that Flux and its derivatives have strict commercial usage restrictions—including limitations on combining SD3.0 with SD3.5 for commercial purposes—OpenFlux stands out as an option. Currently, only the Schnell version of Flux is available for commercial use, but its performance is relatively poor, and its guidance distillation and step distillation make fine-tuning challenging. Currently, OpenFlux is the only open-source model with decent performance, based on the de-distilled version of Schnell, and it has attracted significant attention. Do you have any plans to support training for OpenFlux?

4d4m0r commented 2 weeks ago

I'm able to train a Lora with the fp8 version of openFLux provided by kijai:

https://huggingface.co/Kijai/OpenFLUX-comfy

apparently the ostris model comes loaded with the vae and clips and when we try to make the lora adjustment on it, an error occurs. I don't really know how to say it.

But I didn't get good results training Lora, my images are coming out blurry and with poor quality, but it could be my mistake.