search

ostris / ai-toolkit

Various AI scripts. Mostly Stable Diffusion stuff.
MIT License
3.48k stars 372 forks source link

Can we train SDXL lora with this tool? #164

Open pandayummy opened 2 months ago

pandayummy commented 2 months ago

Is this tool specifically designed for flux?

gg-26 commented 2 months ago

Is this tool specifically designed for flux?

i think yes

pandayummy commented 2 months ago

But SDXL much faster than Flux, it will be there with Flux for several years.

gessyoo commented 2 months ago

But SDXL much faster than Flux, it will be there with Flux for several years.

I've used and can recommend the OneTrainer project for SDXL whole model fine-tunes and LoRas. But Flux is next-level in quality. If you're interested in faster Flux gens, try Flux Schnell. Good results in 4 steps, but experimental.

omidsakhi commented 1 month ago

I tried to change the configurations for SDXL and was not able to match the quality of the lora training that I was getting with AutoTrain Advanced. I suspect there are subtle differences between how the training loop is implemented here compared to DreamBooth from AutoTrain. So, I made a library (lorakit) to follow a configuration similar to this one to train SDXL lora. lorakit

pandayummy commented 1 month ago

I tried to change the configurations for SDXL and was not able to match the quality of the lora training that I was getting with AutoTrain Advanced. I suspect there are subtle differences between how the training loop is implemented here compared to DreamBooth from AutoTrain. So, I made a library (lorakit) to follow a configuration similar to this one to train SDXL lora. lorakit

Could u pls put some images of the UI in your repo?

omidsakhi commented 1 month ago

@pandayummy lorakit does not have a UI (at least not yet). It has a configuration file that you edit. Then you call lorakit through command line interface and pass that configuration for the training to start. Sampled images during the training will be written in the output folder.