search

liuliu / swift-diffusion

BSD 3-Clause "New" or "Revised" License
423 stars 33 forks source link

Dreambooth Swift Diffusion? #11

Open enzyme69 opened 1 year ago

enzyme69 commented 1 year ago

Do you have plan to implement Dreambooth for Swift Diffusion? I am super curious on this, been looking around. But usually Windows or Linux?

liuliu commented 1 year ago

Yeah, one thing good about my implementation is that s4nnc is a good framework for training as well. It has been used to train from RL models to image classifiers to translation models. However, we do need to implement backward passes for all the ops involved, and need to take a closer look at memory usages (as I understand, many of the current "dreambooth" implementations uses 8bit NVIDIA adam optimizer implemented in bitsandbytes repo).