Fine-tuning script based on diffusers

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

https://pixart-alpha.github.io/PixArt-sigma-project/

GNU Affero General Public License v3.0

1.44k stars 68 forks source link

Fine-tuning script based on diffusers #72

Closed youngwanLEE closed 2 months ago

youngwanLEE commented 2 months ago

Hi, I appreciate your excellent work and sharing the code.

I wonder if you will release fine-tuning (training) code with diffusers as you already released the training script based on diffusers in the pixart-alpha repo?

It would be very helpful if you share the fine-tuning code based on diffusers.

lawrence-cj commented 2 months ago

Will be in the future. The training with fp16 + diffusers is unstable. We encourage our users to train with original repo.

youngwanLEE commented 2 months ago

@lawrence-cj Thanks for your quick reply :)

lawrence-cj commented 2 months ago

BTW, the training script will be similar to alpha one. You can have a quick apply.