how to try sd3 sample_sd3.py ?

Alpha-VLLM / Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

MIT License

1.82k stars 74 forks source link

how to try sd3 sample_sd3.py ? #66

Open s9anus98a opened 2 weeks ago

s9anus98a commented 2 weeks ago

I saw you made changes yesterday involving ODEs, and I'd love to try them out in a simple Diffusers Colab notebook. Is that possible? Does this change involve taking the transformer and VAE from SD3 and using them with Lumina? Thanks in advance!

gaopengpjlab commented 2 weeks ago

Lumina is going to support SD3 training from scratch, fullfinetune and inference with a significantly simplified implementation. Code shall be released in a few days.

s9anus98a commented 2 weeks ago

Lumina is going to support SD3 training from scratch, fullfinetune and inference with a significantly simplified implementation. Code shall be released in a few days.

so that's for training? i though the code for image generation. so i guess i can't try for now

zhuole1025 commented 2 weeks ago

Currently we support inference SD3 using their official checkpoints. You can directly run the scripts in lumina_next_t2i_mini/scripts/sample_sd3.sh.