search

PixArt-alpha / PixArt-sigma

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation
https://pixart-alpha.github.io/PixArt-sigma-project/
GNU Affero General Public License v3.0
1.44k stars 67 forks source link

PixArt Sigma output image is only messy noise #109

Closed VGF64 closed 3 weeks ago

VGF64 commented 3 weeks ago

I did everything to set up correctly with this on ComfyUI but when I keep attempting to generate an image it gives me this every time.

ComfyUI_00436_

Any idea what went wrong here?

chrish-slingshot commented 3 weeks ago

Can you share your workflow?

VGF64 commented 3 weeks ago

Can you share your workflow?

Yes, here: Screenshot (363)

I wanna assume and believe it has something to do with the T5v1.1 Loader node. Not too entirely certain. Also the Resolution Select node is set wrong but even when I changed it to the appropriate model it still outputs this way.

chrish-slingshot commented 3 weeks ago

pixart_sigma_test_2.json

Strange, I recreated it and it works ok on my machine. Can you try the attached workflow? If it still fails, I would lean toward it being a VAE problem - maybe try redownloading the Sigma VAE again.

VGF64 commented 3 weeks ago

I downloaded and then redownloaded the VAE from this link via photographer's workflow of PixArt Sigma on CivitAI: https://huggingface.co/PixArt-alpha/pixart_sigma_sdxlvae_T5_diffusers/tree/main/vae

And then I downloaded this VAE as well: https://huggingface.co/PixArt-alpha/PixArt-Sigma-XL-2-1024-MS/tree/main/vae

All of which are still giving me the same messy noise.

Screenshot (364)

VGF64 commented 3 weeks ago

I resolved it! I had to follow this guide and it did the trick! https://civitai.com/articles/5355/installing-comfyui-for-use-with-pixart-sigma

I think it (might?) have something to do with me not having xformers, as I didn't have it installed in my Comfy venv.