Open purzbeats opened 1 day ago
Oh man I wish...... this one has been causing me some gray hairs all day...
But I did just run 1280x768 first time succesfully under 20GB, there's hope!
Under 12GB actually:
I got it running locally last night but it OOM'd on the 384p model, they added VAE tiled decoding I think last night so I'm gonna try again 🤣
Yeah that VAE took a lot, but it's also that their pipeline had no offloading of text_encoder etc. at all.
Does it works with 24go of vram with the vae ? thanks
I just tried and the vae cause a OOM even with 24go of vram
I just tried and the vae cause a OOM even with 24go of vram
With 256 tile size it's taking under 12GB for me:
You're too fast. 💖