deep-floyd / IF

Other
7.63k stars 495 forks source link

OOM appears using DeepFloyd_IF (I use 32G video memory) #147

Open qixuanwang-233 opened 5 months ago

qixuanwang-233 commented 5 months ago

As in the title, OOM appears when I use DeepFloyd IF through diffuser (I use 32GB video memory).

image

I used the diffuser example directly: image image

Bigfield77 commented 5 months ago

Stage 3 is pretty useless, it's just a generic upscaler by stability.

does it still oom if you bypass it?

qixuanwang-233 commented 5 months ago

Stage 3 is pretty useless, it's just a generic upscaler by stability.

does it still oom if you bypass it?

Thank you for your response, stage 3 is all I need and I solved this problem by using xFormers.

Bigfield77 commented 5 months ago

Good for you! Btw, how do you use xformer with deepfloyd?

*update: found it enable_xformers_memory_efficient_attention() on the pipeline