Great work! I got this "Out of memory" issue

PRIS-CV / I-Max

Maximize the Resolution Potential of Pre-trained Rectified Flow Transformers

30 stars 0 forks source link

Great work! I got this "Out of memory" issue #1

Open WilTay1 opened 2 weeks ago

WilTay1 commented 2 weeks ago

this is my machine 2 A100 40G for each

how to make the model run both GPUs?

RuoyiDu commented 2 weeks ago

this is my machine 2 A100 40G for each

how to make the model run both GPUs?

Thanks for your interest! We run I-Max on A100 with 80G VRAM so haven't encountered this problem. But you can try changing query_batch = False to query_batch = True in attention_processor.py to reduce the peak VRAM. Good luck!

shivshankar11 commented 4 days ago

what is maximum resolution 4090 can process without OOM?