search

xdit-project / xDiT

xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
Apache License 2.0
720 stars 55 forks source link

OOM #318

Closed Reginald-L closed 3 weeks ago

Reginald-L commented 4 weeks ago

I use 4 L20 (each GPU with 46G) to run flux-dev, but I got OOM here is my code and log: image image image

is there any mistake in my code? May I get any help?

feifeibear commented 4 weeks ago

Can you successfully run our example code? https://github.com/xdit-project/xDiT/blob/main/examples/run.sh

It seems you did not initialize the distributed enviroment.

Reginald-L commented 3 weeks ago

Can you successfully run our example code? https://github.com/xdit-project/xDiT/blob/main/examples/run.sh

It seems you did not initialize the distributed enviroment.

yep, I can run the examples/run.sh file successfully

Reginald-L commented 3 weeks ago

Can you successfully run our example code? https://github.com/xdit-project/xDiT/blob/main/examples/run.sh

It seems you did not initialize the distributed enviroment.

yep, I can run the examples/run.sh file successfully