sail-sg / MDT

Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)
Apache License 2.0
500 stars 35 forks source link

Visualization problem #27

Closed ZH3nGsQ closed 5 months ago

ZH3nGsQ commented 5 months ago

When I use your pretrained model and run the infer_mdt.py to generate images. The outcome--"sample.jpg" was very noisy. Can you tell me what is happened? {Q0 B6C82HN)QP7PHZU0O8G

ZH3nGsQ commented 5 months ago

And I also encountered with another problem in training stage is that--"RuntimeError: a leaf Variable that requires grad is being used in an in-place operation." I don't know how to solve that.

xv994 commented 5 months ago

hey bro, I met some problems when I ran the "infer_mdt.py". Can you tell me how can I run this .py file? image Should I change or add some parameters?

gasvn commented 5 months ago

Have you do the pip install -e .? I tested on my side, and it works fine.

image
gasvn commented 5 months ago

When I use your pretrained model and run the infer_mdt.py to generate images. The outcome--"sample.jpg" was very noisy. Can you tell me what is happened? {Q0 B6C82HN)QP7PHZU0O8G

did you download the pretrained model from hugglingface?

ZH3nGsQ commented 5 months ago

hey bro, I met some problems when I ran the "infer_mdt.py". Can you tell me how can I run this .py file? image Should I change or add some parameters?

I didn't change or add any parameters.

ZH3nGsQ commented 5 months ago

When I use your pretrained model and run the infer_mdt.py to generate images. The outcome--"sample.jpg" was very noisy. Can you tell me what is happened? {Q0 B6C82HN)QP7PHZU0O8G

did you download the pretrained model from hugglingface?

I already download pretrained model "mdt_xl2_v2_ckpt.pt" from hugging face. And I use the pip install -e . . The outcome is still worse.

gasvn commented 5 months ago

Did you find any warning or so? If looks like the pretrained model is not correctly loaded.