modelscope / richdreamer

Live Demo:https://modelscope.cn/studios/Damo_XR_Lab/3D_AIGC
https://aigc3d.github.io/richdreamer/
Apache License 2.0
362 stars 13 forks source link

Meet some problems when running the code #15

Closed snowflakewang closed 5 months ago

snowflakewang commented 5 months ago

Hello, thank you for your brilliant work! I am deeply impressed by the results shown on the project page. Their geometry and texture are quite highly detailed! But I have some problems when running the code. I think it is my reason. But I do not know which step is wrong. I used _tools/download_ndmodels.py to download the model checkpoint successfully. But when I ran the command:

prompt="A statue of angel, 3d asset"
out_path=outputs/$(echo "$prompt" | tr " " "_")

python run_dmtet.py -t "$prompt" -o "$out_path"

I got the following problems:

RuntimeError: Error(s) in loading state_dict for LatentDiffusionInterface:
        Unexpected key(s) in state_dict: "cond_stage_model.transformer.text_model.embeddings.position_ids".

Could you help me to fix it? Thanks a lot! :)

Update: I change the following in _modelzoo.py

model.load_state_dict(model_ckpt, strict=False) # model.load_state_dict(model_ckpt, strict=strict)

Then the code can be run successfully. But I do not know whether this operation is true.

lingtengqiu commented 5 months ago

what is your diffusers version or transformers version?

snowflakewang commented 5 months ago

transformers==4.37.0.dev0 diffusers==0.23.0

lingtengqiu commented 5 months ago

try: diffusers==0.180 & transformers==4.30.2