Really strange results on a single teddy bear image.

[Sharpiless]

run:

python generate.py --ckpt ckpt/syncdreamer-pretrain.ckpt \
                   --input testset/teddy.png \
                   --output output/teddy2 \
                   --sample_num 4 \
                   --cfg_scale 0.0 \
                   --elevation 30 \
                   --crop_size 200

results:

run:

python generate.py --ckpt ckpt/syncdreamer-pretrain.ckpt \
                   --input testset/teddy.png \
                   --output output/teddy2 \
                   --sample_num 4 \
                   --cfg_scale 0.0 \
                   --elevation 0 \
                   --crop_size 200

results:

[Sharpiless]

Only work well on the previded demo:

Any suggestions would be appreciated.

[liuyuan-pal]

Hi, you may check if the segmentation of the input image is correct or not.

[Sharpiless]

Hi, you may check if the segmentation of the input image is correct or not.

This is the segmented rgb-a image. The mask seems to be correct.

[liuyuan-pal]

Hi, I've tried the image on the online demo https://huggingface.co/spaces/liuyuan-pal/SyncDreamer It seems to be OK.

[liuyuan-pal]

oh, you need to use cfg scale at 1.5 or 2.0. and the image should have an elevstion of 0 degree.

[Sharpiless]

Thanks a lot!

[Sharpiless]

Another trivia question: Are you willing to share the code that generates the "camera-16.pkl" file? Thanks!

[Sharpiless]

Another trivia question: Are you willing to share the code that generates the "camera-16.pkl" file? Thanks!

fixed by using blender 2.90 and https://github.com/liuyuan-pal/SyncDreamer/blob/main/blender_script.py

[liuyuan-pal]

Hi, it's this line https://github.com/liuyuan-pal/SyncDreamer/blob/1fa5ecf118cbda2096978d27dd602d4d027e065d/blender_script.py#L279