search

liuyuan-pal / SyncDreamer

[ICLR 2024 Spotlight] SyncDreamer: Generating Multiview-consistent Images from a Single-view Image
https://liuyuan-pal.github.io/SyncDreamer/
MIT License
906 stars 39 forks source link

Generating from other views #41

Open mshahbazi72 opened 1 year ago

mshahbazi72 commented 1 year ago

Hi

Is it possible to generate images from other views different from the 16 views used during training? I assume it is not possible to generate more than 16 images, but I tried generating new views by replacing the camera parameters in the pickle file camera-16.pkl. However, I still get the same images when running generate.py. I suspect this might be because the camera parameters are over-written by the checkpoint

liuyuan-pal commented 1 year ago

Hi, the model does not support the generation of images in other views. It is trained to generate 16 views on the elevation of 30 degrees and evenly distributed azimuth. These fixed viewpoints are hardcoded in the attention layers so that generating other views would be low-quality if we change these viewpoints.

yuhuangyue commented 10 months ago

I want to run train_renderer.py to generate mesh file, how can I replaced with other views?