search

3dlg-hcvc / omages

We present Object Images (Omages): An homage to the classic Geometry Images.
MIT License
257 stars 12 forks source link

Two different models for geometry and texture. #8

Open linziqu opened 2 months ago

linziqu commented 2 months ago

Thank you for your kind response for my previous issue.

I have one more question regarding the different model used for the geometry images and material images. The model for geometry images is Dit, which flattens the image to 1-D for processing, and the model for material images is imagen, which directly inputs the 2-D images. Why not using the Dit for material images generation?

QhelDIV commented 2 months ago

Hi, thanks for the question. In theory, yes, DiT can also generate material maps conditioned on the generated geometry. In practice, we find imagen can learn mateiral maps more easily, while DiT can learn the geometry better.