autonomousvision / differentiable_volumetric_rendering

This repository contains the code for the CVPR 2020 paper "Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision"
http://www.cvlibs.net/publications/Niemeyer2020CVPR.pdf
MIT License
798 stars 90 forks source link

How to obtain normal, and texture for multi-view reconstruction #26

Closed tharinduk90 closed 4 years ago

tharinduk90 commented 4 years ago

Hi! Amazing paper, and very clean code! Thanks so much for releasing this.

how to obtain normal map and color map (texture) for multi-view reconstruction ?

m-niemeyer commented 4 years ago

Hi @tharinduk90 !

If you have a trained model (you can use one of the pre-trained models as a start), you can run our generation script to obtain the output. This will produce a mesh which is textured and has normals (both per vertex). In this function we do the per-vertex color prediction, and here we do the normal estimation. If you want to disable the color prediction, you can do this in your config file modifying the generation - with_normals argument. We do not support any other output format of the normals / texture currently.

I hope this helps. Good luck!