Is there any way that I can color the model I've generated? - Githubissues

zju3dv / animatable_nerf

Code for "Animatable Implicit Neural Representations for Creating Realistic Avatars from Videos" TPAMI 2024, ICCV 2021

Other

493 stars 50 forks source link

Is there any way that I can color the model I've generated? #53

Closed Marianoeli closed 1 year ago

Marianoeli commented 1 year ago

Thanks for your amazing work,sir.But I wonder that I s there any way that I can color the model I've generated?

dendenxu commented 1 year ago

Are you referring to the generated mesh of the trained model? If it's just for previewing:

You can query the canonical render_network for vertex color or texture colors (possibly use one of the training view directions).
After that just use your favorite 3D mesh saving library (maybe open3d, trimesh, or pytorch3d) to write the mesh along with its vertex/texture color to disk.

If you want to convert an anisdf/aninerf model to mesh without any precision/realism loss:

That would be a research problem on its own!
For example, you will have to incorporate the view-dependent effect onto the generated mesh, using something like spherical harmonics?