taconite / arah-release

[ECCV 2022] ARAH: Animatable Volume Rendering of Articulated Human SDFs
https://neuralbodies.github.io/arah/
MIT License
182 stars 15 forks source link

How can I save mesh and texture files? #30

Open rexainn opened 7 months ago

rexainn commented 7 months ago

First of all, thanks for your great work!!! But there are some questions I found when I reproduce on my custom dataset.

I've set gen_cano_mesh = True, but there is no mesh file saved in my output dirs. I checked the code, and I thought that it only outputs the rendered images.

So how could I save mesh files like what you offer in this link? Also I downloaded your mesh files and visualize them in meshlab, I found that there is no texture like rendered images in vis/rgb_pred.

What I need is mesh file with texture, so that I could use it in my scenes and rendered like vis/rgb_pred just with backgrounds.

This is your offered mesh file without texture: image

taconite commented 7 months ago

The current code does not contain an explicit mesh exportation routine. You can use mesh faces and vertices here to obtain the mesh - for example, you can convert these tensors to numpy arrays and use trimesh to save the mesh.

taconite commented 7 months ago

For texture, you can query the underlying color MLP to get per-vertex/face colors. However, this will result in a degenerated appearance. How to reproduce the appearance of volume rendering using mesh-based rendering is an open question in CV.