search

youngLBW / HRN

[CVPR2023] A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images.
https://younglbw.github.io/HRN-homepage/
Apache License 2.0
414 stars 38 forks source link

Is there a way to export 3d recontructed face after applying the deformation and displacement map ? #6

Closed fabricecarles closed 1 year ago

fabricecarles commented 1 year ago

Thank you for sharing this beautiful project

The current exported 3d mesh I get when running single view task is hrn_mid_mesh.obj and do not include all details as like in final 2d output

By backtracing through https://github.com/youngLBW/HRN/blob/main/models/facerecon_model.py#L823 and https://github.com/youngLBW/HRN/blob/main/models/facerecon_model.py#L364

I am trying to export the 3d face after applying the deformation and displacement map but I am not sure it is possible ? It seam that everything is apply frame by frame in 2d space inside render_uv_texture https://github.com/youngLBW/HRN/blob/main/util/nv_diffrast.py#L150 I am right ?

If there is a way to export final deformation and displacement in 3d space could you share it ?

Thanks

youngLBW commented 1 year ago

Hi, thanks for your appreciation.

We supported the exporting of the mesh after applying the deformation and displacement map just now.

Note that the displacement map is designed to apply on the rendering process, so the effect of the exported mesh with high frequency details may not be as ideal as the rendered 2D image.