search

yihua7 / NeRF-Texture

[SIGGRAPH 2023, TPAMI 2024] Code for NeRF-Texture: Texture Synthesis with Neural Radiance Fields
https://yihua7.github.io/NeRF-Texture-web/
189 stars 10 forks source link

Question about Training Step 3. Create picked_faces.obj (optional) #2

Closed RuihanGao closed 1 year ago

RuihanGao commented 1 year ago

I am trying to reproduce the results synthesizing durian's 3D texture and copy it to the banana. For Step 3, I can select the bottom region using "rectangle selection" tool in MeshLab, but how shall I cut it afterwards? I tried "delete selected faces and vertices", but it is not a closed mesh object for saving. Screenshot from 2023-06-13 21-00-09 Screenshot from 2023-06-13 21-17-19

If skipping this step, I could get synthesized texture, but not uniform as demonstrated.

Screenshot from 2023-06-13 21-36-44 Screenshot from 2023-06-13 21-39-51

ps: I reproduce the above results using --tcnn flag instead of --ff flag, as I was unable to install ffmlp package.

Do you have any suggestion on that?

yihua7 commented 1 year ago

The file picked_faces.obj does not necessarily need to be a closed mesh. It serves as a template on which implicit patches are sampled from. In the specific 'durian' scene, only the upper portion of the fruit is visible, while the lower part is occluded by the platform supporting it. Without having constructed a picked_faces.obj file, the texture synthesis process will use the lower region that cannot be seen and this can lead to a noisy or imperfect result. To avoid this, please consult the picked_faces.obj model included in the data provided in the Quick Start guide.