isl-org / Open3D

Open3D: A Modern Library for 3D Data Processing
http://www.open3d.org
Other
11.21k stars 2.28k forks source link

How mesh the merged 2D face image on a 3D model(how to create the map between 2D and 3D)? #5906

Open kt-rax opened 1 year ago

kt-rax commented 1 year ago

Checklist

My Question

How to mesh a special texture on to a special 3D model (how to create the map between 2D and 3D)? (1)speacial texture: 2D face images( merged from two images ) (2)special 3D model: 3D face model with points cloud (3)3D model and 3D images got from the same face 34E9BF4F-F4EC-477b-92AE-BA3CB62836E7

kt-rax commented 1 year ago

additional comment:I have got the some mapped face feature points in the middle of the face

ssheorey commented 1 year ago

This function is helpful for your problem:

http://www.open3d.org/docs/latest/python_api/open3d.t.geometry.TriangleMesh.html#open3d.t.geometry.TriangleMesh.bake_triangle_attr_textures

Here is an example result: https://user-images.githubusercontent.com/217089/194868359-d9f68049-49a4-4985-99af-5eb5e357e372.gif

However you need the "texture_uvs" triangle mesh property - this specifies the texture coordinates for every triangle (not just some mapped points). You will have to estimate this for your specific use case.

kt-rax commented 1 year ago

Hi ssheorey, Thank for your reply. It's very helpful. Could you pls share the example code if possible? I run the function demo code but don't get the same result. (texture a picture or image on a 3d model). Additional how to estimate the texture coordinates? Is there any suggestion ? Thanks.