fengju514 / Face-Pose-Net

Estimate 3D face pose (6DoF) or 11 parameters of 3x4 projection matrix by a Convolutional Neural Network
501 stars 109 forks source link

Can I use your library to find the nose position in my point cloud data? #10

Closed Ostnie closed 6 years ago

Ostnie commented 6 years ago

I am doing some research in 3d face point cloud,I have only a little experience,Now I have a problem that I can't find the nose position in my point cloud data,I see maybe your library can help me but I don't find the right program,could you help me? or tell me wether it can do this,many thanks!

TalHassner commented 6 years ago

@Ostnie, I'm not entirely sure what you are asking for.

You can use FacePoseNet to obtain a very accurate estimate of the position of the nose in an input image of a face (the pixel coordinates of the nose), however, FacePoseNet won't help you find the position of a 3D nose in an unaligned 3D point-cloud.

iacopomasi commented 6 years ago

Hi @Ostnie , I think this paper can be very helpful though it depends on how much your data points are noisy.

A. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1927-1943, Nov. 2007. doi: 10.1109/TPAMI.2007.1105

See in particular Sec. 3 and Fig. 3.

I hope this helps. -iacopo

Ostnie commented 6 years ago

Hi @iacopomasi ,thank you very much for your help, let me have a try