search

abdallahdib / NextFace

A high-fidelity 3D face reconstruction library from monocular RGB image(s)
GNU General Public License v3.0
707 stars 91 forks source link

Wrong pose and higher iterStep1 lead to bad shape #36

Open Michaelwhite34 opened 2 years ago

Michaelwhite34 commented 2 years ago

iterStep1 2000 left Deep3DFaceRecon_pytorch, right NextFace. Image 11 Image 12 e5895849736cc2a677c7386e31d6 iterStep1 10000
debug1_iter0_frame0 render_0

landmarks0

abdallahdib commented 2 years ago

Hi I never tested with 10000 iterations, u need to increase the shape/expression regularuzation to get better fitting

Michaelwhite34 commented 2 years ago

Hi I never tested with 10000 iterations, u need to increase the shape/expression regularuzation to get better fitting

But 2000 iterations still gives bad results, some clear facial feather doesn't match, like nose.

abdallahdib commented 2 years ago

Did u try multiple view points for same subject? This could improve the accuracy of the geometry. Using single image for the reconstruction is ill posed. Having multiple views improves.

Michaelwhite34 commented 2 years ago

Did u try multiple view points for same subject? This could improve the accuracy of the geometry. Using single image for the reconstruction is ill posed. Having multiple views improves.

I mean, I am not even talking about side view of nose, the input is front view and the reconstructed nose is very different in front view.

abdallahdib commented 2 years ago

U may need to improve/add more facial landmarks to obtain an accurate fitting.