search

yfeng95 / face3d

Python tools for 3D face: 3DMM, Mesh processing(transform, camera, light, render), 3D face representations.
2.68k stars 614 forks source link

3dmm fitting result does not look like the input image #73

Closed zengxianyu closed 3 years ago

zengxianyu commented 4 years ago

The input image with landmarks: bfm

and the result is not good.

Screen Shot 2020-08-12 at 12 08 22 PM Screen Shot 2020-08-12 at 12 08 11 PM

Is this caused by fitting the 3dmm model using 2d landmark or BFM not working well for Asian faces?

sublimationAC commented 4 years ago

I suppose the texture on the ears is from the color of the wall, based on the image.

zengxianyu commented 4 years ago

I suppose the texture on the ears is from the color of the wall, based on the image.

The color is copied from the image and basically makes sense, but the shape is not correct (e.g., the nose and mouth

sublimationAC commented 4 years ago

I suppose the texture on the ears is from the color of the wall, based on the image.

The color is copied from the image and basically makes sense, but the shape is not correct (e.g., the nose and mouth

Ok, I get what u mean now. Ur inference is correct. Due to the sparse landmark constrain, we cannot fit the shape of the nose. However, I guess u can try to use texture to help the algorithm fit it.

essebbaninaim commented 3 years ago

Hi,

Sorry to bother you but im new with python tools.

I try to generate a 3DMM from a picture.

Can you pls share the code u used to make the render. That will help me a lot !

Thanks in advance !

fisakhan commented 3 years ago

@zengxianyu How did you do that? How can I input my 2D image and generate its 3D model?

zengxianyu commented 3 years ago

https://github.com/ascust/3DMM-Fitting-Pytorch this repo works better for fitting to 2D images

fisakhan commented 3 years ago

https://github.com/ascust/3DMM-Fitting-Pytorch this repo works better for fitting to 2D images

@zengxianyu Thank you.

Zenway-Wong commented 2 years ago

Hello, could you please share how you got the final 3D model from image? How did you get the texture, expression and shape parameter for BFM.

I go through the code and just find the function to fit the 68 key points (not image!) and return expression and shape parameter.