search

face3d0725 / weak_UV

Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction
MIT License
29 stars 3 forks source link

What happens if the face has harsh shadow #1

Open Michaelwhite34 opened 3 years ago

Michaelwhite34 commented 3 years ago

Assume the face is in front view, one side has natural lighting,other side has harsh shadow.Will the shadow be removed after the reconstruction?

face3d0725 commented 3 years ago

Assume the face is in front view, one side has natural lighting,other side has harsh shadow.Will the shadow be removed after the reconstruction?

Unfortunately, this is not guaranteed. If the shadows are very severe, the face segmentation module will simply remove them and the resulting UV map will not contain them, while if the shadows are not severe, they will be retained.

Michaelwhite34 commented 3 years ago

Assume the face is in front view, one side has natural lighting,other side has harsh shadow.Will the shadow be removed after the reconstruction?

Unfortunately, this is not guaranteed. If the shadows are very severe, the face segmentation module will simply remove them and the resulting UV map will not contain them, while if the shadows are not severe, they will be retained.

By "retained" do you mean the shadow part will be on the final UV map as it is or become "normal" texture as the other part of the face ? (I want to add addtional inpainting mask to the shadow part which I feel has natural lighting,is that possible ?)

face3d0725 commented 3 years ago

Assume the face is in front view, one side has natural lighting,other side has harsh shadow.Will the shadow be removed after the reconstruction?

Unfortunately, this is not guaranteed. If the shadows are very severe, the face segmentation module will simply remove them and the resulting UV map will not contain them, while if the shadows are not severe, they will be retained.

By "retained" do you mean the shadow part will be on the final UV map as it is or become "normal" texture as the other part of the face ? (I want to add addtional inpainting mask to the shadow part which I feel has natural lighting,is that possible ?)

If the shadow is not considered as an occlusion by the segmentation module, it will be kept on the final UV map, otherwise it will be removed and the final UV map will be filled with "normal" textures as other part of the face. If you want to edit the shadow parts, you could manually mask it out in the beginning (on the input face image).