cleardusk / 3DDFA

The PyTorch improved version of TPAMI 2017 paper: Face Alignment in Full Pose Range: A 3D Total Solution.
MIT License
3.61k stars 653 forks source link

Can I use infrared images as input? #198

Open lawo123 opened 3 years ago

lawo123 commented 3 years ago

Can I use infrared images as input? @liguohao96

cleardusk commented 3 years ago

Near or far-infrared image?

lawo123 commented 3 years ago

Near or far-infrared image?

near-infrared image

lyyiangang commented 3 years ago

this 3d face landmark detector also work on near infrared image, I am working on this topic. But it not works as good as on RGB image.

lawo123 commented 3 years ago

this 3d face landmark detector also work on near infrared image, I am working on this topic. But it not works as good as on RGB image.

thank you very much

Arios42 commented 2 years ago

I try to implement this facial landmark detector on NIR images, but I receive poor results. Even though I retrain the model by using the gray images, the results are not satisfying. How do you implement this 3D facial landmark detector on NIR images?

this 3d face landmark detector also work on near infrared image, I am working on this topic. But it not works as good as on RGB image.

lyyiangang commented 2 years ago

NIR image is not simple gray img. If you want improve performance on NIR img, you nedd collect some NIR face img and label them, and fine tune the 3d face model.