search

TadasBaltrusaitis / OpenFace

OpenFace – a state-of-the art tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.
Other
6.69k stars 1.82k forks source link

Eye gaze tracking #306

Open merghaney opened 6 years ago

merghaney commented 6 years ago

Hi , I'm trying to get the gaze values for a close image for the eye (an eye patch) and I used the commands but I do get the values for the all face image, not for the eye patch I pass it. Does this functionality exist in the code or I have to use the all face image?

TadasBaltrusaitis commented 6 years ago

Hi,

OpenFace only supports full face images and will not work on just close up images of eyes.

Thanks, Tadas

merghaney commented 6 years ago

Hi,

Thanks a lot for your response, if it’s not annoying can you tell me is there is a way to make it run on eye patch images? And if it not would you share some links where I can find it.

Best Regards Merghaney

On Fri, Dec 22, 2017 at 12:26 Tadas Baltrusaitis notifications@github.com wrote:

Hi,

OpenFace only supports full face images and will not work on just close up images of eyes.

Thanks, Tadas

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/TadasBaltrusaitis/OpenFace/issues/306#issuecomment-353569692, or mute the thread https://github.com/notifications/unsubscribe-auth/AUA39h3Sn_zTw7CA71sXIK9vpx0B_MJWks5tC4PogaJpZM4RFboJ .

-- Best Regards Merghaney

TadasBaltrusaitis commented 6 years ago

You would need to have a specialised eye region detector (for left and right eyes), and it would need to be modified to provide a tight region around the 28 eye region landmarks being detected, then you would need to modify the model files to just detect the eye region landmarks.

This would require a fairly involved modification of the C++ or Matlab landmark detection codes.

You could have a look at the 'matlab_version\demo\face_image_demo_eyes.m` script to see how the eye region model is being initialised from the rest of the facial landmarks

Thanks, Tadas

merghaney commented 6 years ago

Thanks a lot. If it’s OK with you I will ask you once and a while about it.

Thanks again, Merghaney

On Fri, Dec 22, 2017 at 21:40 Tadas Baltrusaitis notifications@github.com wrote:

You would need to have a specialised eye region detector (for left and right eyes), and it would need to be modified to provide a tight region around the 28 eye region landmarks being detected, then you would need to modify the model files to just detect the eye region landmarks.

This would require a fairly involved modification of the C++ or Matlab landmark detection codes.

Thanks, Tadas

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/TadasBaltrusaitis/OpenFace/issues/306#issuecomment-353662984, or mute the thread https://github.com/notifications/unsubscribe-auth/AUA39mr9bBE3wVzNUMCh9GEG8VI7qQ7gks5tDAW0gaJpZM4RFboJ .

-- Best Regards Merghaney