search

davisking / dlib

A toolkit for making real world machine learning and data analysis applications in C++
http://dlib.net
Boost Software License 1.0
13.54k stars 3.37k forks source link

Gaze Estimation Support #825

Open arasharchor opened 7 years ago

arasharchor commented 7 years ago

As now there is a sample head position estimation and face landmark detection, I was wondering is there any plan to add gaze estimation module to Dlib library?

following repositories can be useful to do so: https://github.com/mpatacchiola/deepgaze https://github.com/opengazer/OpenGazer

davisking commented 7 years ago

I'm not going to do it. But maybe someone will contribute :)

e-fominov commented 7 years ago

@smajida , why not use shape_predictor for it? you simply need to have about 1000 images with human eyes, with pupil size about 3-10 pixels and train the model with the code from examples directory

arasharchor commented 7 years ago

@e-fominov good idea. Do you know a sample dataset for this? I found this https://www.mpi-inf.mpg.de/departments/computer-vision-and-multimodal-computing/research/gaze-based-human-computer-interaction/appearance-based-gaze-estimation-in-the-wild-mpiigaze/

and this one

http://www.cs.columbia.edu/CAVE/databases/columbia_gaze/

I will take a look inside these two datasets

TimSC commented 11 months ago

The shape_predictor_68_face_landmarks.dat model includes pupil positions. I'm not sure how accurate it is.