search

elucideye / drishti

Real time eye tracking for embedded and mobile devices.
BSD 3-Clause "New" or "Revised" License
387 stars 82 forks source link

Generate gaze training data? #479

Open headupinclouds opened 6 years ago

headupinclouds commented 6 years ago

https://news.developer.nvidia.com/ai-generated-faces-track-your-movements/

headupinclouds commented 6 years ago

322

headupinclouds commented 6 years ago

This package could potentially provide unlimited training data:

https://github.com/wayaai/SimGAN

Implementation of Apple's Learning from Simulated and Unsupervised Images through Adversarial Training

Also...

https://www.kaggle.com/4quant/eye-gaze/version/1

End-to-end: https://www.mpi-inf.mpg.de/departments/computer-vision-and-multimodal-computing/research/gaze-based-human-computer-interaction/appearance-based-gaze-estimation-in-the-wild-mpiigaze/

Collection Procedure

We implemented custom software running as a background service on participants’ laptops. Every 10 minutes the software automatically asked participants to look at a random sequence of 20 on-screen positions (a recording session), visualized as a grey circle shrinking in size and with a white dot in the middle. Participants were asked to fixate on these dots and confirm each by pressing the spacebar once the circle was about to disappear. This was to ensure participants concentrated on the task and fixated exactly at the intended on-screen positions. No other instructions were given to them, in particular no constraints as to how and where to use their laptops.

Collection software similar to this :point_up: (but for mobile devices) will likely be needed for true mobile gaze tracking.

headupinclouds commented 6 years ago

Rendering of Eyes for Eye-Shape Registration and Gaze Estimation http://arxiv.org/pdf/1505.05916.pdf