facebookresearch / projectaria_eyetracking

Project Aria Social Eye Tracking Model
Apache License 2.0
25 stars 3 forks source link

eye tracking not accurate enough #2

Open geeve-research opened 6 days ago

geeve-research commented 6 days ago

i've written the following script using the social eye model, (running it real-time on my macbook air m2), the issue is it is not accurate enough for computer use (using eye tracking to control the computer cursor). i'm working on helping a paralyzed user use their computer using the aria glasses. so hope you could share some fix to improve the eye tracking accuracy enough to control a computer cursor with eyes. @amyreese my current calibration and testing script : https://github.com/geeve-research/ariatest/blob/main/calibration_eye.py

yusufmansour commented 5 days ago

what sort of accuracy are you getting after calibration? and how far off is it from what you need for you usecase?

what kind of errors are you observing? is it a bias or variance?

geeve-research commented 4 days ago

@yusufmansour it would be amazing if you could share any scripts that run this model in real-time using the camera stream from project aria.