search

emilianavt / OpenSeeFace

Robust realtime face and facial landmark tracking on CPU with Unity integration
BSD 2-Clause "Simplified" License
1.46k stars 152 forks source link

Eye Tracking for mouse Cursor controlling. #73

Open Chris2000SP opened 3 months ago

Chris2000SP commented 3 months ago

Hello, i found this Software in the context of VTubing. But i saw that it can be used to track eyes.

My Goal: I have a friend who has medically limited freedom of movement and he wants to use Linux. I thought if that Tracking is that good, it can be used to track the eye movement for the cursor by using this software.

But i know that something is missing to do so: by using openseeface, using other software to calibrate it for mouse cursor if OSF do not have it.

Can you please answer if it would be possible to control the mouse by eye tracking with OSF?

Thanks.

emilianavt commented 3 months ago

I honestly think the eye tracking is not that good. Controlling amouse cursor with it would probably be quite painful, but maybe it would still be better than nothing.

However, there is no built-in support for controlling the mouse cursor. You could try either modifying the tracker code directly (e.g. in facetracker.py), or read the tracking results from the UDP packets that OSF can send in another application.