1j01 / tracky-mouse

Mouse control via head tracking, as a cross platform desktop app and JS library. eViacam alternative.
https://trackymouse.js.org/
MIT License
27 stars 5 forks source link

Trigger click action with mouth gesture (smiling or opening mouth) #25

Open 1j01 opened 2 years ago

1j01 commented 2 years ago

Currently the app supports dwell clicking (hovering in one spot long enough to trigger a click), but a gesture would be faster.

There is already the facemesh library included for detecting the pose of the user's face, and whilst it doesn't look like it handles eye or eyebrow movements well enough, I think detecting a smile or open mouth should work fine. It might cause accidental clicks sometimes though when it loses proper tracking of the face, we'll have to see if that's a problem.

You should still have the option of using dwell clicking. See https://github.com/1j01/tracky-mouse/issues/1 for support for clicking by blinking.