search

AceCentre / EyeCommander

An open source computer vision interface that tracks eye movements for individuals with severely-limited mobility.
https://docs.acecentre.org.uk/eyecommander
MIT License
53 stars 6 forks source link

Consultation #95

Open damianlluch opened 6 months ago

damianlluch commented 6 months ago

Where can I use this technology? What are the commands? Any guide? I tried to open youtube with Chrome and I can only scroll down, and play-pass on a video. Thanks

gavinhenderson commented 6 months ago

Hey @damianlluch thanks for taking the time to checkout EyeCommander.

You can read the documentation on how it works and how to set it up here: https://docs.acecentre.org.uk/products/v/eyecommander/

Currently, we do not support Mac or Android. EyeCommander is built using electron, so in theory it can be modified to work on Mac but there is lots of windows specific code that would need reworking for it to run on Mac.

In terms of commands, on Windows it issues a 'keyboard press' when a blink is detected. You can configure which key it sends a press signal for. In theory you can then access any software that accepts a keypress. We provide explicit support for selected apps like NuVoice and Grid3. However, it should work on most AAC apps on Windows.

In regards to CBoard, yes it is compatible on Windows. CBoard allows you to setup scanning and accepts a keypress as a trigger. I have not tested it extensively but in theory it should work.

Also, here is a link to the latest release: https://github.com/AceCentre/EyeCommander/releases

willwade commented 6 months ago

I'll just add a addendum to this. The last build on mac is this. https://github.com/AceCentre/EyeCommander/releases/tag/v1.2.2 - it works - you need to download the dmg. Just note some of the bug fixes that @gavinhenderson fixed since this might still be in this build

One other thing re: Mac. I wouldn't use EyeCommander :) I would use the inbuilt gesture control. Its good and super efficient

System Settings -> Accessibility -> Pointer Control -> Alternative Pointer Actions. Then, choose a mouse action for your facial gesture. The only problem is CBoard only accepts keyboard keys. Someone needs to do a PR on that to accept mouse buttons.

damianlluch commented 6 months ago

I tried Cboard from a Mac, and I was able to play and scroll down just fine.

Regarding Eye Commander, I tried the old version that has the build, but as I mentioned, I was only able to do those two functions.