search

AceCentre / EyeCommander

An open source computer vision interface that tracks eye movements for individuals with severely-limited mobility.
https://docs.acecentre.org.uk/eyecommander
MIT License
53 stars 4 forks source link

Add 'Bluetooth Device' as an output option #27

Open willwade opened 2 years ago

willwade commented 2 years ago

We would like our clients who use iOS devices to be able to use EyeCommander.

We can achieve this by adding the ability to output as a Bluetooth Device from EyeCommander.

To do this we might have to rely on a second piece of hardware if we cannot create a bluetooth device output from a windows machine.

gavinhenderson commented 2 years ago

I haven't looked into it but I reckon your right there is probably no software API to trigger software switches. I also think you cant access the camera in the background so thats definitely a non starter.

Can we plug a camera into X80?

willwade commented 2 years ago

Simple answer - nope re x80. It's an arduino stack and doesn't play well with cameras.

willwade commented 2 years ago

One idea. The mediapipe part of this would be doable to make this run on anything (https://mediapipe.dev) so you could in theory create an app on mobile that would do this then send BLE HID keys to any other device. So run it on your phone - send to windows or another iOS device. Downside - keeping app running when asleep and power drain.

willwade commented 2 years ago

Ive supported Nick and the EarSwitch to do something similar - This is my example code to run on a nrf52840 Arduino and some server side code - all in python/CircuitPy - but easily doable in Node https://gist.github.com/willwade/ff4ad61fcef409c182db303e6133e5d4

gavinhenderson commented 2 years ago

We could potentially even do this on the electron client side using WebBluetooth which would make it super portable. Might have limitations but it is worth a shot