search

C-Loftus / sight-free-talon

Integrate Talon voice dictation commands with TTS, screen readers, braille, and more!
http://colton.place/sight-free-talon/
GNU General Public License v3.0
16 stars 2 forks source link

Integrate with Cursorless #13

Open C-Loftus opened 11 months ago

C-Loftus commented 11 months ago

Lots of potential for using cursorless to intelligently navigate around vscode when coding. Blocked until cursorless keyboard mode is done since the api doesn't expose everything at the moment. Investigate using a pedal as well

We can essentially use the tree structure as a way to intelligently interact with the editor better than a typical screen reader.

C-Loftus commented 11 months ago

It would be interesting to get the perspective of someone who uses braille very efficiently, and if it is possible to create specialized braille contractions based on the context. If that is the case, it might be possible to contract both the letter and the color of the hat in someway so as to make it more efficient instead of just having a screen reader, read off the text.

That being said, this might require a particularly heavy cognitive load to have both custom braille contractions, the talon alphabet with cursorless commands as well as doing the actual coding.

That being said, there are a lot of interesting design opportunities to explore and ways to rethink how we can apply techniques from voice coding to situations where visual stimuli is limited

zersiax commented 9 months ago

I can help you there, I use braille on a daily basis to get coding done. Just lmk what is needed :)