Improve Voiceover support

blinksh / blink

Blink Mobile Shell for iOS (Mosh based)

https://blink.sh

GNU General Public License v3.0

6.13k stars 570 forks source link

Improve Voiceover support #171

Open tyrylu opened 7 years ago

tyrylu commented 7 years ago

Hello. Currently, if you try to use blink with Voiceover, there are some issues:

The keyboard feedback is for some reasons disabled, e. g. no announcements of deleted letters, completed words etc.
You can not use Voiceover rotor commands to browse the text field by lines etc., you have to hear the entire (or visible?) content. You are almost there, connecting to a ssh host with Voiceover is doable, but for some serious work, it at least needs the text control reading fixed, the keyboard can be next. Experienced on Ios 10.1 on an Iphone 6 with the latest app store release. I would much like to help further, but unfortunately i have no Mac os development machine.

carloscabanero commented 7 years ago

Thanks Tyrylu, reading it line by line definitely is the next step to take. For some reason that is working on the desktop but not on the iPad, I will add this to the next iteration. :)

tyrylu commented 7 years ago

Hello, it's good that you could reproduce it and will fix it.

mikeiit commented 7 years ago

Hey guys,

This is Mike. Hope you guys had a good day so far. I saw this project here and I am interested to know more about it and see if I can possibly contribute to it.

I'm an entry level developer in a startup here in Chicago. I have done some development as well as testing. Please let me know if we can have a talk next week and see if there is a chance for us to work on the project together. Thank you.

Mike

carloscabanero commented 7 years ago

Leaving this here for reference: https://developer.apple.com/library/content/technotes/TestingAccessibilityOfiOSApps/TestAccessibilityiniOSSimulatorwithAccessibilityInspector/TestAccessibilityiniOSSimulatorwithAccessibilityInspector.html

carloscabanero commented 7 years ago

Hi Mike! Thanks for your interest in Blink! Would be great to see ways we can collaborate. Please send me a DM @BlinkShell on Twitter to discuss. :)

yury commented 4 years ago

We improved voice over support with our new smart keys keyboard. @mikeiit, @tyrylu we pushed public Test Flight version. Is possible you to try it out?

tyrylu commented 4 years ago

Definitely, if you can send the invite to lukastyrychtr@gmail.com.

yury commented 4 years ago

@tyrylu sent you invite. One note: It requires iOS/iPadOS 13

tyrylu commented 4 years ago

Ach... That might be a problem, i'll have to wait until i get something newer than my IPhone 6 then... :-)

tyrylu commented 4 years ago

I finally got a chance to test the latest beta. The support is quite good, however there are some issues.

The Voiceover braille input does not work for some reason (it appears as if it would like to move through some webpage elements list or something like that)
The Input field loses VoiceOver focus
New output from the remote side does not show until the input text field is reactivated
It would be really useful if the new output could be spoken by Vo

yury commented 4 years ago

It should spoke output, I will look. Thank you!

yury commented 4 years ago

Quick question. Did you have VO turned on before starting blink or creating new shell?

tyrylu commented 4 years ago

Yes, of course.

demhademha commented 3 years ago

Is there an update on this issue