Feature Request - Accessibility - On-Screen Keyboard (OSK)

Fr3nzy-029 commented 2 months ago

Issue Description

The default OSK in GNOME and many other Desktop Environments are docked to the bottom of the screen and take up a lot of space in screen. The OSK is made to auto show/auto hide when clicking in/out of text fields. This workflow is not suitable for accessibility. Also they don't have the option for full keyboard layout with modifier keys like ctrl, alt, super, esc, etc. and function keys.

Requested Features

Option to use OSK as a floating window (with window decoration) that can be resized by mouse (at window corners/edges). This window is always visible and can be kept always on top of other windows.
Option to use full keyboard layout with modifier and function keys.
Clicking on modifier key to latch and then lock it (for using keyboard shortcuts like copy, paste).
Applying themes on OSK.
Optional Request : Suggestions for word auto complete while typing.

Reference

I am currently using a tool called Onboard (built for XOrg). It is used in Linux Mint by default. The above requested features are all available in Onboard and its model is so far the best for accessibility. Please consider its model for Cosmic OSK. The floating window OSK model is also used by Windows 10 & 11, so you can plan from its design too. Also check out GJS OSK GNOME extension for a reference too.

Personal Description

For the past 3 years I have been affected by gradually increasing motor impairment. I am unable to use the keyboard and so I only use the mouse and OSK.

Fr3nzy-029 commented 2 months ago

In addition to above request, please consider developing Cosmic OSK as a separate and standalone app if possible. This will be helpful for accessibility and touch screen users in linux across various distros and desktop environments. There is no good OSK in Wayland and XOrg (except maybe Onboard) for accessibility users.

Fr3nzy-029 commented 2 months ago

@mmstick I saw that the accessibility feature design is a work in progress. I don't know if the team has noticed this request. Kindly share this request to the team designing accessibility and I hope they can consider this.

leviport commented 2 months ago

@Fr3nzy-029 We read all issues and requests. This one did not escape our notice.

pop-os / cosmic-epoch