phillco / talon-axkit

Talon macOS accessibility magic!
MIT License
45 stars 12 forks source link

custom accessibility inspector #12

Open phillco opened 2 years ago

phillco commented 2 years ago

MacOS includes an app called the Accessibility Inspector, which we frequently use during development:

Screen Shot 2022-03-27 at 2 41 11 PM

The most useful feature is that you can click the "crosshair" button and then hover over a certain element in a different app to see its attributes.

While the inspector is nice, it has a few weaknesses:

Thanks to the new ui.element_at() recently added to talon by aegis, we could build a replacement using Canvas. It could serve as a semitransparent sidebar that could be dragged anywhere and toggled on/off as necessary. It could also draw borders around the focused element and/or elements under the mouse.

nriley commented 3 months ago

68 implements a simple version of this by outputting information to the log. Still plenty of room for improvement!