w3c / at-driver

AT Driver defines a protocol for introspection and remote control of assistive technology software, using a bidirectional communication channel.
https://w3c.github.io/at-driver
Other
33 stars 4 forks source link

SafariDriver, Key Presses & Glass Panes #75

Open lolaodelola opened 6 months ago

lolaodelola commented 6 months ago

A SafariDriver-managed Safari session rejects external interaction, however in order for the AT-Driver protocol to perform actions like a user does (whether via simulated key presses or via higher-level "user intentions"), the glass pane may need to be "selectively permeable".

Background

As a security mechanism, Safari installs a transparent “glass pane” over the automation windows while the browser is being used for WebDriver testing. This pane catches any stray interactions (mouse, keyboard, resizing, and so on) that could affect the automation window. If a running test gets stuck, you can interrupt it by “breaking” the glass pane and stopping the session. When an automation session is interrupted, the test’s connection to the browser is permanently severed, and the automation window remains open for further inspection, until closed manually.

sadym-chromium commented 6 months ago

Minutes from WebDriver BiDi WG 2024-05-08: https://www.w3.org/2024/05/08-webdriver-minutes.html#t04