w3c / aria-at-automation-driver

A WebSocket server which allows clients to observe the text enunciated by a screen reader and to simulate user input
Other
10 stars 6 forks source link

Safari stops responding during some jobs #52

Open jugglinmike opened 6 months ago

jugglinmike commented 6 months ago

In our early experimentation with automated results collection for VoiceOver and Safari, we've observed some cases where Safari becomes unresponsive and VoiceOver reports the following AT response for all subsequent tests:

Safari is not responding.

(example job in GitHub Actions)

We have elected to deploy the system despite these occasional failures because Test Admins can operate around them by requesting new collection jobs. Doing so also gives us a better opportunity to measure how often the problem occurs--a piece of information which should inform our prioritization for diagnosing and fixing the underlying problem.

ccanash commented 1 month ago

We were not able to reproduce this during flakiness testing, keeping it open as we continue working on this to see if it appears again