search

w3c / aria-at

Assistive Technology ARIA Experience Assessment
https://aria-at.netlify.app
Other
154 stars 28 forks source link

Conflicting results for test 2 "Navigate backwards to a collapsed disclosure button" (Disclosure Navigation Menu Example, V24.07.31) #1099

Closed tactics2 closed 3 weeks ago

tactics2 commented 3 months ago

Description of Behavior

Test Setup

Review Conflicts for "Navigate backwards to a collapsed disclosure button"

  1. Unexpected Behaviors for "Shift+j (quick nav on)" Command

    • Tester tactics2 recorded output "academics collapsed button" and noted no unexpected behavior.
    • Tester IsaDC recorded output " Run Test Setup dimmed button You are currently on a button. This item is dimmed." and noted "Reading cursor position changed in an unexpected manner (Details: Cursor moved to the wrong control., Impact: SEVERE)".

  2. Assertion Results for "Shift+j (quick nav on)" Command and "Role 'button' is conveyed" Assertion

    • Tester tactics2 recorded output "academics collapsed button" and marked assertion as passing.
    • Tester IsaDC recorded output " Run Test Setup dimmed button You are currently on a button. This item is dimmed." and marked assertion as failing.

  3. Assertion Results for "Shift+j (quick nav on)" Command and "Name of the button, 'Academics', is conveyed" Assertion

    • Tester tactics2 recorded output "academics collapsed button" and marked assertion as passing.
    • Tester IsaDC recorded output " Run Test Setup dimmed button You are currently on a button. This item is dimmed." and marked assertion as failing.

  4. Assertion Results for "Shift+j (quick nav on)" Command and "State 'collapsed' is conveyed" Assertion

    • Tester tactics2 recorded output "academics collapsed button" and marked assertion as passing.
    • Tester IsaDC recorded output " Run Test Setup dimmed button You are currently on a button. This item is dimmed." and marked assertion as failing.

it appears IsaDC was not reloading the test page after each test, which is why the test button is reported as being dimmed. My results are accurate. I have triple checked them.

IsaDC commented 3 weeks ago

Closing this issue as the test plan is being rerun from scratch.