search

IBMa / equal-access

IBM Equal Access Accessibility Checker contains tools to automate accessibility checking from a browser or in a continuous development/build environment
https://www.ibm.com/able/toolkit/tools#develop
Apache License 2.0
633 stars 83 forks source link

ACT Mapping: map ACT rules against Checker #982

Closed philljenkins closed 2 years ago

philljenkins commented 2 years ago
philljenkins commented 2 years ago

The Rule Tracker tab in the worksheet lists all rules currently tracked through their lifecycle by the ACT Task Force.

ACT rules check spreadsheet

Each rule has a status. as of 6-17-2022 These include:

Count | Status | Description -- | -- | -- 5 | Update needed | An issue blocks the rule from being a proposed rule. 2 | Surveying | Part of an survey, either in progress or under discussion 4 | Survey Ready | Implemented, and with no open issues 1 | Ready for CFC | Agreed on during a call, but requires wider approval from the ACT Task Force 3 | Ready for AG | Approved by ACT, ready for AG to review 14 | Published | The rule has been published as an approved rule. It must be accepted by AG first. 57 | Proposed | The rule has been copied to the wcag-act-rules github repository 1 | Waiting for atomic | Approved composite rule, but with atomic rules not yet approved 4 | Deprecated | This rule is no longer supported

This Sprint's mapping (this issue) will cover the following 21 rules: 1 Readyfor CFC 2 Ready for AG 14 Published 4 Deprecated

philljenkins commented 2 years ago

The Implementation Report results were generated by using the ACT test driver against each production build of the Equal Access Accessibility Checker (IBM Accessibility) relevant rules with options set to use the "Preview" ruleset and "IBM Accessibility" guidelines.

Implementation report of Equal Access Accessibility Checker (IBM Accessibility) https://act-rules.github.io/implementation/equal-access-accessibility-checker

philljenkins commented 2 years ago

Some examples of inconsistency between ACT test case expected results and Checker results:

ACT Rule | ACT Test Case | Expected | Checker Results | Checker RuleID -- | -- | -- | -- | -- [ARIA required context role](https://act-rules.github.io/rules/ff89c9) | [Failed Example 3](https://act-rules.github.io/rules/ff89c9/#failed-example-3) | failed | passed | [Rpt_Aria_RequiredParent_Native_Host_Sematics](https://github.com/IBMa/equal-access/blob/master/accessibility-checker-engine/src/v4/rules/Rpt_Aria_RequiredParent_Native_Host_Sematics.ts) [ARIA required owned elements](https://act-rules.github.io/rules/bc4a75) | [Failed Example 3](https://act-rules.github.io/rules/bc4a75/#failed-example-3) | failed | passed | [Rpt_Aria_RequiredChildren_Native_Host_Sematics](https://github.com/IBMa/equal-access/blob/master/accessibility-checker-engine/src/v4/rules/Rpt_Aria_RequiredChildren_Native_Host_Sematics.ts) [Element with aria-hidden has no content in sequential focus navigation](https://act-rules.github.io/rules/6cfa84) | [Passed Example 4](https://act-rules.github.io/rules/6cfa84/#passed-example-4) | passed | untested | [aria_hidden_focus_misuse](https://github.com/IBMa/equal-access/blob/master/accessibility-checker-engine/src/v4/rules/aria_hidden_focus_misuse.ts)
philljenkins commented 2 years ago

Was blocked by #984

philljenkins commented 2 years ago

ACT's new draft website is at https://deploy-preview-104--wai-wcag-act-rules.netlify.app/standards-guidelines/act/implementations/ and https://www.w3.org/WAI/standards-guidelines/act/implementations/

marcjohlic commented 2 years ago

Phill to check update from Tom (url) to see if that unblocks

tombrunet commented 2 years ago

Update: https://wai-wcag-act-rules.netlify.app/standards-guidelines/act/implementations/equal-access/ (Phill added below)

Implementation Summary

June 23, 2022: Equal Access Accessibility Checker version 3.1.33-rc is an Automated tool by IBM Accessibility. This ACT implementation tests for WCAG 2.1 Level A, AA, and WAI-ARIA 1.2.

Number of ACT Rules Implemented by the Checker

Rules | Consistent | Partially Consistent -- | -- | -- WCAG 2 rules | 2 | 9 Proposed rules | 4 | 7

(See link above for full report)

tombrunet commented 2 years ago

For comparison, AXE results: https://wai-wcag-act-rules.netlify.app/standards-guidelines/act/implementations/axe-core/ (Phill added below)

Implementation Summary

June 23, 2022: Axe-core version 4.5.0-prerelease is an Automated tool by Deque Systems. This ACT implementation tests for WCAG 2.1 Level A, AA, AAA, and WAI-ARIA 1.2.

Number of ACT Rules Implemented by AXE-core

Rules | Consistent | Partially Consistent -- | -- | -- WCAG 2 rules | 12 | 2 Proposed rules | 9 | 15

(See link above for full report)

philljenkins commented 2 years ago

@tombrunet Completed the ACT/Checker mapping for which Requirement is being reported against: See Checker_ACT_Mapping 2022-06-23.xlsx (see column H cells highlighted in yellow for which Checker rules need changing) (see column I cells highlighted in orange for which ACT rules need mapping changes)

In summary, the following six Checker rules need mapping changes for which Requirement is being reported:

  1. WCAG20_Input_ExplicitLabel.ts
  2. WCAG20_Elem_Lang_Valid.ts
  3. HAAC_Aria_ImgAlt.ts
  4. HAAC_Aria_SvgAlt.ts
  5. WCAG20_Frame_HasTitle.ts
  6. meta_viewport_zoom.ts

image

MHoov commented 2 years ago

@philljenkins this issue hasn't been updated in 21 days. @marcjohlic FYI

philljenkins commented 2 years ago

Analysis reported to SME council July 21. Opening new issues as documented in issue description above.

philljenkins commented 2 years ago

Will add related issues here in comments if they do not show up in the description above.

philljenkins commented 2 years ago

Opened issues for follow-on work to improve mapping and failure examples