search

pa11y / pa11y-dashboard

Pa11y Dashboard is a web interface which helps you monitor the accessibility of your websites
https://pa11y.org
GNU General Public License v3.0
984 stars 181 forks source link

The tests for "WCAG2AAA" don't include some results from "WCAG2AA" tests #274

Closed karkachev closed 3 years ago

karkachev commented 3 years ago

I'm a developer of a web accessibility testing tool that use the pa11y-webservice app. And durring the development I found a bug in tests for "WCAG2AAA". These results don't include some errors which return tests for "WCAG2AA".

I checked this bug in Pa11y Dashboard app and got the same issue.

I made a test for four dozen sites and see the issue is repeating on all of them. Any of these tests doesn't include any issue of the "error" type from the "AA" level.

Here's an example made in the Pa11y Dashboard app: Test for "WCAG2AA" Test for "WCAG2AAA" You can see that the "Principle1.Guideline1_4.1_4_3.G18.Fail" issue (error of AA level) from the first test, doesn't appear in the second test - https://prnt.sc/10rhagd

And the same tests on our tool: Test for "WCAG2AA" Test for "WCAG2AAA"

sangitamane commented 3 years ago

This does not seem to be an issue. I checked your example and some more with the Pa11y dashboard and the errors shown in WCAG2AA test (WCAG2AA.Principle1.Guideline1_4.1_4_3.G18.Fail) are also present in WCAG2AAA test (WCAG2AAA.Principle1.Guideline1_4.1_4_6.G17.Fail). Please let us know more details if you face the same issue.

sangitamane commented 3 years ago

Closing this issue but please feel free to reopen it if you still face a problem