search

w3c / wcag-em-report-tool

Interactive Guide to Assist Managing Web Accessibility Evaluations
http://www.w3.org/WAI/eval/report-tool/
Other
77 stars 45 forks source link

Unable to open report in WCAG EM Report Tool #324

Closed jeeyyy closed 4 years ago

jeeyyy commented 4 years ago

Some manual assessments of a given ACT Rule were conducted using the WCAG EM Report Tool. Such assessments were later submitted as implementations to the ACT Rules community.

In order to conduct an assessment, we provide a WCAG EM Report compliant JSON data for each of the rules. For example - https://act-rules.github.io/rules/97a4e1#useful-links

image

An example can be found here - https://act-rules.github.io/testcases/97a4e1/rule-97a4e1-testcases-for-em-report-tool.json

These used to work fine, and several implementation reports were generated in the past.

It looks like since the 2.0.0 release we are running into an error, when trying to open a report. The error in question looks like below.

image

I tried to debug, but there are no logs or stack trace. Any help appreciated.

rvantonisse commented 4 years ago

Looking into this, thank you for reporting.

rvantonisse commented 4 years ago

Hey @jkodu ,

Some manual assessments of a given ACT Rule were conducted using the WCAG EM Report Tool.

The file you provided as example, https://act-rules.github.io/testcases/97a4e1/rule-97a4e1-testcases-for-em-report-tool.json, contains WCAG 2.1 asserted Assertions with test: WCAG2:WCAG2:<WCAG21_ID> where <WCAG21_ID> is replaced with the actual id. Also, what is causing the bug, the data has assertions put under the property auditResults. The tool itself exports assertions under auditResult. This data was not originally generated by the previous version of the reporter, but manually added after exporting from the previous version.

I would disencourage any modification of data if you want to be certain it will be opened by the reporter later.

I will close this issue since this is not a bug caused by the reporter but caused by manually modifying the reporter generated json.