Pa11y Not Running in GH Actions

btylerburton commented 1 year ago

Datagov would like to run pa11y-ci on the pages in our repo, but pa11y-ci is failing silently.

How to reproduce

Run tests in https://github.com/GSA/datagov-11ty repo.

Expected behavior

I expect to see a report of all the URLs and their issues, see example below.

Actual behavior

The pa11y report fails silently.

Sketch

[ ] Build off pa11y-debug branch. Contains updated NPM script and patch to pa11y-ci needed to expose the runtime error.
[ ] Explore the options related to running pa11y-ci in a Docker container

nickumia-reisys commented 1 year ago

Is this the failing silently message?

Running Pa11y on 153 URLs:
Running Pa11y on URL https://data.gov/privacy-policy/
Using a pre-configured Headless Chrome instance, the `chromeLaunchConfig` option will be ignored
 > https://data.gov/privacy-policy/ - Failed to run >> TimeoutError: Pa11y timed out (60000ms)

btylerburton commented 1 year ago

@nickumia-reisys yes. without the patch all we were getting was Failed to run. My guess is it's a missing puppetteer dependency.

hkdctol commented 11 months ago

Moving to icebox for the time being.

GSA / data.gov