search

pa11y / pa11y-ci

Pa11y CI is a CI-centric accessibility test runner, built using Pa11y
https://pa11y.org
GNU Lesser General Public License v3.0
519 stars 63 forks source link

Failed Test Not Being Triggering During CicleCI Process? #136

Closed pihish closed 3 years ago

pihish commented 3 years ago

Currently using the following commands under the jobs:test subtree in my CircleCI config.yaml:

steps:
      - checkout
      - run: npm install
      - run: |
          set -e
          npm run test

My pa11y CI tests run with npm run test. Failed tests does not fail my CircleCI build. I think the reason for this is that Pa11y CI does not end its process prematurely just because there is a failed test (it keeps on testing until it tests every page).

I added set -e per this CircleCI post. But it doesn't seem to make a difference.

How do I get CircleCI to fail when Pa11y fails?