liip / TheA11yMachine

The A11y Machine is an automated accessibility testing tool which crawls and tests pages of any web application to produce detailed reports.
https://www.liip.ch/
621 stars 66 forks source link

Added option to ignore robots.txt #97

Closed Gayoushie closed 7 years ago

Gayoushie commented 7 years ago

Added option to bypass robots.txt file, so that the tool can be used to team servers, where all urls are disallowed by robots.txt file.

Hywan commented 7 years ago

Hello,

Nice contribution, thanks! But what do you mean by “be used to team servers”?

Gayoushie commented 7 years ago

Hi. While trying to use the A11yMachine we came across this problem... we have a production site, on which it worked perfectly, but we wanted to test our other servers (which we call team servers): dev, QA, stage, etc. Our site goes through different stages before it can go live, and we would like to test for accessibility before things go to production. And all our servers, except for production, have robots.txt with all pages disallowed. I think this is a common practice with many companies.

Hope I clarified your question.

Thanks, Gayane

On Mar 3, 2017, at 12:06 AM, Ivan Enderlin notifications@github.com wrote:

Hello,

Nice contribution, thanks! But what do you mean by “be used to team servers”?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.

Hywan commented 7 years ago

@Gayoushie Yes it is!

Gayoushie commented 7 years ago

hi @Hywan, per your request i renamed the option to --ignore-robots-txt.

Hywan commented 7 years ago

Thanks! We will take a look at it as soon as possible!