Allow scraping of domains protected by Cloudflare IUAM

huntrar / scrape

a command-line web scraping tool

MIT License

149 stars 17 forks source link

Allow scraping of domains protected by Cloudflare IUAM #5

Open jobveldhuis opened 4 years ago

jobveldhuis commented 4 years ago

I am unsure if this is a requested feature, but I would love to have the possibility to scrape domains that are protected by Cloudflare's I am Under Attack-Mode. This could be done relatively quickly and in a reliable way, but I thought it was good to discuss the feature first before working on a PR.

Are you open to a PR for this feature?

huntrar commented 4 years ago

Yes, sounds like a value add to me.