search

JimmyLaurent / cloudflare-scraper

A package to bypass Cloudflare's protection
MIT License
283 stars 30 forks source link

What exactly does this do? #3

Closed Aditya94A closed 4 years ago

Aditya94A commented 4 years ago

Can you please add some more details to the readme.

Puppeteer (chromium headless) is used to retrieve cloudflare cookies then request module is used to perform requests making this solution reliable but also pretty fast.

What are some use-cases? Is this a workaround for cloudflare detection?

JimmyLaurent commented 4 years ago

This is in early stage and actually more like a POC for now. I prefer to focus on code rather than documenting. That being said, the goal of this package is to help you scrape websites protected by cloudfare's IUAM (I'm Under Attack Mode) page. If you don't know this protection: it's a serie of javascript challenges to prove that you're not a bot. Here is a picture:

Aditya94A commented 4 years ago

Awesome! Looking forward to the future of this project! Would love to integrate it into my projects once it's ready 😁