KoalaBear84 / OpenDirectoryDownloader

Indexes open directories
GNU General Public License v3.0
1.07k stars 86 forks source link

ways to bypass Cloudflare #138

Open UtopiaCloud opened 7 months ago

UtopiaCloud commented 7 months ago

I developed some crawlers couple months ago, where i faced on the cloudflare issue. I found two ways. I never had problems with cloudflare again (until now).

Hope it's useful. I like your project. would contribute, if i had the time. (maybe in the future) cheers.

KoalaBear84 commented 7 months ago

Hi @UtopiaCloud

Thanks for your info!

Didn't knew FlareSolverrSharp. I'll try to look into it if it can be an alternative and less 'invasive' solution next to running a complete browser 😅