search

rahulisola / BrickseekScraper

Personal (non-regularly-maintained) repo for scrapping Brickseek data.
1 stars 1 forks source link

not working #4

Open mymy59 opened 1 year ago

mymy59 commented 1 year ago

with homedepot cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 Captcha challenge, This feature is not available in the opensource (free) version.

rahulisola commented 1 year ago

Unfortunately this is a security update from Cloudflare side and it is dependent on the client which captcha they get.

I'm still getting the Cloudflare v1 captcha, so can't reproduce it as the cloudscraper library is able to bypass that for free.

I can probably build a solution that uses either Selenium or ScrapingAnt (free version allows for up to 10k scrapes / month I think), but it'll need more setup and/or registering for a free plan on their website. Let me know if you want me to look into that.