techwithtim / AI-Web-Scraper

An AI web scraper using ollama, brightdata, selenium and other libraries.
257 stars 110 forks source link

Understanding Captcha Solver #8

Open BrianMosbeux opened 3 weeks ago

BrianMosbeux commented 3 weeks ago

Hi,

Can someone help me understand what is the purpose/usage of the capthca solver?

# In scrape.py > scrape_website() function
driver.execute('executeCdpCommand', {
            'cmd': 'Captcha.waitForSolve',
            'params': {'detectTimeout': 10 * 1000},
        })?

In bright data documentation it says:

By default, as part of our full proxy unblocking solution, Scraping Browser also solves CAPTCHAs that are encountered while returning your proxy request. https://docs.brightdata.com/scraping-automation/scraping-browser/features/captcha-solver

So why is it still needed?

Thanks in advance for your help!

fukemy commented 3 weeks ago

same question here