ultrafunkamsterdam / undetected-chromedriver

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
https://github.com/UltrafunkAmsterdam/undetected-chromedriver
GNU General Public License v3.0
9.56k stars 1.14k forks source link

The site is not loading steamdb.info #1720

Open ShiGhost opened 8 months ago

ShiGhost commented 8 months ago

Hello. I'm trying to use undetected-chromedriver to bypass cloudflare, but in the end the site doesn't load - https://steamdb.info/sub/363669/apps / , screenshots are attached. Also, after several page updates, it loads, I click on the cloudflare checkbox, it thinks and the page with the same checkbox is reloaded, it does not skip further. Everything works through a regular browser.

Screenshot

ShiGhost commented 8 months ago

Hi, to help you bypass Cloudflare-protected websites like https://steamdb.info/sub/363669/apps, I have created an Anti-Detect Library called Botasaurus. Here's how you can use it to visit steamdb.info:

1. **Install Botasaurus**
python -m pip install botasaurus
2. **Bypass https://steamdb.info/sub/363669/apps**
from botasaurus import *
from botasaurus.create_stealth_driver import create_stealth_driver

@browser(
    create_driver=create_stealth_driver(
        start_url="https://steamdb.info/sub/363669/apps",
    ),
)
def scrape_heading_task(driver: AntiDetectDriver, data):
    driver.prompt()
    heading = driver.text('h1')
    return heading

scrape_heading_task()    

I suggest learning about bypassing various Cloudflare protections here.

If this has been a lifesaver for you, I would greatly appreciate a Star here :)

It works, but how do I make it so I can parse with bs4, and so I can specify more than just one page.

ShiGhost commented 8 months ago

And on debian the Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'chrome-launcher' imported from /files/botasaurus/.venv/lib/python3.11/site-packages/javascript/js/deps.js

And cloudflare gets around every once in a while.