Weirdly found a specific page on a specific site that detects seleniumbase every time

seleniumbase / SeleniumBase

📊 Blazing fast Python framework for web crawling, scraping, testing, and reporting. Supports pytest. Stealth abilities: UC Mode and CDP Mode.

https://seleniumbase.io

MIT License

5.43k stars 982 forks source link

Weirdly found a specific page on a specific site that detects seleniumbase every time #3199

Closed johnpjust closed 1 month ago

johnpjust commented 1 month ago

Was trying SB and it works great (typical examples from SB work really well in most places). Why doesn't it work for this very specific page on this website below??

url = "https://seleniumbase.io/apps/turnstile"? from seleniumbase import Driver driver = Driver(uc=True) driver.get(url) #detected as bot

johnpjust commented 1 month ago

just saw discussion section...I'll look there before posting this.

mdmintz commented 1 month ago

You may need to use the SB() format with sb.uc_gui_click_captcha():

from seleniumbase import SB

with SB(uc=True, incognito=True) as sb:
    url = "https://www.glassdoor.com/Reviews/index.htm"
    sb.uc_open_with_reconnect(url, 4)
    sb.uc_gui_click_captcha()