omkarcloud / botasaurus

The All in One Framework to build Awesome Scrapers.
https://www.omkar.cloud/botasaurus/
MIT License
1.36k stars 124 forks source link

Request, Stealth Mode not working #74

Closed surmatech closed 4 months ago

surmatech commented 6 months ago

from botasaurus import *

@request(use_stealth=True) def scrape_heading_task(request: AntiDetectRequests, data): response = request.get('ANY_CF_UAM_WEBSITE') print(response.status_code) return response.text

scrape_heading_task()

This shares output almost instantaneously for all cloudflare UAM websites and doesn't work. Tried with and without proxies. In the browser alternative, it waits for those 8 seconds making it work. What could be wrong here?

Any way to simulate wait here too, the wait argument doesn't work.

Chetan11-dev commented 4 months ago

Please run the following commands:

python -m pip install bota botasaurus_api botasaurus_driver bota botasaurus-proxy-authentication botasaurus_server --upgrade

And read the documentation at https://github.com/omkarcloud/botasaurus.