search

alirezamika / autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python
MIT License
6.24k stars 654 forks source link

Websites that require cookies #8

Closed denny64 closed 4 years ago

denny64 commented 4 years ago

Is there a way to scrape websites that check for cookies?

alirezamika commented 4 years ago

Yes. You should pass the cookie header via request_args parameter.

denny64 commented 4 years ago

Thanks I'll give that a shot