search

tasos-py / Search-Engines-Scraper

Search google, bing, yahoo, and other search engines with python
MIT License
513 stars 137 forks source link

How to search more pages and links #70

Closed qiankunlee closed 1 week ago

qiankunlee commented 2 months ago

Hello, thanks for your work very much. I have a question now, how to search more results like links, I have changed the parameter of 'SEARCH_ENGINE_RESULTS_PAGES', but it doesn't work!

qiankunlee commented 2 months ago

The SEARCH_ENGINE_RESULTS_PAGES is in config.py

tasos-py commented 2 months ago

Hi, it's very easy to set the max number of pages. For the CLI script you can use the -p argument, and for the lib the .search(pages=) argument. However, the actual number of pages can be smaller, depending on the query and search engine. For example Google doesn't go further than the 2-3rd page sometimes