A Python library that queries Google, Bing, Yahoo and other search engines and collects the results from multiple search engine results pages.
Please note that web-scraping may be against the TOS of some search engines, and may result in a temporary ban.
Google
Bing
Yahoo
Duckduckgo
Startpage
Aol
Dogpile
Ask
Mojeek
Brave
Torch
search_engines/engines/
and add it to the search_engines_dict
dictionary in search_engines/engines/__init__.py
. The new class should subclass SearchEngine
, and override the following methods: _selectors
, _first_page
, _next_page
. Python 2.7 - 3.x with
Requests and
BeautifulSoup
Run the setup file: $ python setup.py install
.
Done!
As a library:
from search_engines import Google
engine = Google()
results = engine.search("my query")
links = results.links()
print(links)
As a CLI script:
$ python search_engines_cli.py -e google,bing -q "my query" -o json,print