search

tasos-py / Search-Engines-Scraper

Search google, bing, yahoo, and other search engines with python
MIT License
513 stars 137 forks source link

Collect more than 10 results + get meta description #68

Closed IKDH closed 1 week ago

IKDH commented 5 months ago

Hello,

I can't manage to get more than 10 results for a keyword. Is there a way to set up this parameter ?

Also, is it possible to get the meta description for each URL. The one that Google display, not the one set up by the owner of the website.

Thank you!

tasos-py commented 5 months ago

Thanks for informing me, I'll see to it

tasos-py commented 5 months ago

About your first question, yes you can get more results by increasing the number of pages. if you're using the CLI script you can set pages with the -p= argument, and if you're using it as a lib you can set the pages= argument.

About the second thing, I'm not sure what you mean. File outputs contain most of what search engines display, including title and text, For example, a google search for "test" produces results like, 

{
    "host": "speedtest.net",
    "link": "https://www.speedtest.net/",
    "title": "Speedtest by Ookla - The Global Broadband Speed Test",
    "text": "Download the Speedtest app for more metrics, video testing, mobile coverage maps, and more. Get it on Google Play."
},

Isn't that sufficient enough?