opsdisk / yagooglesearch

Yet another googlesearch - A Python library for executing intelligent, realistic-looking, and tunable Google searches.
BSD 3-Clause "New" or "Revised" License
241 stars 42 forks source link

[Feature Request] Support for collecting Related searches #34

Open photkey opened 9 months ago

photkey commented 9 months ago

google related searches

opsdisk commented 9 months ago

Thanks for taking the time to submit the suggestiomn @photkey - let me think about and see how easy it is to extract that text.

photkey commented 7 months ago

Any updates on this @opsdisk ?

opsdisk commented 6 months ago

Hi @photkey

Short answer is no, I haven't been able to do a deep dive into it.

Long answer, at some point Google introduced infinite scroll to search results ( I don't even use Google search daily anymore, so this was new to me). yagooglesearch still works, but it's more challenging trying to reverse engineer the GUI and yagooglesearch results. I'm also at a crossroads in deciding how much more I want to support new features in the library since Google caps the results at 400 (https://github.com/opsdisk/yagooglesearch?tab=readme-ov-file#max-400-results-returned) and, anecdotally, the quality of search results is decreasing.

If you create a PR, I can definitely review it and possibly merge the feature in.