Open twentylemon opened 3 years ago
https://serpstack.com/ gives 100 free requests per month. The best free API option I found.
I know its probably way slower, but cant we just beautifulsoup the top result? That would get us unlimited access straight from a google webpage.
Yeah, for sure, but the top result is all over the place. There's the result card, there's the left side bar, or there's the top link. Then, stuff like "other questions" and such. It's pretty complex. We can have a basic one that scrapes, but it'll be way harder to add more features, and it'd be more fragile.
So, you could ask something like are peas legumes and get back the top blurb.