serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)
51 stars 4 forks source link

[Bing Search API] Results from the API do not match results from Bing search #1550

Open marm123 opened 5 months ago

marm123 commented 5 months ago

Our Enterprise Customer reported that the results of our Bing Search API do not match the results of the actual Bing search. They used the bing_url from the JSON response. I've been able to recreate the issue, and I've been served different results from our API than what's available on Bing. I've tried testing it with and without the VPN (France), and have not been able to get matching results.

Results from the API:

image

Results from the bing_url:

image

Playground | Inspect | bing_url Customer's inspect Intercom Similar issue to https://github.com/serpapi/public-roadmap/issues/1428 and https://github.com/serpapi/public-roadmap/issues/1514

tanys123 commented 5 months ago

Bing search results are quite random. I tested it on my browser with incognito and without VPN. I ran the query Coffee

Screenshot 2024-04-18 at 2 56 01 PM Screenshot 2024-04-18 at 2 55 19 PM

Still doing more experiments to see if we can recognize a pattern.

ilyazub commented 1 month ago

We with @Ovi, have tried using geo proxy for our Bing Search API. It improves consistency between our API and the actual Bing results.

With geo proxy, the number of results was the same and the results were related to France (cc parameter we used) 2024-08-13_15-05

Without geo proxy, the number of results was different and the results were related to the random proxy IP image

P.S. Bing results do indeed differ across page reloads.