[New API] Add Bulk Search API

serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)

57 stars 6 forks source link

[New API] Add Bulk Search API #66

Open kagermanov27 opened 2 years ago

kagermanov27 commented 2 years ago

Provide an ability to do 1,000,000+ searches (Flow is called "Bulk Search API")

Submit 1M+ via scheduled=true
1,000,000+ searches get processed in 1..24 hours
Customer is checking next day (related to https://github.com/serpapi/public-roadmap/issues/65) or similarly to the current suggested usage of async=true searches.

Documentation can be under https://serpapi.com/bulk-search-api.

Past Canny Link · Private PR in progress

We can address separately with a manual custom solution, when a customer wants to make 50,000,000 non-blocking searches daily to be processed ASAP.

leemul commented 2 years ago

Hi, hopefully this batch request feature will make it in soon. For me, as well as the query itself we could pass in other paramaters such as the maximum number of results to receive, which engine / location / tbs etc...and importantly each search to pass in a custom ID so we can easily link the results back up once they're processed, bonus points for a call to a webhook when it's completed / status change on the job.

Toffee1878 commented 1 year ago

Looking forward to this being implemented.

dimitryzub commented 1 year ago

@Toffee1878 This feature is currently under active development. There is no approximate release date for users yet. At least at the time, I'm writing this message 🙂