search

OhmSpectator / streetviews-grabber

A script that grabs Google Street View for a city.
Other
7 stars 1 forks source link

Distribute the Google API requests over different nodes #25

Open OhmSpectator opened 1 year ago

OhmSpectator commented 1 year ago

The OSM request is only one and can be done on a machine. But the Google API requests take ages to finish. To many of them to be done. Even generic parallelization over different CPUs is not that helpful. Think about the distribution of these requests between different nodes.

OhmSpectator commented 1 year ago

https://en.wikipedia.org/wiki/Apache_Hadoop

OhmSpectator commented 1 year ago

https://cwiki.apache.org/confluence/display/HADOOP2

OhmSpectator commented 1 year ago

To make distributed requests to the Google Street View Static API, you can use a tool like Google's own Cloud Functions or Apache OpenWhisk. These tools allow you to run small pieces of code, called "functions," in the cloud, which can be triggered by events or accessed via an API. With these tools, you can distribute requests to the Google Street View Static API across multiple servers, making your application more scalable and efficient.