fvasco / pinpoi

Import and manage point of interest
GNU General Public License v3.0
27 stars 5 forks source link

Update all categories at once #31

Open eddydc opened 3 years ago

eddydc commented 3 years ago

Not really an issue but an annoyance bothering me for a long while. I would like to update all pois for all categories at once instead off doing this per category separately. I've a large number of pois and categories. Can this option be provided pls?

Lee-Carre commented 2 years ago

update all pois for all categories at once

I suggest this not be literal and, instead, put all requests into a queue which is handled M at a time (M=2 might be a sensible default).

Especially for the case of different datasets using the same hostname, do not open more than 2 (as per the HTTP spec) concurrent connections to the same host. While fetching, don't have more than S outstanding / ongoing requests to any individual host (S=2 as default?). Though, I doubt that PinPoi uses HTTP pipeline-ing.

Some of the data sources I use, dynamically-generate the response, so I would like (read: need) the following:


Additionally to being able to update

Being able to