search

Etimo / photo-garden

An easy way for anyone to get an overview of a large amount of photos from different vendors and sources. 📷 🖼️
https://photo.garden
MIT License
7 stars 1 forks source link

Google Drive rate limits #65

Open nightkr opened 6 years ago

nightkr commented 6 years ago

Google Drive only allows 1000 queries per user per 100 seconds, which makes our download logic pretty unhappy, especially during development.

nightkr commented 6 years ago

Note that this only seems to affect full-size images, not thumbnails. I'm going to disable full-size downloads for now...

indrif commented 6 years ago

We should probably implement a configurable throttling mechanism for queues. This will not be the only case where we need to control the number of calls. Most APIs have some kind of rate limit and even though most of them might not be applicable to us there are some that will.

Probably needs some discussion.

indrif commented 6 years ago

Many of the ai services have pretty aggressive rate limits. Azure limits the calls to 20/s for example for their cognitive image recognition service.

nightkr commented 6 years ago

Yeah, absolutely.