search

match4everyone / match4everything

Other
7 stars 0 forks source link

Implement API rate limits #181

Open Baschdl opened 3 years ago

Baschdl commented 3 years ago

With this settings, a user is only allowed to retrieve 15*100=1500 users per day. @match4everyone/match4everyone Currently, this has to be changed in the settings/common.py and not like in A.py and B.py. Do we want to expose such general settings also in something like a general.py or should we just document that the user has to change that in settings/common.py?

Closes #177

Depends on #173

feeds commented 3 years ago

I would raise the limit per minute. Skipping through more than 5 pages and adapting the filter several times (= one requests each) is quite normal. I would set it to 40 the least. Bigger crawlers will be stopped by the hour wise rate limit.

feeds commented 3 years ago

I think its a rather technical setting, so it should go to settings.py

Baschdl commented 3 years ago

After long negotiations, we settled for 15/min

Baschdl commented 3 years ago

@feeds Mind leaving a review? 😄

Baschdl commented 3 years ago

@feeds @bjrne @maltezacharias Anyone?