search

cblgh / cerca

lean forum software
Other
127 stars 18 forks source link

Querying the RSS feed multiple results in 504 #88

Open decentral1se opened 2 days ago

decentral1se commented 2 days ago

The RSS feed seems to lock up after multiple queries. This has happened multiple times today as a XMPP/RSS notification bot (!) was built to relay updates. I will try to come up with a reproduction for this, leaving this here for now so I don't forget.

cblgh commented 2 days ago

heh yeah, so there's actually a measure in place to prevent unruly robots / disrespectful rss bots from draining the server. look into limiter.go. i think we should expose & make configurable the limits and its opinions 👍

separate from this there's actually a concurrency issue (accessing the map in a naughty way) in there somewhere that has happened once and is on my todo to debug.

decentral1se commented 1 day ago

warawara has worked around the current limit implementation to prove itself not unruly 😂

Configurable sounds good!

If I see any naughty map access crashes, will post here.

cblgh commented 1 day ago 
It can be used for other RSS feeds but the odd choices are here because it is
essentially made to be used with the cerca forum, which public feed only 
display the latest posts, only one per thread, most recent at the top.

ahah shiet 🔥