rbren / rss-parser

A lightweight RSS parser, for Node and the browser
MIT License
1.39k stars 209 forks source link

Multiple requests by rss-parser #272

Closed mboelen closed 7 months ago

mboelen commented 7 months ago

In our logs I see multiple requests by rss-parser. Is this common behavior by the tool, or is this someone who implemented it incorrectly and calls the parser multiple times?

I'm not using rss-parser myself, so have no good (yet) understanding on how it is used.

2024-04-10T12:46:02+00:00 200 123.123.123.123 "GET / HTTP/1.1" 28295 "-" "rss-parser" TLSv1.3/TLS_AES_256_GCM_SHA384 0.000 .
2024-04-10T12:46:07+00:00 200 123.123.123.123 "GET / HTTP/1.1" 28295 "-" "rss-parser" TLSv1.3/TLS_AES_256_GCM_SHA384 0.000 .
2024-04-10T12:46:11+00:00 200 123.123.123.123 "GET / HTTP/1.1" 28295 "-" "rss-parser" TLSv1.3/TLS_AES_256_GCM_SHA384 0.000 .
2024-04-10T12:46:15+00:00 200 123.123.123.123 "GET / HTTP/1.1" 28295 "-" "rss-parser" TLSv1.3/TLS_AES_256_GCM_SHA384 0.000 .
rbren commented 7 months ago

Hopefully someone who implemented it incorrectly 😅

Looks like they're scraping you every few seconds.