search

kurtmckee / feedparser

Parse feeds in Python
https://feedparser.readthedocs.io/en/latest/
Other
1.89k stars 336 forks source link

Updating the default user-agent: http://feedparser.org/ #458

Closed saeedesmaili closed 1 day ago

saeedesmaili commented 1 week ago

The user-agent doc mentions that the default user-agent for feedparser is:

UniversalFeedParser/5.0.1 +http://feedparser.org/

Given that http://feedparser.org/ is redirecting to https://www.oxwellandco.com/ which seems to be a scam or gambling website, having this as a default user-agent might make some website owners block this user-agent if they dig into it.

Would it make sense to update the default user-agent string to something else?

saeedesmaili commented 1 week ago

Ah, I just checked the source code and the default user-agent string currently is using this github repo's url:

USER_AGENT = "feedparser/%s +https://github.com/kurtmckee/feedparser/" % __version__

So I think it's just the doc that should be updated.