Fixed(Add-Content): Extend Webpage Detection to Include RSS Feeds Based on Content-Type Check

stakwork / sphinx-nav-fiber

14 stars 48 forks source link

Closed MuhammadUmer44 closed 1 month ago

MuhammadUmer44 commented 1 month ago

Feeds like this should work: https://rss.arxiv.org/rss/cs.AI
If RSS is not picked up by regex check but is identified as a wevpage, add an additional check on all webpages for RSS feeds.
Extend check for type = application/rss+xml

MuhammadUmer44 commented 1 month ago

Hi @Rassl, Please review this PR.

tomsmith8 commented 1 month ago

https://rss.arxiv.org/rss/stat.ML

This should be picked up right?