SmartRSS / Smart-RSS

RSS extension
MIT License
114 stars 16 forks source link

Feature Request: Feed Any Webpage #203

Open giiutfff opened 2 years ago

giiutfff commented 2 years ago

I know there are many online services provide rss feed for websites that do not support rss. But since they are hosted by a 3rd party, the reliability is not sure. And they come and go. (eg. Google Reader) Also they often limit the usage and require payment to unlock features, and the data is stored on their devices rather than individual's. (not FOSS)

So I suggest to add the ability to feed any webpage:

  1. fetch the html content. (might need to load into a iframe, because some webpage uses ajax to load actual content) or use Mozilla Readability parser maybe?
  2. use XPath(or regexp, idk) to extract the content
  3. compare to previous fetch, if the content is different then generate a timestamp and add the entry.
zakius commented 2 years ago

I don't think I'll be able to provide this feature as there are many hurdles to beat on the way, but for now I'll keep it on the list and think about possible solutions

giiutfff commented 2 years ago

This addon can feed any webpage and rss https://addons.mozilla.org/firefox/addon/distill-web-monitor-ff/ Unfortunately it's proprietary software. And the UI is awful.(a single list to display all the feeds and entries? NOOOO)They also limit what can be done without their non-free network service. However, I think this might be a good example of what or how can an addon achieves.