preload feeds from config

ghost commented 4 years ago

Hi,

Hope you are all well !

I would like to preload some feeds at the startup of readeef from the config file, is it possible ?

Example of list:

http://securityaffairs.co/wordpress/feed
https://access.redhat.com/blogs/766093/feed
https://cxsecurity.com/wlb/rss/all/
https://ics-cert.us-cert.gov/advisories/advisories.xml
https://ics-cert.us-cert.gov/alerts/alerts.xml
https://rss.packetstormsecurity.com/files/
https://searchsecurity.techtarget.com/rss/Security-Wire-Daily-News.xml
https://tools.cisco.com/security/center/psirtrss20/AlertRSS.xml
https://tools.cisco.com/security/center/psirtrss20/CiscoSecurityAdvisory.xml
https://www.novell.com/newsfeeds/rss/patches/security_notifications-daily.xml
https://www.oracle.com/ocom/groups/public/@otn/documents/webcontent/rss-otn-sec.xml
https://www.secnews24.com/feed/
https://www.us-cert.gov/ncas/alerts.xml
https://www.us-cert.gov/ncas/current-activity.xml
https://www.vulnerability-lab.com/rss/rss.php
https://securelist.com/feed/
https://blog.yoroi.company/feed/
http://feeds.feedburner.com/eset/blog/
https://blog.malwarebytes.com/feed/
https://linuxsecurity.com/advisories/debian?format=feed&type=rss
https://linuxsecurity.com/advisories/deblts?format=feed&type=rss
https://linuxsecurity.com/advisories/centos?format=feed&type=rss
https://linuxsecurity.com/advisories/red-hat?format=feed&type=rss
https://feeds.feedburner.com/TheHackersNews
https://www.darknet.org.uk/feed/
http://blog.extremehacking.org/feed/
https://latesthackingnews.com/feed/
https://www.hackread.com/feed
https://www.zdnet.com/topic/security/rss.xml
https://www.zdnet.com/news/rss.xml
https://gbhackers.com/feed/
https://www.darkreading.com/rss_simple.asp
https://www.darkreading.com/rss_simple.asp?f_n=644&f_ln=Attacks/Breaches
https://www.darkreading.com/rss_simple.asp?f_n=645&f_ln=Application%20Security
https://www.darkreading.com/rss_simple.asp?f_n=646&f_ln=Database%20Security
https://www.darkreading.com/rss_simple.asp?f_n=647&f_ln=Cloud
https://www.darkreading.com/rss_simple.asp?f_n=648&f_ln=Endpoint
https://www.darkreading.com/rss_simple.asp?f_n=649&f_ln=Authentication
https://www.darkreading.com/rss_simple.asp?f_n=650&f_ln=Privacy
https://www.darkreading.com/rss_simple.asp?f_n=651&f_ln=Mobile
https://www.darkreading.com/rss_simple.asp?f_n=652&f_ln=Perimeter
https://www.darkreading.com/rss_simple.asp?f_n=653&f_ln=Risk
https://www.darkreading.com/rss_simple.asp?f_n=654&f_ln=Compliance
https://www.darkreading.com/rss_simple.asp?f_n=657&f_ln=Identity%20and%20Access%20Management
https://www.darkreading.com/rss_simple.asp?f_n=658&f_ln=Analytics
https://www.darkreading.com/rss_simple.asp?f_n=659&f_ln=Threat%20Intelligence
https://www.darkreading.com/rss_simple.asp?f_n=660&f_ln=Security%20Monitoring
https://www.darkreading.com/rss_simple.asp?f_n=661&f_ln=Vulnerabilities%20/%20Threats
https://www.darkreading.com/rss_simple.asp?f_n=662&f_ln=Advanced%20Threats
https://www.darkreading.com/rss_simple.asp?f_n=663&f_ln=Insider%20Threats
https://www.darkreading.com/rss_simple.asp?f_n=664&f_ln=Vulnerability%20Management
https://exploit.kitploit.com/feeds/posts/default?alt=rss
https://threatpost.com/feed/
https://blog.knowbe4.com/rss.xml
https://hackercombat.com/feed/
https://securityaffairs.co/wordpress/feed
https://www.helpnetsecurity.com/feed/
https://www.theregister.co.uk/security/headlines.atom
https://feeds.feedburner.com/securityweek
https://www.itsecurityguru.org/feed/
https://nakedsecurity.sophos.com/feed/

Cheers, X

urandom commented 4 years ago

This is technically possible by loading them via opml via the user's settings.

ghost commented 4 years ago

How do you create this opml file ? Any tools to advise ?

urandom commented 4 years ago

An opml file is a pretty basic xml file:

<?xml version="1.0" encoding="UTF-8"?>
<opml version="1.1">
    <body>
        <outline text="AnandTech" xmlUrl="http://www.anandtech.com/rss"></outline>
        ...
   </body>
</opml>

ghost commented 4 years ago

Thanks, I created a small tool fo generating the ompl file https://github.com/x0rzkov/readeef/tree/dockerize/cmd/readeef-ompl

Merry Christmas to you

urandom commented 4 years ago

You should be able to use encoding/xml directly with parser.OpmlXml, as is done here:

https://github.com/urandom/readeef/blob/master/api/opml.go#L104

Happy holidays

urandom / readeef

preload feeds from config #34