search

Netflix-Skunkworks / Scumblr

Web framework that allows performing periodic syncs of data sources and performing analysis on the identified results
Apache License 2.0
2.64k stars 318 forks source link

Issue when running RSS provider on certain feeds. #110

Open ghost opened 7 years ago

ghost commented 7 years ago

We're getting an error when running the RSS provider against the feed for Malware Traffic analysis: http://www.malware-traffic-analysis.net/blog-entries.rss

It's the only feed we're currently having an issue with, so I believe it may be the feed but thought it best to raise the issue.

Error received:
Error: value <Thur, 20 Oct 2016 23:35:00 +0000> of tag <pubDate> is not available

Full Stack Trace at: http://pastebin.com/KV1m9J0v

ahoernecke commented 7 years ago

Thanks @joshua-rogers,

This looks like the specific rss feed may be missing a field we're expecting. I'll see if I can fix this up in the next couple days.

cafeitduong commented 7 years ago

Hello,

I also having an unstable error, sometime the job get running and return with error of just like joshua-rogers' sometimes the job could not get started because of error "Error: 403 Forbidden".

cafeitduong commented 7 years ago

Hello,

May I know have we fixed this issue, I'm trying to run RSS search on https://www.exploit-db.com/rss.xml but got "Error: 403 Forbidden", is it Scumblr error or exploit-db prevent from auto crawl mechanism? Thanks!

cafeitduong commented 7 years ago

Never mind, please ignore my previous message, I was able to do it by using feedburner.google.com. Thanks!