search

mediacloud / web-tools

The shared repository for Media Cloud web apps (Explorer, Source Manager, Topic Mapper)
https://tools.mediacloud.org
Apache License 2.0
64 stars 30 forks source link

Fetching stories from an RSS feed not working. #2105

Open esirK opened 3 years ago

esirK commented 3 years ago

Hello @rahulbot @dsjen @pypt We have been trying to pull stories from this RSS feed and also for this (I picked the RSS data from an active rss feed that has been fetched from another site so I'm sure it works if pulled from that website.). Is there something that we are missing in order to be able to fetch stories off an rss feed URL? There aren't any errors that we can find to attach here. The only interesting thing that happens is a new RSS feed gets created and it also gets marked Disabled automatically as shown below

Screenshot 2021-09-30 at 12 11 27

rahulbot commented 3 years ago

The only thing weird in that screenshot is the URL - it has the package names prepended to the URL. Did you add those or is there some bug in the system that added them?

esirK commented 3 years ago

The only thing weird in that screenshot is the URL - it has the package names prepended to the URL. Did you add those or is there some bug in the system that added them?

The system automatically added them.

rahulbot commented 3 years ago

Oh, yeah, then that seems like a bug. Can you describe the process that resulted in this? Did you enter a new source and have the system automatically scrape for RSS feeds and this is what resulted? If so, what was the domain you put in? That can help us try to replicate it.