search

mediacloud / rss-fetcher

Intelligently fetch lists of URLs from a large collection of RSS Feeds as part of the Media Cloud Directory.
https://search.mediacloud.org/directory
Apache License 2.0
5 stars 5 forks source link

sources without feeds #21

Closed opme closed 1 year ago

opme commented 1 year ago

Hi. Noticed you have 1.5 millions sources but only 170k feeds. So about 1.4 million sources that do not have feeds?

Have you checked those 1.4 million for feeds already? If it has not been done already I'm thinking it could be done in about 30 days by spinning up some cloud instances.

rahulbot commented 1 year ago

Hello and thanks for your suggestion. However, we don't have capacity to ingest feeds from that many sources. Our focus is on having a more curated set of sources that we regularly ingest content from... such as those in our geographic collections.