search

news-scraper / news_scraper

Simple ETL news scraper in Ruby
MIT License
4 stars 0 forks source link

RSS feed items #12

Closed jules2689 closed 8 years ago

jules2689 commented 8 years ago

Should we use the pub date and title from the RSS feed, or at least offer it? The latter so this is not coupled to Google RSS

image

jules2689 commented 8 years ago

@richardwu

richardwu commented 8 years ago

we could include a optional flag in the GoogleNewsRss constructor that also retrieves pubDate and other Google RSS metafields in the extract method.

jules2689 commented 8 years ago

Looking again, I think it would require a refactor I think, not sure its worth tbh