search

robertocarroll / chatui

How to make MEN part of the fabric of the city - Issues are the main issue tracker for this project
MIT License
0 stars 0 forks source link

Get the raw materials from MEN site #2

Closed robertocarroll closed 9 years ago

robertocarroll commented 9 years ago

Take a MEN topic page feed, e.g. http://www.manchestereveningnews.co.uk/all-about/manchester-central-reference-library?service=rss, and convert it into json.

robertocarroll commented 9 years ago

Structure the scraper like this: http://www.delimited.io/blog/2014/1/10/scraping-movie-data-from-the-web-in-nodejs

  1. Grab the links from topic page
  2. Get the articles from those links
robertocarroll commented 9 years ago

Much could be done to make this better but closing this issue.