Epic: Sites to Scrape From

[AvocadoMoon]

Problem

There are sites which publish local events on them, but we want them to centralized in one location for easy search and pooled into a DB of other events people publish.

Solution

Create a web scraper that is able to gather all the information desired in a digestible form, and a driver which then publishes these events onto a website.

Driver Tasks

• [x] Create a driver that is compatible with the Mobilizon API

Scraper Tasks

• [ ] Create some interface that the scrapers must oblige to
• [ ] Scrape for the following sites:
  • [ ] Cafe9
  • [ ] Howard's Book Store
  • [ ] Toad's Place
  • [ ] Best Video Film & Cultural Center
  • [ ] Music Haven
  • [ ] Park City Music Hall
  • [ ] Black rock books
  • [ ] New Haven Cat Cafe
  • [ ] Jazz Haven
  • [ ] Space Ballroom
  • [ ] Stella Blues
  • [ ] Siera Club
• [ ] Google calendar supported sites
  • [x] Hartford Jazz Society
  • [x] WBT
  • [x] Elm City Games
  • [x] Downtown New Haven
  • [x] Bradely Street Bike-Coop
  • [x] Healing Meals
  • [x] Save the sound
  • [x] New Haven Library
  • [x] Hartford Public Library
  • [ ] Koffee

[AvocadoMoon]

Scraper for Microformats following schema.org. Most sites that host events seem to not follow this, but every site seems to utilize one instance of it which is the "local business" type.

[AvocadoMoon]

Looks like some of the sites use word press which has some API that may be applicable for tapping into. Also there seems to be a library within python that is used for calendars, and my be able to pull online calendars.