search

cobalt-uoft / uoft-scrapers

Public web scraping scripts for the University of Toronto.
https://pypi.python.org/pypi/uoftscrapers
MIT License
48 stars 14 forks source link

UTM timetable scraper #6

Open qasim opened 9 years ago

qasim commented 9 years ago

The UTM timetable needs a scraper. It should fill up as much of the course schema for each course as it possibly can:

{
  id: String,
  code: String,
  name: String,
  description: String,
  division: String,
  department: String,
  prerequisites: String,
  exclusions: String,
  level: Number,
  campus: String,
  term: String,
  breadths: [Number],
  meeting_sections: [{
    code: String,
    instructors: [String],
    times: [{
      day: String,
      start: Number,
      end: Number,
      duration: Number,
      location: String
    }],
    size: Number,
    enrolment: Number
  }]
}
qasim commented 8 years ago

So UTM has a set of mobile websites for a lot of cool stuff. Here's UTM courses: https://m.utm.utoronto.ca/timetable.php

purnimamehta commented 8 years ago

Working on this over at purnimamehta/uoft-scrapers - although I'm using this site to scrape course information instead of the host site. The host site's source code is a little iffy to navigate to acquire the HTML file of course information.