search

densekernel / 3001

COMP3001:Technology Management and Professional Issues - Team 5 GitHub Repository
2 stars 6 forks source link

Scrape tube status history #28

Closed xalodni closed 9 years ago

xalodni commented 10 years ago

From http://tubestatus.net/timeline/date/2012-08-15

Table could easily be scraped using Beautiful Soup.

Result is a way to determine status given day, line and hour. Going to make a local MySQL table for this. Visualisation team might want a look.

Will produce record of how I went about scraping it.

Everybody OK with the format of day x line x hour -> status?

densekernel commented 10 years ago

Hi Ran, just wondered how this is going along, I would like to analyse this data for some basic stats about the engineering works

xalodni commented 9 years ago

http://tubestatus.net/timeline - Can't get anything except the last 24 hours. I won't be able to do anything until I can get timetables by date.

[edit]

Actually I can except it's slow. It's slower than getting the last 24 hours.

xalodni commented 9 years ago

Actually I can except it's slow. It's slower than getting the last 24 hours.

xalodni commented 9 years ago

Sent an email to the address at the bottom of the website.

nicola commented 9 years ago

Scraper #29

nicola commented 9 years ago

https://github.com/jonnymanf/3001/tree/master/data cc @RagavanGun @mohandai Closed 2c664886ad27255a56f3eb7a373c6d8725c2b1a5