ExamSchedule/1149ExamSchedule.csv has extra blank columns

uWaterloo / Datasets

Datasets powering the Open Data API

https://api.uwaterloo.ca

61 stars 56 forks source link

ExamSchedule/1149ExamSchedule.csv has extra blank columns #62

Open nathanv opened 10 years ago

nathanv commented 10 years ago

There is a known issue with extra columns in the csv. Some notes:

This issue ONLY affects the CSV and not the API.
Since we wanted to get the data out as fast as possible and since the API works as per usual, we are releasing the data with this known issue.
In the future, we endeavour to properly normalize the data in conjunction with the partners at the registrar.

edit 13:06 16-10-2014: for clarity

nathanv commented 10 years ago

File in question is here: https://api.uwaterloo.ca/v2/terms/1149/examschedule.json

nathanv commented 10 years ago

This issue is referenced in http://lists.uwaterloo.ca/pipermail/opendata/2014-October/000178.html

lkmorlan commented 10 years ago

This raises a question about the nature of these source data files. I think they should either be the unprocessed files strait from the upstream source or fully-processed and normalized files which use ISO dates and times, no redundant data (like day of the week), etc. Right now, they are somewhere in the middle, having had some processing, but not all of it.

nathanv commented 10 years ago

Point of clarification: please not that this issue ONLY affects the CSV and not the API.

@lkmorlan totally agree. Thanks for opening the new bugs #63, #64, #65, #66, #66.