Fix: Timestamp and calculation issues - Githubissues

qri-io / data-stories-scripts

A collection of scripts used for data logging in support of _Data Stories_ on qri.io.

28 stars 15 forks source link

Fix: Timestamp and calculation issues #38

Closed blahblahblah- closed 4 years ago

blahblahblah- commented 4 years ago

I was trying to run this on my machine locally and was getting some very different data, so I investigated and found the following issues:

When importing timestamps from MTA's CSVs, timestamps should be imported explicitly as Eastern Time (it defaulted to UTC for me)
When attributing observations to the date, the calculation of day should be -2hrs instead of +2hrs
Investigated on spikes in data and turns out some were related to subunits not reporting for days to return. We should throw away those observations.

Example on why JFK Jamaica had a spike on 2020-05-02: