'created' field unix timestamp correctness

cooperhewitt / the-pen-data

Open Data generated by Cooper Hewitt's Pen

http://www.cooperhewitt.org/open-source

Other

11 stars 5 forks source link

'created' field unix timestamp correctness #5

Open akamlani opened 8 years ago

akamlani commented 8 years ago

In the conversion from the 'created' field of the unix timestamp to a datetime, it shows bundles over the timespan as early as 00 hour and late as 23 hour. Is this correct? Are these timestamps to be when the object label was actually scanned by the pen?

micahwalter commented 8 years ago

Well, the timestamps are in UTC timezone, so that could be one possibility. Midnight UTC is 8pm EST, which makes sense since we are open until 9pm on Saturdays.

akamlani commented 8 years ago

Looks like I am still seeing some timestamps on the objects tagged after closing time.

I performed the analysis on the subset (slice of 10000 samples) as indicated in the notebook
Here is a link to my notebook: cooperhewitt_thepen notebook

micahwalter commented 8 years ago

HI @akamlani Thanks for this. I'm pretty sure this is happening during special events, or after hours testing we may be doing. It would be interesting to do the analysis across the whole set and plot over time to see if there is a pattern. -m

akamlani commented 8 years ago

I'll see if I can look into it further. If there is any more context on those select data observations, let me know.