search

equivalentideas / westconnex_M4_East_Air_Quality_Monitoring

WestConnex M4 East - Air Quality Monitoring data
1 stars 1 forks source link

Use correct data types for columns containing air quality measurements #10

Closed equivalentideas closed 6 years ago

equivalentideas commented 6 years ago

So that we can work with and doc calculations on the data.

We'll have to migrate the existing data.

equivalentideas commented 6 years ago

I did a little bit on this yesterday to convert the float data to the float type. Unfortunately it couldn't automagically coerce the text data to floats as I had hoped, and I couldn't find a way to add instructions, so I went down the path of making new columns, making the conversation and then removing the old columns. My initial attempt didn't work well and wiped out all the data :D. Combination and learning a new library and 35ºC.

I'll push that up, but I don't think I'll be working on it more today.

equivalentideas commented 6 years ago

Here's that initial work I did yesterday https://github.com/equivalentideas/westconnex_M4_East_Air_Quality_Monitoring/tree/convert_column_type_for_floats

henare commented 6 years ago

It looks like pm2_5_concentration_ug_per_m3 should be stored as an Integer and the remaining eight values should be stored as Floats (will get stored as double precision by Postgres).

henare commented 6 years ago

It looks like pm2_5_concentration_ug_per_m3 should be stored as an Integer...

The data published by the NSW government (see #18) isn't an Integer so this should also be a Float. That makes things easy.