CityofToronto / bdit_data-sources

Data sources used by the Big Data Innovation Team
https://github.com/orgs/CityofToronto/teams/bigdatainnovationteam
GNU General Public License v3.0
36 stars 8 forks source link

Migrate historical ATR category data #1000

Open radumas opened 6 days ago

radumas commented 6 days ago

An ~imminent~ upcoming update to MOVE’s schema will remove the VDS data and Bicycle ATRs (permanent counters) from the legacy schema (loaded into FLOW at some point in time). Set us up in a way so that the disappearance of those datasets from move_staging won’t impact our usage of the three datasets

Data for category_id IN (2,6,7) (RESCU, PermStn and Bicycle) will be removed from traffic.cnt_det and traffic.countinfo.

gabrielwol commented 5 days ago

In a mild panic yesterday I copied data for category_id 6 into traffic.cnt_det_6 & traffic.countinfo_6 (& ditto for _7). They have the same definitions as the base tables.

Anything else you see to do?