CityofToronto / bdit_data-sources

Data sources used by the Big Data Innovation Team
https://github.com/orgs/CityofToronto/teams/bigdatainnovationteam
GNU General Public License v3.0
38 stars 8 forks source link

Nine different day numbers in `traffic.countinfomics.day_no`? #952

Closed Nate-Wessel closed 4 months ago

Nate-Wessel commented 5 months ago

This isn't super-well documented, but I'd expect this field to have 7 distinct values. It has 9

SELECT DISTINCT day_no 
FROM traffic.countinfomics
ORDER BY day_no

Is this DOW? ISODOW? Both and more?

Nate-Wessel commented 5 months ago

And there are 8 different days in traffic.countinfo

SELECT DISTINCT day_no
FROM traffic.countinfo
mkewins commented 5 months ago

For posterity...

gabrielwol commented 4 months ago

Will need to do some heavy lifting to edit all these views which depend on day_no columns:

traffic.countinfo: view aduyves.investigate_cp_geo_id_coverage depends on column day_no of table traffic.countinfo materialized view traffic.speed_counts_cl depends on column day_no of table traffic.countinfo materialized view traffic.speed_counts depends on column day_no of table traffic.countinfo materialized view traffic.speed_vol_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed1_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed3_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed4_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed_all_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed_study_groups depends on column day_no of table traffic.countinfo materialized view dmcelroy.speed_vol_study_groups depends on column day_no of table traffic.countinfo materialized view vz_challenge.speed_counts depends on column day_no of table traffic.countinfo view data_requests.i0529_ase_speed_volumes depends on column day_no of table traffic.countinfo

traffic.countinfomics: view bqu.countinfomics_2017 depends on column day_no of table traffic.countinfomics materialized view data_requests.i0419_curb_radii_tmcs depends on column day_no of table traffic.countinfomics materialized view scannon.i0419_curb_radii_tmcs depends on column day_no of table traffic.countinfomics

gabrielwol commented 4 months ago

I edited the dependencies and dropped the day_no columns from traffic.countinfo and traffic.countinfomics ✅ PR open to edit the replicator to copy only destination table columns from move_staging.