search

CityofToronto / bdit_volumes

Traffic Volumes Modelling Project
7 stars 6 forks source link

Load SCOOT data into Postgres #25

Open aharpalaniTO opened 7 years ago

aharpalaniTO commented 7 years ago

Process for:

  1. Validating data prior to import
  2. Importing data
  3. Aggregating data?

Store data it its own schema, scoot

aharpalaniTO commented 7 years ago

@sunnyqywang has completed step 2

jwrcoleman commented 7 years ago

Store cycle-level data in Postgres @radumas

jwrcoleman commented 7 years ago

@sunnyqywang to create partitioned table structure to store 15-minute data.

jwrcoleman commented 7 years ago

Monthly data includes records from other months, need to come up with a strategy to re-partition or handle this issue

sunnyqywang commented 7 years ago

Partition Table created.

aharpalaniTO commented 7 years ago

15-minute bin data are currently in Postgres. Cycle level data still to be loaded. With @radumas.