Open aharpalaniTO opened 7 years ago
I will produce initial delta tables + summaries. Will leave to @sunnyqywang to determine best approach. Most likely will look to refresh our version of FLOW counts every month, if the process isn't too time consuming.
@aharpalani started to develop this process; still in progress. @sunnyqywang has updated artery locations to reflect more recent version of FLOW.
@aharpalaniTO wrote process for creating 5 tables:
new_arterydata
: diff between traffic.arterydata
AND flow::arterydata
new_countinfo
: diff between traffic.countinfo
AND flow::countinfo
new_cnt_det
: all records from traffic.cnt_det
where count_info_id IN new_countinfo
new_countinfomics
: diff between traffic.countinfomics
AND flow::countinfomics
new_det
: all records from traffic.det
where count_info_id IN new_countinfomics
@aharpalaniTO and @sunnyqywang to discuss streamlining process for future use
@aharpalaniTO loading new data from FLOW to the traffic schema, and @sunnyqywang's script only processes the difference between updated tables and their clean versions in prj_volume schema.
Process likely to involve:
artery_tcl
correctlyarterydata
,cnt_det
,det
, etc.)