CityofToronto / bdit_traffic_prophet

Suite of algorithms for predicting average daily traffic on Toronto streets
GNU General Public License v3.0
1 stars 1 forks source link

Clean FLOW count data to improve permanent count station accuracy #30

Open cczhu opened 4 years ago

cczhu commented 4 years ago

Based on some circumstantial evidence, such as

we know that there are issues in the FLOW data being we're ingesting into the model. These issues can both be categorical errors (eg. accidentally including bike counts), sensor failure, special events, or not properly accounting for locations with major construction or detours. We should clean the data of these issues.

This cleaning process should involve:

cczhu commented 4 years ago

Note that right now we use a median to calculate the annual average version D_ijk because PTCs have not been cleaned of high noise locations (we don't for DoM_ijk). get_annually_averaged_ratios should be revisited when this issue is being solved.