CityofToronto / bdit_volumes

Traffic Volumes Modelling Project
7 stars 6 forks source link

Errors running `flow_data_processing.py` #75

Open iammattlee opened 2 years ago

iammattlee commented 2 years ago

Running flow_data_processing.py leads to this error, which halts the process due to null values found in S02_match-atr-by-nodes.sql. Two variables are causing issues:

Error output shown below:

> python3 flow_data_processing.py
> /home/mlee/.local/share/virtualenvs/bdit_volumes-drFvfGdn/lib/python3.6/site-packages/fuzzywuzzy/fuzz.py:11: UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning
> warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning')
> WARNING:  there is no transaction in progress
> WARNING:  there is no transaction in progress
> NOTICE:  table "excluded_geoids" does not exist, skipping
> NOTICE:  table "temp_match" does not exist, skipping
> Traceback (most recent call last):
> File "flow_data_processing.py", line 110, in <module>
> newmatch = pfd.arterycode_matching() ## comment this line out to skip arterycode matching process
> File "flow_data_processing.py", line 36, in arterycode_matching
> self.execute_sql("S02_match-atr-by-nodes.sql")
> File "/home/mlee/bdit_volumes/volume_project/utilities.py", line 65, in execute_sql
> self.db.query(sql)
> File "/home/mlee/.local/share/virtualenvs/bdit_volumes-drFvfGdn/lib/python3.6/site-packages/pg.py", line 2001, in query
> return self.db.query(command)
> pg.IntegrityError: ERROR:  null value in column "direction" violates not-null constraint
> DETAIL:  Failing row contains (39948, 103009, null, null, 1, 1).