ejwillemse / app_vukwm_bag_delivery

1 stars 0 forks source link

Error with area code extraction #53

Closed ejwillemse closed 1 year ago

ejwillemse commented 1 year ago

Cause by missing area number

Traceback (most recent call last):
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 564, in _run_script
    exec(code, module.__dict__)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/Home.py", line 101, in <module>
    load_input_data.load_data()
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/app_vukwm_bag_delivery/home/presenters/load_input_data.py", line 40, in load_data
    convert_intermediate_data()
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/app_vukwm_bag_delivery/home/presenters/load_input_data.py", line 27, in convert_intermediate_data
    unassigned_jobs = raw_input_processing.process_input_data(
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/app_vukwm_bag_delivery/models/pipelines/process_input_data/raw_input_processing.py", line 116, in process_input_data
    df = extract_transport_number(df)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/app_vukwm_bag_delivery/models/pipelines/process_input_data/raw_input_processing.py", line 66, in extract_transport_number
    transport_area_number=df["Transport Area Code"].str[:-1].astype(int)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/generic.py", line 6240, in astype
    new_data = self._mgr.astype(dtype=dtype, copy=copy, errors=errors)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/internals/managers.py", line 450, in astype
    return self.apply("astype", dtype=dtype, copy=copy, errors=errors)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/internals/managers.py", line 352, in apply
    applied = getattr(b, f)(**kwargs)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/internals/blocks.py", line 526, in astype
    new_values = astype_array_safe(values, dtype, copy=copy, errors=errors)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/dtypes/astype.py", line 299, in astype_array_safe
    new_values = astype_array(values, dtype, copy=copy)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/dtypes/astype.py", line 230, in astype_array
    values = astype_nansafe(values, dtype, copy=copy)
  File "/Users/ejwillemse/dev/waste_labs_dev/app_vukwm_bag_delivery/.venv/lib/python3.10/site-packages/pandas/core/dtypes/astype.py", line 170, in astype_nansafe
    return arr.astype(dtype, copy=True)
ValueError: cannot convert float NaN to integer