The task heat_supply.district-heating fails with this error message:
[2024-07-23, 20:24:34 UTC] {taskinstance.py:441} ▼ Post task execution logs
[2024-07-23, 20:24:34 UTC] {taskinstance.py:2905} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3653, in get_loc
return self._engine.get_loc(casted_key)
File "pandas/_libs/index.pyx", line 147, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/index.pyx", line 176, in pandas._libs.index.IndexEngine.get_loc
File "pandas/_libs/hashtable_class_helper.pxi", line 7080, in pandas._libs.hashtable.PyObjectHashTable.get_item
File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'resistive_heater'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 465, in _execute_task
result = _execute_callable(context=context, execute_callable_kwargs)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 432, in _execute_callable
return execute_callable(context=context, execute_callable_kwargs)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper
return func(self, *args, kwargs)
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/init.py", line 216, in skip_task
result = super(type(task), task).execute(*xs, *ks)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper
return func(self, args, kwargs)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 235, in execute
return_value = self.execute_callable()
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 252, in execute_callable
return self.python_callable(self.op_args, self.op_kwargs)
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/init.py", line 86, in district_heating
supply = cascade_heat_supply(scenario, plotting=False)
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 328, in cascade_heat_supply
capacity_per_category = capacity_per_district_heating_category(
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 74, in capacity_per_district_heating_category
target_values.capacity["resistive_heater"]
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1007, in getitem
return self._get_value(key)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1116, in _get_value
loc = self.index.get_loc(label)
File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3655, in get_loc
raise KeyError(key) from err
KeyError: 'resistive_heater'
[2024-07-23, 20:24:34 UTC] {taskinstance.py:1206} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=heat_supply.district-heating, run_id=manual__2024-07-19T10:01:55.021318+00:00, execution_date=20240719T100155, start_date=20240723T202434, end_date=20240723T202434
[2024-07-23, 20:24:34 UTC] {standard_task_runner.py:110} ERROR - Failed to execute job 2361 for task heat_supply.district-heating ('resistive_heater'; 623688)
[2024-07-23, 20:24:34 UTC] {local_task_job_runner.py:240} INFO - Task exited with return code 1
[2024-07-23, 20:24:35 UTC] {logging_mixin.py:188} WARNING - /home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py:1297 AirflowProviderDeprecationWarning: Call to deprecated class PostgresOperator. (Please use airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator.Also, you can provide hook_params={'schema': <***base>}.)
[2024-07-23, 20:24:35 UTC] {taskinstance.py:3503} INFO - 0 downstream tasks scheduled from follow-on schedule check
The task heat_supply.district-heating fails with this error message: [2024-07-23, 20:24:34 UTC] {taskinstance.py:441} ▼ Post task execution logs [2024-07-23, 20:24:34 UTC] {taskinstance.py:2905} ERROR - Task failed with exception Traceback (most recent call last): File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3653, in get_loc return self._engine.get_loc(casted_key) File "pandas/_libs/index.pyx", line 147, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/index.pyx", line 176, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/hashtable_class_helper.pxi", line 7080, in pandas._libs.hashtable.PyObjectHashTable.get_item File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item KeyError: 'resistive_heater' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 465, in _execute_task result = _execute_callable(context=context, execute_callable_kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 432, in _execute_callable return execute_callable(context=context, execute_callable_kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper return func(self, *args, kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/init.py", line 216, in skip_task result = super(type(task), task).execute(*xs, *ks) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper return func(self, args, kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 235, in execute return_value = self.execute_callable() File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 252, in execute_callable return self.python_callable(self.op_args, self.op_kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/init.py", line 86, in district_heating supply = cascade_heat_supply(scenario, plotting=False) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 328, in cascade_heat_supply capacity_per_category = capacity_per_district_heating_category( File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 74, in capacity_per_district_heating_category target_values.capacity["resistive_heater"] File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1007, in getitem return self._get_value(key) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1116, in _get_value loc = self.index.get_loc(label) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3655, in get_loc raise KeyError(key) from err KeyError: 'resistive_heater' [2024-07-23, 20:24:34 UTC] {taskinstance.py:1206} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=heat_supply.district-heating, run_id=manual__2024-07-19T10:01:55.021318+00:00, execution_date=20240719T100155, start_date=20240723T202434, end_date=20240723T202434 [2024-07-23, 20:24:34 UTC] {standard_task_runner.py:110} ERROR - Failed to execute job 2361 for task heat_supply.district-heating ('resistive_heater'; 623688) [2024-07-23, 20:24:34 UTC] {local_task_job_runner.py:240} INFO - Task exited with return code 1 [2024-07-23, 20:24:35 UTC] {logging_mixin.py:188} WARNING - /home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py:1297 AirflowProviderDeprecationWarning: Call to deprecated class PostgresOperator. (Please use
airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator
.Also, you can providehook_params={'schema': <***base>}
.) [2024-07-23, 20:24:35 UTC] {taskinstance.py:3503} INFO - 0 downstream tasks scheduled from follow-on schedule check