openego / powerd-data

GNU Affero General Public License v3.0
1 stars 0 forks source link

Finish-eGon100RE-heat_supply.district-heating-fails #292

Closed CarlosEpia closed 2 months ago

CarlosEpia commented 3 months ago

The task heat_supply.district-heating fails with this error message: [2024-07-23, 20:24:34 UTC] {taskinstance.py:441} ▼ Post task execution logs [2024-07-23, 20:24:34 UTC] {taskinstance.py:2905} ERROR - Task failed with exception Traceback (most recent call last): File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3653, in get_loc return self._engine.get_loc(casted_key) File "pandas/_libs/index.pyx", line 147, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/index.pyx", line 176, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/hashtable_class_helper.pxi", line 7080, in pandas._libs.hashtable.PyObjectHashTable.get_item File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item KeyError: 'resistive_heater' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 465, in _execute_task result = _execute_callable(context=context, execute_callable_kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 432, in _execute_callable return execute_callable(context=context, execute_callable_kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper return func(self, *args, kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/init.py", line 216, in skip_task result = super(type(task), task).execute(*xs, *ks) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 401, in wrapper return func(self, args, kwargs) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 235, in execute return_value = self.execute_callable() File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/operators/python.py", line 252, in execute_callable return self.python_callable(self.op_args, self.op_kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/init.py", line 86, in district_heating supply = cascade_heat_supply(scenario, plotting=False) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 328, in cascade_heat_supply capacity_per_category = capacity_per_district_heating_category( File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/heat_supply/district_heating.py", line 74, in capacity_per_district_heating_category target_values.capacity["resistive_heater"] File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1007, in getitem return self._get_value(key) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/series.py", line 1116, in _get_value loc = self.index.get_loc(label) File "/home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3655, in get_loc raise KeyError(key) from err KeyError: 'resistive_heater' [2024-07-23, 20:24:34 UTC] {taskinstance.py:1206} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=heat_supply.district-heating, run_id=manual__2024-07-19T10:01:55.021318+00:00, execution_date=20240719T100155, start_date=20240723T202434, end_date=20240723T202434 [2024-07-23, 20:24:34 UTC] {standard_task_runner.py:110} ERROR - Failed to execute job 2361 for task heat_supply.district-heating ('resistive_heater'; 623688) [2024-07-23, 20:24:34 UTC] {local_task_job_runner.py:240} INFO - Task exited with return code 1 [2024-07-23, 20:24:35 UTC] {logging_mixin.py:188} WARNING - /home/powerd/egon100re-run/venv2/lib/python3.8/site-packages/airflow/models/baseoperator.py:1297 AirflowProviderDeprecationWarning: Call to deprecated class PostgresOperator. (Please use airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator.Also, you can provide hook_params={'schema': <***base>}.) [2024-07-23, 20:24:35 UTC] {taskinstance.py:3503} INFO - 0 downstream tasks scheduled from follow-on schedule check