openego / powerd-data

GNU Affero General Public License v3.0
1 stars 0 forks source link

finish-eGon100RE-DSM_cts_ind not working #243

Open CarlosEpia opened 1 month ago

CarlosEpia commented 1 month ago

The task DSM_cts_ind is not working. It is failing with this error message:

[2024-05-07, 12:57:45 UTC] {standard_task_runner.py:84} INFO - Running: ['airflow', 'tasks', 'run', 'egon--processing-pipeline', 'DSM_cts_ind.dsm-cts-ind-processing', 'manual2024-05-03T07:42:22.499342+00:00', '--job-id', '211', '--raw', '--subdir', 'DAGS_FOLDER/dags/pipeline.py', '--cfg-path', '/tmp/tmprf7qyveq'] [2024-05-07, 12:57:45 UTC] {standard_task_runner.py:85} INFO - Job 211: Subtask DSM_cts_ind.dsm-cts-ind-processing [2024-05-07, 12:57:45 UTC] {task_command.py:416} INFO - Running <TaskInstance: egon-data-processing-pipeline.DSM_cts_ind.dsm-cts-ind-processing manual2024-05-03T07:42:22.499342+00:00 [running]> on host at31 [2024-05-07, 12:57:45 UTC] {taskinstance.py:1662} INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNER='airflowstatsd_on = False' AIRFLOW_CTX_DAG_ID='egon--processing-pipeline' AIRFLOW_CTX_TASK_ID='DSM_cts_ind.dsm-cts-ind-processing' AIRFLOW_CTX_EXECUTION_DATE='2024-05-03T07:42:22.499342+00:00' AIRFLOW_CTX_TRY_NUMBER='2' AIRFLOW_CTX_DAG_RUN_ID='manual2024-05-03T07:42:22.499342+00:00' [2024-05-07, 12:57:45 UTC] {logging_mixin.py:154} INFO -
[2024-05-07, 12:57:45 UTC] {logging_mixin.py:154} INFO - CTS per osm-area: cooling, ventilation and air conditioning [2024-05-07, 12:57:45 UTC] {logging_mixin.py:154} INFO -
[2024-05-07, 12:58:56 UTC] {logging_mixin.py:154} INFO -
[2024-05-07, 12:58:56 UTC] {logging_mixin.py:154} INFO - industry per osm-area: cooling and ventilation [2024-05-07, 12:58:56 UTC] {logging_mixin.py:154} INFO -
[2024-05-07, 12:59:57 UTC] {taskinstance.py:1937} ERROR - Task failed with exception Traceback (most recent call last): File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/
init.py", line 216, in skip_task result = super(type(task), task).execute(*xs, *ks) File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 192, in execute return_value = self.execute_callable() File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 209, in execute_callable return self.python_callable(self.op_args, **self.op_kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/DSM_cts_ind.py", line 1582, in dsm_cts_ind_processing dsm_cts_ind() File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/DSM_cts_ind.py", line 1098, in dsm_cts_ind df_dsm_buses = gpd.GeoDataFrame( File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/geopandas/geodataframe.py", line 194, in init__ raise ValueError( ValueError: Assigning CRS to a GeoDataFrame without a geometry column is not supported. Supply geometry using the 'geometry=' keyword argument, or by providing a DataFrame with column name 'geometry' [2024-05-07, 12:59:57 UTC] {taskinstance.py:1400} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=DSM_cts_ind.dsm-cts-ind-processing, execution_date=20240503T074222, start_date=20240507T125745, end_date=20240507T125957 [2024-05-07, 12:59:57 UTC] {standard_task_runner.py:104} ERROR - Failed to execute job 211 for task DSM_cts_ind.dsm-cts-ind-processing (Assigning CRS to a GeoDataFrame without a geometry column is not supported. Supply geometry using the 'geometry=' keyword argument, or by providing a DataFrame with column name 'geometry'; 3150293) [2024-05-07, 12:59:58 UTC] {local_task_job_runner.py:228} INFO - Task exited with return code 1 [2024-05-07, 12:59:58 UTC] {logging_mixin.py:154} WARNING - /home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/models/baseoperator.py:1203 AirflowProviderDeprecationWarning: Call to deprecated class PostgresOperator. (Please use airflow.providers.common.sql.operators.sql.SQLExecuteQueryOperator.Also, you can provide `hook_params={'schema': <base>}`.) [2024-05-07, 12:59:58 UTC] {taskinstance.py:2778} INFO - 0 downstream tasks scheduled from follow-on schedule check