The task that calculates DLR potentials is failing with this error message:
[2024-04-22, 14:34:58 UTC] {taskinstance.py:1662} INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNER='airflowstatsd_on = False' AIRFLOW_CTX_DAG_ID='egon--processing-pipeline' AIRFLOW_CTX_TASK_ID='calculate_dlr.dlr' AIRFLOW_CTX_EXECUTION_DATE='2024-04-22T07:15:05.729748+00:00' AIRFLOW_CTX_TRY_NUMBER='1' AIRFLOW_CTX_DAG_RUN_ID='manual2024-04-22T07:15:05.729748+00:00'
[2024-04-22, 14:34:59 UTC] {taskinstance.py:1937} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/init__.py", line 216, in skip_task
result = super(type(task), task).execute(xs, ks)
File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 192, in execute
return_value = self.execute_callable()
File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 209, in execute_callable
return self.python_callable(self.op_args, self.op_kwargs)
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/calculate_dlr.py", line 52, in dlr
dlr_hourly_dic, dlr_hourly = DLR_Regions(
File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/calculate_dlr.py", line 171, in DLR_Regions
weather_data_raw = xr.open_mfdataset(str(path))
File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/xarray/backends/api.py", line 963, in open_mfdataset
raise OSError("no files to open")
OSError: no files to open
[2024-04-22, 14:34:59 UTC] {taskinstance.py:1400} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=calculate_dlr.dlr, execution_date=20240422T071505, start_date=20240422T143458, end_date=20240422T143459
[2024-04-22, 14:34:59 UTC] {standard_task_runner.py:104} ERROR - Failed to execute job 89 for task calculate_dlr.dlr (no files to open; 4146919)
[2024-04-22, 14:34:59 UTC] {local_task_job_runner.py:228} INFO - Task exited with return code 1
[2024-04-22, 14:34:59 UTC] {taskinstance.py:2778} INFO - 0 downstream tasks scheduled from follow-on schedule check
The task that calculates DLR potentials is failing with this error message: [2024-04-22, 14:34:58 UTC] {taskinstance.py:1662} INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNER='airflowstatsd_on = False' AIRFLOW_CTX_DAG_ID='egon--processing-pipeline' AIRFLOW_CTX_TASK_ID='calculate_dlr.dlr' AIRFLOW_CTX_EXECUTION_DATE='2024-04-22T07:15:05.729748+00:00' AIRFLOW_CTX_TRY_NUMBER='1' AIRFLOW_CTX_DAG_RUN_ID='manual2024-04-22T07:15:05.729748+00:00' [2024-04-22, 14:34:59 UTC] {taskinstance.py:1937} ERROR - Task failed with exception Traceback (most recent call last): File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/init__.py", line 216, in skip_task result = super(type(task), task).execute(xs, ks) File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 192, in execute return_value = self.execute_callable() File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/airflow/operators/python.py", line 209, in execute_callable return self.python_callable(self.op_args, self.op_kwargs) File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/calculate_dlr.py", line 52, in dlr dlr_hourly_dic, dlr_hourly = DLR_Regions( File "/home/powerd/egon100re-run/powerd-data/src/egon/data/datasets/calculate_dlr.py", line 171, in DLR_Regions weather_data_raw = xr.open_mfdataset(str(path)) File "/home/powerd/egon100re-run/venv/lib/python3.8/site-packages/xarray/backends/api.py", line 963, in open_mfdataset raise OSError("no files to open") OSError: no files to open [2024-04-22, 14:34:59 UTC] {taskinstance.py:1400} INFO - Marking task as FAILED. dag_id=egon--processing-pipeline, task_id=calculate_dlr.dlr, execution_date=20240422T071505, start_date=20240422T143458, end_date=20240422T143459 [2024-04-22, 14:34:59 UTC] {standard_task_runner.py:104} ERROR - Failed to execute job 89 for task calculate_dlr.dlr (no files to open; 4146919) [2024-04-22, 14:34:59 UTC] {local_task_job_runner.py:228} INFO - Task exited with return code 1 [2024-04-22, 14:34:59 UTC] {taskinstance.py:2778} INFO - 0 downstream tasks scheduled from follow-on schedule check