search

pytroll / satpy

Python package for earth-observing satellite data processing
http://satpy.readthedocs.org/en/latest/
GNU General Public License v3.0
1.05k stars 289 forks source link

`scn.load(scn.available_dataset_ids())` fails with KeyError (thrown by xarray) for nwcsaf-geo #1148

Open gerritholl opened 4 years ago

gerritholl commented 4 years ago

Describe the bug

When loading a Scene with the nwcsaf-geo reader and trying to load all available datasets using scn.load(scn.available_dataset_ids()), a KeyError is thrown. Several other datasets also fail to load with suppressed KeyErrors.

To Reproduce

# Your code here
from satpy import Scene
from glob import glob
from satpy.utils import debug_on
debug_on()
scn = Scene(filenames={"nwcsaf-geo": glob("/media/nas/x21308/scratch/NWCSAF/20200106/*/*100000Z.nc")})
scn.load(scn.available_dataset_ids())

Expected behavior

I expect all available datasets to be loaded successfully and preferably without warnings.

Actual results

It fails with a KeyError exception and a traceback ultimate thrown by xarray.core.dataset._get_virtual_variable. The error is KeyError: 'ihsai_status_flag'. The full console output (stdout + stderr):

``` [DEBUG: 2020-04-15 15:41:15 : satpy.scene] Setting 'PPP_CONFIG_DIR' to '/home/gholl/checkouts/satpy/satpy/etc/' [DEBUG: 2020-04-15 15:41:15 : satpy.readers] Reading ['/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/etc/readers/nwcsaf-geo.yaml', '/home/gholl/checkouts/satpy/satpy/etc/readers/nwcsaf-geo.yaml'] [DEBUG: 2020-04-15 15:41:15 : satpy.readers.yaml_reader] Assigning to nwcsaf-geo: ['/media/nas/x21308/scratch/NWCSAF/20200106/CMA/S_NWC_CMA_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CMA/S_NWC_CMA_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/ media/nas/x21308/scratch/NWCSAF/20200106/CT/S_NWC_CT_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CT/S_NWC_CT_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CTTH/S_NWC_CTTH_MSG4_EUROPE-B-VISIR_20200106T100 000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CTTH/S_NWC_CTTH_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CMIC/S_NWC_CMIC_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/PC/S_NWC_PC_MSG4_EUROPE-B-VI SIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CRR/S_NWC_CRR_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/iSHAI/S_NWC_iSHAI_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CI/S_NWC_CI _MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/RDT/S_NWC_RDT-CW_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/ASII/S_NWC_ASII-NG_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc'] [WARNING: 2020-04-15 15:41:16 : satpy.readers] Don't know how to open the following files: {'/media/nas/x21308/scratch/NWCSAF/20200106/PC/S_NWC_PC-Ph_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CRR/S_NWC_CRR-Ph_MSG4_EUROPE-B-VISIR_20200106T1 00000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/PLAX/S_NWC_PLAX_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc'} [DEBUG: 2020-04-15 15:41:16 : satpy.composites] Looking for composites config file seviri.yaml [DEBUG: 2020-04-15 15:41:16 : satpy.composites] Looking for composites config file visir.yaml /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ci_prob90. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_conditions. [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_gw' not found or loaded for 'asiigw_quality' /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_reff. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='ishai_diffki_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_diffki_pal. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='crr_accum_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading crr_accum_pal. [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Failed to load DatasetID(name='crr_accum_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) from Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1164, in _construct_dataarray variable = self._variables[name] KeyError: 'crr_accum_pal' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 614, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/nwcsaf_nc.py", line 136, in get_dataset variable = self.nc[dsid_name] File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1254, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1166, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 167, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'crr_accum_pal' [ERROR: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Could not load dataset 'DatasetID(name='crr_accum_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=())': "Could not load DatasetID(name='crr_accum_pal', wavelength=None, resol ution=3000, polarization=None, calibration=None, level=None, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 753, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 638, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 623, in _load_dataset raise KeyError( KeyError: "Could not load DatasetID(name='crr_accum_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) from any provided files" [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_gw' not found or loaded for 'asii_turb_wave_prob' [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='ci_prob_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ci_prob_pal. [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Failed to load DatasetID(name='ci_prob_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) from Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1164, in _construct_dataarray variable = self._variables[name] KeyError: 'ci_prob_pal' During handling of the above exception, another exception occurred: Traceback (most recent call last): [123/212] File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 614, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/nwcsaf_nc.py", line 136, in get_dataset variable = self.nc[dsid_name] File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1254, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1166, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 167, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'ci_prob_pal' [ERROR: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Could not load dataset 'DatasetID(name='ci_prob_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=())': "Could not load DatasetID(name='ci_prob_pal', wavelength=None, resolutio n=3000, polarization=None, calibration=None, level=None, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 753, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 638, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 623, in _load_dataset raise KeyError( KeyError: "Could not load DatasetID(name='ci_prob_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) from any provided files" /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading crr. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ci_quality. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_cot. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='ishai_bl_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_bl_pal. [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_gw' not found or loaded for 'asiigw_conditions' [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='ctth_pres_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ctth_pres_pal. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ctth_pres_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_residual. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_ki. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cmic_phase_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_phase_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading pc. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cma_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_pal. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading crr_intensity. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cmic_lwp_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_lwp_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_diffbl. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='ishai_diffhl_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_diffhl_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_difftpw. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cmic_reff_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_reff_pal. [WARNING: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asiitf_quality' [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cmic_iwp_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_iwp_pal. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_phase. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_hl. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_li. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cmic_iwp. /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyresample/utils/__init__.py:33: UserWarning: 'get_area_def' has moved, import it with 'from pyresample import get_area_def' warnings.warn("'get_area_def' has moved, import it with 'from pyresample import get_area_def'") /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordin ate-reference-systems proj_string = self.to_proj4() [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading ishai_diffshw. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.yaml_reader] No coordinates found for DatasetID(name='cma_cloudsnow_pal', wavelength=None, resolution=3000, polarization=None, calibration=None, level=None, modifiers=()) [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow_pal. [DEBUG: 2020-04-15 15:41:16 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow_pal. Traceback (most recent call last): File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1164, in _construct_dataarray variable = self._variables[name] KeyError: 'MapCell_quality' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "mwe33.py", line 6, in scn.load(scn.available_dataset_ids()) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 971, in load self.read(**kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 880, in read return self._read_datasets(nodes, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/scene.py", line 721, in _read_datasets new_datasets = reader_instance.load(ds_ids, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 843, in load ds = self._load_dataset_with_area(dsid, coords, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 750, in _load_dataset_with_area area = self._load_dataset_area(dsid, file_handlers, coords, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 732, in _load_dataset_area return self._load_area_def(dsid, file_handlers, **kwargs) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 661, in _load_area_def return _load_area_def(dsid, file_handlers) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 855, in _load_area_def area_defs = [fh.get_area_def(dsid) for fh in file_handlers] File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/yaml_reader.py", line 855, in area_defs = [fh.get_area_def(dsid) for fh in file_handlers] File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/satpy/readers/nwcsaf_nc.py", line 269, in get_area_def nlines, ncols = self.nc[dsid.name].shape File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1254, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1166, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 167, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'MapCell_quality' ```

Environment Info:

``` Readers ======= abi_l1b: ok abi_l1b_scmi: ok abi_l2_nc: ok acspo: ok agri_l1: ok ahi_hrit: ok ahi_hsd: ok ami_l1b: ok amsr2_l1b: ok avhrr_l1b_aapp: ok avhrr_l1b_eps: ok avhrr_l1b_gaclac: cannot find module 'satpy.readers.avhrr_l1b_gaclac' (No module named 'pygac') avhrr_l1b_hrpt: cannot find module 'satpy.readers.hrpt' (No module named 'pygac') caliop_l2_cloud: ok clavrx: ok electrol_hrit: ok fci_l1c_fdhsi: ok generic_image: ok geocat: ok ghrsst_l3c_sst: ok glm_l2: ok goes-imager_hrit: ok goes-imager_nc: ok grib: cannot find module 'satpy.readers.grib' (No module named 'pygrib') hsaf_grib: cannot find module 'satpy.readers.hsaf_grib' (No module named 'pygrib') hy2_scat_l2b_h5: ok iasi_l2: ok iasi_l2_so2_bufr: cannot find module 'satpy.readers.iasi_l2_so2_bufr' (('Missing eccodes-python and/or eccodes C-library installation. Use conda to install eccodes.\n Error: ', ModuleNotFoundError("No module named 'eccodes'"))) jami_hrit: ok li_l2: cannot find module 'satpy.readers.li_l2' (No module named 'h5netcdf') maia: ok mersi2_l1b: ok mimicTPW2_comp: ok modis_l1b: ok modis_l2: ok msi_safe: cannot find module 'satpy.readers.msi_safe' (No module named 'glymur') mtsat2-imager_hrit: ok nucaps: ok nwcsaf-geo: ok nwcsaf-msg2013-hdf5: ok nwcsaf-pps_nc: ok olci_l1b: ok olci_l2: ok omps_edr: ok safe_sar_l2_ocn: ok sar-c_safe: ok scatsat1_l2b: ok seviri_l1b_hrit: ok seviri_l1b_icare: ok seviri_l1b_native: ok seviri_l1b_nc: ok seviri_l2_bufr: cannot find module 'satpy.readers.seviri_l2_bufr' (Missing eccodes-python and/or eccodes C-library installation. Use conda to install eccodes) seviri_l2_grib: cannot find module 'satpy.readers.seviri_l2_grib' (Missing eccodes-python and/or eccodes C-library installation. Use conda to install eccodes) slstr_l1b: ok slstr_l2: ok tropomi_l2: ok vaisala_gld360: ok viirs_compact: ok viirs_edr_active_fires: ok viirs_edr_flood: ok viirs_l1b: ok viirs_sdr: ok virr_l1b: ok Writers ======= /data/gholl/miniconda3/envs/py38/lib/python3.8/site-packages/pyninjotiff/tifffile.py:154: UserWarning: failed to import the optional _tifffile C extension module. Loading of some compressed images will be slow. Tifffile.c can be obtained at http://www.lfd.uci.edu/~gohlke/ warnings.warn( cf: ok geotiff: ok mitiff: ok ninjotiff: ok scmi: ok simple_image: ok Extras ====== cartopy: ok geoviews: No module named 'geoviews' ```

Additional context

To test which ones fail, I tried to run

from satpy import Scene
from glob import glob
scn = Scene(filenames={"nwcsaf-geo": glob("/media/nas/x21308/scratch/NWCSAF/20200106/*/*100000Z.nc")})

for dsid in scn.available_dataset_ids():
    try:
        scn.load([dsid])
    except KeyError:
        print(dsid.name)

but I got inconsistent results between runs; some datasets may fail with KeyError, perhaps depending on the order in which they are attempted to be loaded. The exception can also be triggered by loading just "ihsai_status_flag".

djhoese commented 4 years ago

So that sounds like your files (the most up to date version of these files?) do not support all the variables that are configured for the reader. If the reader isn't dynamically loading datasets (available_datasets in the reader) then this is expected in my opinion.

The fix would be to update the reader to tell the difference between the file types and define datasets as belonging to a particular file type. When that file type isn't available the base reader should already automatically filter those out as "not available".

gerritholl commented 4 years ago

By expected, do you mean desirable, or "an expected bug" due to a limitation in the reader? When a method is called available_dataset_ids and its docstring states it returns "loadable datasets" and "what files have been provided to the scene" then I would expect that the list of IDs returned are available and loadable.

djhoese commented 4 years ago

Expected bug due to a limitation in the reader.

gerritholl commented 2 years ago

At some point between Satpy 0.21 and Satpy 0.34, the situation has changed. With Satpy 0.34, the MCVE results in what appears to be an infinite loop, which is worse than KeyError.

Full output until interrupted ``` [DEBUG: 2022-02-23 14:53:07 : satpy.readers.yaml_reader] Reading ('/data/gholl/checkouts/satpy/satpy/etc/readers/nwcsaf-geo.yaml',) [DEBUG: 2022-02-23 14:53:07 : satpy.readers.yaml_reader] Assigning to nwcsaf-geo: ['/media/nas/x21308/scratch/NWCSAF/20200106/CMA/S_NWC_CMA_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CMA/S_NWC_CMA_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CT/S_NWC_CT_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CT/S_NWC_CT_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CTTH/S_NWC_CTTH_MSG4_EUROATL-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CTTH/S_NWC_CTTH_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CMIC/S_NWC_CMIC_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/PC/S_NWC_PC_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CRR/S_NWC_CRR_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/iSHAI/S_NWC_iSHAI_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CI/S_NWC_CI_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/RDT/S_NWC_RDT-CW_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/ASII/S_NWC_ASII-NG_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc'] /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/backends/plugins.py:105: DeprecationWarning: SelectableGroups dict interface is deprecated. Use select. entrypoints = entry_points().get("xarray.backends", ()) [WARNING: 2022-02-23 14:53:08 : satpy.readers] Don't know how to open the following files: {'/media/nas/x21308/scratch/NWCSAF/20200106/PC/S_NWC_PC-Ph_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/CRR/S_NWC_CRR-Ph_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc', '/media/nas/x21308/scratch/NWCSAF/20200106/PLAX/S_NWC_PLAX_MSG4_EUROPE-B-VISIR_20200106T100000Z.nc'} [DEBUG: 2022-02-23 14:53:08 : satpy.composites.config_loader] Looking for composites config file seviri.yaml [DEBUG: 2022-02-23 14:53:08 : satpy.composites.config_loader] Looking for composites config file visir.yaml [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_effectiv_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_effectiv_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ctth_effectiv_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_alti_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_alti_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ctth_alti_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cmic_conditions. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading crr_accum_pal. [WARNING: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] Failed to load DataID(name='crr_accum_pal', resolution=3000, modifiers=()) from Traceback (most recent call last): File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray variable = self._variables[name] KeyError: 'crr_accum_pal' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset variable = self.nc[file_key] File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1497, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1395, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 168, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'crr_accum_pal' [ERROR: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] Could not load dataset 'DataID(name='crr_accum_pal', resolution=3000, modifiers=())': "Could not load DataID(name='crr_accum_pal', resolution=3000, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 851, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 723, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 708, in _load_dataset raise KeyError( KeyError: "Could not load DataID(name='crr_accum_pal', resolution=3000, modifiers=()) from any provided files" [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_tpw. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_tempe_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_tempe_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ctth_tempe_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_alti. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_alti. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cmic_lwp_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cmic_lwp_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading pc_conditions. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ct. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ct. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_bl. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading crr_intensity_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='crr_intensity_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_ml. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_tpw_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_tpw_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ci_quality. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_bl_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_bl_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_diffli_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffli_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ci_prob60. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_li_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_li_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_residual. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cmic_reff. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_diffki_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffki_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cmic_cot_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cmic_cot_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_diffml_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffml_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ci_prob30. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_ki_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_ki_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_status_flag. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_status_flag. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cma_dust_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cma_dust_pal. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cma_dust_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_tempe. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ctth_tempe. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ct_quality. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ct_quality. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading cmic_cot. [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading MapCell_conditions. [WARNING: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] Failed to load DataID(name='MapCell_conditions', resolution=3000, modifiers=()) from Traceback (most recent call last): File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray variable = self._variables[name] KeyError: 'MapCell_conditions' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset variable = self.nc[file_key] File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1497, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1395, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 168, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'MapCell_conditions' [ERROR: 2022-02-23 14:53:08 : satpy.readers.yaml_reader] Could not load dataset 'DataID(name='MapCell_conditions', resolution=3000, modifiers=())': "Could not load DataID(name='MapCell_conditions', resolution=3000, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 851, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 723, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 708, in _load_dataset raise KeyError( KeyError: "Could not load DataID(name='MapCell_conditions', resolution=3000, modifiers=()) from any provided files" [DEBUG: 2022-02-23 14:53:08 : satpy.readers.nwcsaf_nc] Reading ishai_diffskt. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading MapCellCatType. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffki. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffli. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_li. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_method. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_method. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_residual_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_residual_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_volcanic_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_volcanic_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cma_volcanic_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_ki. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_accum. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading pc_quality. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffbl_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffbl_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cma_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ihsai_status_flag. [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Failed to load DataID(name='ihsai_status_flag', resolution=3000, modifiers=()) from Traceback (most recent call last): File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray variable = self._variables[name] KeyError: 'ihsai_status_flag' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset variable = self.nc[file_key] File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1497, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1395, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 168, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'ihsai_status_flag' [ERROR: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Could not load dataset 'DataID(name='ihsai_status_flag', resolution=3000, modifiers=())': "Could not load DataID(name='ihsai_status_flag', resolution=3000, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 851, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 723, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 708, in _load_dataset raise KeyError( KeyError: "Could not load DataID(name='ihsai_status_flag', resolution=3000, modifiers=()) from any provided files" [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_reff_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cmic_reff_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffshw_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffshw_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_dust. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_dust. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_quality. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffhl_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffhl_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_phase_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cmic_phase_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffskt_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_diffskt_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cma_cloudsnow_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ci_status_flag. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_status_flag. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ci_prob90. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='crr_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffbl. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffhl. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_skt. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_conditions. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffshw. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_quality. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_quality. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_volcanic. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_volcanic. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_quality. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_toz_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_toz_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_diffml. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_skt_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_skt_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_status_flag. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_status_flag. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_cumuliform. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_cumuliform. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_shw. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cma_cloudsnow. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_conditions. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr_intensity. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_difftoz. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading crr. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ci_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_iwp. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading asii_turb_trop_prob. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_hl. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_status_flag. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading pc. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_toz. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_difftoz_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_difftoz_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_ml_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_ml_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_shw_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_shw_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading MapCell_quality. [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Failed to load DataID(name='MapCell_quality', resolution=3000, modifiers=()) from Traceback (most recent call last): File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray variable = self._variables[name] KeyError: 'MapCell_quality' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset variable = self.nc[file_key] File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1497, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1395, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 168, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'MapCell_quality' [ERROR: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Could not load dataset 'DataID(name='MapCell_quality', resolution=3000, modifiers=())': "Could not load DataID(name='MapCell_quality', resolution=3000, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 851, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 723, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 708, in _load_dataset raise KeyError( KeyError: "Could not load DataID(name='MapCell_quality', resolution=3000, modifiers=()) from any provided files" [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ci_prob_pal. [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Failed to load DataID(name='ci_prob_pal', resolution=3000, modifiers=()) from Traceback (most recent call last): File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray variable = self._variables[name] KeyError: 'ci_prob_pal' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset projectable = fh.get_dataset(dsid, ds_info) File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset variable = self.nc[file_key] File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1497, in __getitem__ return self._construct_dataarray(key) File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1395, in _construct_dataarray _, name, variable = _get_virtual_variable( File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 168, in _get_virtual_variable ref_var = variables[ref_name] KeyError: 'ci_prob_pal' [ERROR: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Could not load dataset 'DataID(name='ci_prob_pal', resolution=3000, modifiers=())': "Could not load DataID(name='ci_prob_pal', resolution=3000, modifiers=()) from any provided files" Traceback (most recent call last): File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 851, in _load_dataset_with_area ds = self._load_dataset_data(file_handlers, dsid, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 723, in _load_dataset_data proj = self._load_dataset(dsid, ds_info, file_handlers, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 708, in _load_dataset raise KeyError( KeyError: "Could not load DataID(name='ci_prob_pal', resolution=3000, modifiers=()) from any provided files" [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_hl_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_hl_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_effectiv. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_effectiv. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading MapCellCatType_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='MapCellCatType_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_conditions. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_conditions. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ci_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ci_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_difftpw_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ishai_difftpw_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading pc_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='pc_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_pres. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_pres. /data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/pyproj/crs/crs.py:1256: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems return self._crs.to_proj4(version=version) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_iwp_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='cmic_iwp_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ct_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_difftpw. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_lwp. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading cmic_phase. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_pres_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ctth_pres_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ctth_pres_pal', resolution=3000, modifiers=()) [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ishai_quality. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_cumuliform_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.nwcsaf_nc] Reading ct_cumuliform_pal. [DEBUG: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] No coordinates found for DataID(name='ct_cumuliform_pal', resolution=3000, modifiers=()) [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ct_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset cma_quality [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset cma_quality [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset cma_quality [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ct_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset cma_quality [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset asiing_conditions [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset asiing_quality [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Can't load ancillary dataset ishai_status_flag [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:09 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:10 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:11 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:12 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:13 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:14 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:15 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:16 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:17 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:18 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:19 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type 'nc_nwcsaf_asii_tf' not found or loaded for 'asii_turb_trop_prob_status_flag' [WARNING: 2022-02-23 14:53:20 : satpy.readers.yaml_reader] Required file type '['nc_nwcsaf_asii_tf', 'nc_nwcsaf_asii_gw']' not found or loaded for 'asii_turb_prob_pal' Traceback (most recent call last): File "/data/gholl/checkouts/protocode/mwe/nwcsaf-infinite-loop.py", line 6, in scn.load(scn.available_dataset_ids()) File "/data/gholl/checkouts/satpy/satpy/scene.py", line 1259, in load self._read_datasets_from_storage(**kwargs) File "/data/gholl/checkouts/satpy/satpy/scene.py", line 1281, in _read_datasets_from_storage return self._read_dataset_nodes_from_storage(nodes, **kwargs) File "/data/gholl/checkouts/satpy/satpy/scene.py", line 1287, in _read_dataset_nodes_from_storage loaded_datasets = self._load_datasets_by_readers(reader_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/scene.py", line 1312, in _load_datasets_by_readers new_datasets = reader_instance.load(ds_ids, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables self.load(loadable_av_ids, previous_datasets=datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load self._load_ancillary_variables(all_datasets, **kwargs) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 877, in _load_ancillary_variables all_av_ids = self._gather_ancillary_variables_ids(datasets) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 906, in _gather_ancillary_variables_ids av_ids.append(self.get_dataset_key(key)) File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 940, in get_dataset_key return get_key(key, self.available_dataset_ids, **kwargs) File "/data/gholl/checkouts/satpy/satpy/dataset/data_dict.py", line 105, in get_key res = key.filter_dataids(key_container) File "/data/gholl/checkouts/satpy/satpy/dataset/dataid.py", line 591, in filter_dataids keys = list(filter(self._match_dataid, dataid_container)) File "/data/gholl/checkouts/satpy/satpy/dataset/dataid.py", line 597, in _match_dataid if self._shares_required_keys(dataid): KeyboardInterrupt ```
djhoese commented 2 years ago

Wow, very interesting. So for the first set of issues we see errors/tracebacks like this:

  File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 699, in _load_dataset
    projectable = fh.get_dataset(dsid, ds_info)
  File "/data/gholl/checkouts/satpy/satpy/readers/nwcsaf_nc.py", line 144, in get_dataset
    variable = self.nc[file_key]

And:

Traceback (most recent call last):
  File "/data/gholl/mambaforge/envs/py310/lib/python3.10/site-packages/xarray/core/dataset.py", line 1393, in _construct_dataarray
    variable = self._variables[name]
KeyError: 'crr_accum_pal'

These are clearly (I think) the reader thinking that a variable should be in the file, but it isn't. This is the same general issue as the original problem where the reader isn't "smart" enough to say "this variable could be loaded from the file, but this version of the file doesn't have it".

The bigger issue as you've pointed out is the infinite ancillary loading:

  File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 882, in _load_ancillary_variables
    self.load(loadable_av_ids, previous_datasets=datasets, **kwargs)
  File "/data/gholl/checkouts/satpy/satpy/readers/yaml_reader.py", line 968, in load
    self._load_ancillary_variables(all_datasets, **kwargs)

So this is the result of the main variable loading having one or more variables listed as ancillary variables that need to be loaded. My best guess is that the files have a circular set of dependencies between two or more variables. Can you show the ncdump -h of the file? Or a portion of it? The fix for this would be either:

  1. Refactor the ancillary variable loading so it isn't recursive or at least knows what variables were attempted in loading regardless of whether or not they failed to load.
  2. Update the file handler to not allow the circular dependence of the ancillary variables from the file (modify the DataArray metadata).

I think both might be a good idea.