search

pytroll / satpy

Python package for earth-observing satellite data processing
http://satpy.readthedocs.org/en/latest/
GNU General Public License v3.0
1.06k stars 293 forks source link

Cannot create a scene for OLCI data #1500

Closed simonrp84 closed 3 years ago

simonrp84 commented 3 years ago

Describe the bug Using the latest satpy master, I cannot create a Scene when trying to load OLCI data. Instead, I get: No filenames found for reader: olci_l1b

I thought this might be due to running on windows (hence \\ instead of /) in the OLCI file format names, but I tried changing the YAML file and it still doesn't work.

To Reproduce

from satpy import Scene, find_files_and_readers
from glob import glob

indir = "C:/Users/EUMETCAST#/Downloads/"
files = glob(indir + '*S3A*/*.nc')
print(len(files))
scn = Scene(files, reader='olci_l1b')

Expected behavior A scene is created based on the OLCI files found via glob.

Actual results

Don't know how to open the following files: 
{'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\removed_pixels.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa16_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa12_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa02_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa13_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa01_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa04_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\qualityFlags.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\tie_meteo.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa10_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa09_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa20_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa17_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa21_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa15_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa05_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa07_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa03_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa06_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa11_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa19_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\geo_coordinates.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa14_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\instrument_data.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\time_coordinates.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\tie_geo_coordinates.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa18_radiance.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\tie_geometries.nc', 
'C:/Users/EUMETCAST#/Downloads\\S3A_OL_1_EFR____20210102T100323_20210102T100623_20210102T114650_0179_067_022_2700_LN1_O_NR_002\\Oa08_radiance.nc'}

Environment Info:

djhoese commented 3 years ago

Try not mixing / and \\ in your glob pattern. Use os.path.join to join the two parts of the pattern and see if Satpy behaves better. Also the # in your EUMETCAST# seems...suspect (read: odd).

simonrp84 commented 3 years ago

Turns out this was a problem with the L1 data itself. For some reason the data we received had incorrect directory names (missing .SEN3 from the end). No idea what happened upstream, but at least it's not a satpy problem!

For reference, / and \\ don't present problems, and the # doesn't have an effect either. :-)

mraspaud commented 3 years ago

Or just a reason to grab #1500