search

Open-EO / openeo-opensearch-client

Simple opensearch client for openeo.
Apache License 2.0
0 stars 0 forks source link

Sentinel-2 phoebus files #16

Closed jdries closed 1 year ago

jdries commented 1 year ago

Still seeing these files causing issues: Error while reading: /vsis3/EODATA/Sentinel-2/MSI/L2A/2018/08/20/S2B_MSIL2A_20180820T093029_N0208_R136_T34TES_20180820T120528.SAFE//dpc/app/facilities/PHOEBUS-core/PHOEBUS-core-3.4.317/DPC/exec/data/share/wp_in_progress/fasttrack_20180820_4/app_data/step_step_EUP_FastTrack/launch_8/.33099_1534783898789/.S2B_OPER_MSI_L2A_TL_MPS__20180820T120528_A007598_T34TES_N02.08/GRANULE/L2A_T34TES_A007598_20180820T093530/IMG_DATA/R20m/T34TES_20180820T093029_SCL_20m.jp2

j-6e637a64b9fa41f9b92f3de8d0c1c1db

https://finder.creodias.eu/oldresto/api/collections/Sentinel2/search.json?box=21.657597756412194%2C46.02854700799339%2C21.95285234099209%2C46.23461502351761&sortParam=startDate&sortOrder=ascending&page=1&maxRecords=100&status=0%7C34%7C37&dataset=ESA-DATASET&productType=L2A&cloudCover=%5B0%2C95%5D&startDate=2018-03-01T00%3A00%3A00Z&completionDate=2018-10-31T23%3A59%3A59.999999999Z returned

jdries commented 1 year ago

Another one: Lost task 20.3 in stage 32.0 (TID 1123) (10.42.143.68 executor 10): java.io.IOException: Error while reading: /vsis3/EODATA/Sentinel-2/MSI/L2A/2018/06/03/S2B_MSIL2A_20180603T101019_N0208_R022_T32UQB_20180603T130307.SAFE//dpc/app/facilities/PHOEBUS-core/PHOEBUS-core-3.4.317/DPC/exec/data/share/wp_in_progress/fasttrack_20180603_5/app_data/step_step_EUP_FastTrack/launch_7/.14103_1528036131394/.S2B_OPER_MSI_L2A_TL_SGS__20180603T130307_A006483_T32UQB_N02.08/GRANULE/L2A_T32UQB_A006483_20180603T101329/IMG_DATA/R20m/T32UQB_20180603T101019_SCL_20m.jp2

EmileSonneveld commented 1 year ago

The first example seems like corrupt data. The following features where captured on the same second, and have the same area code, however, they have a different geometry. S2B_MSIL2A_20180820T093029_N0208_R136_T34TES_20180820T120528.SAFE S2B_MSIL2A_20180820T093029_N9999_R136_T34TER_20221025T001026 Probably, the processing baseline 2.08 can be ignored, as this is the one that contains invalid URLs.

This could be the same issue as in: https://github.com/Open-EO/openeo-opensearch-client/issues/15