kappazeta / km_predict

S2 full image prediction
Apache License 2.0
20 stars 9 forks source link

Products not found #30

Open adelenelai opened 1 month ago

adelenelai commented 1 month ago

Hello, there's a problem during download as some products are not found on sentinelhub e.g., for S2A_MSIL2A_20190619T103031_N0500_R108_T32TLS_20230805T044707

File "/usr/local/lib/python3.11/dist-packages/sentinelhub/download/handlers.py", line 46, in new_download_func
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142]     raise DownloadFailedException(
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142] sentinelhub.exceptions.DownloadFailedException: Failed to download from:
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142] https://roda.sentinel-hub.com/sentinel-s2-l2a/products/2019/6/19/S2A_MSIL2A_20190619T103031_N0500_R108_T32TLS_20230805T044707/productInfo.json
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142] with HTTPError:
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142] 404 Client Error: Not Found for url: https://roda.sentinel-hub.com/sentinel-s2-l2a/products/2019/6/19/S2A_MSIL2A_20190619T103031_N0500_R108_T32TLS_20230805T044707/productInfo.json
[2024-07-05, 08:57:04 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-05 08:56:55,142] Server response: ""

Is there a workaround for this?

indrek-sunter commented 1 month ago

Hello,

A workaround might be to use other data platforms for the products. However, the data formats might vary across the platforms. KappaMask expects the .SAFE format.

It seems that the product is present on Copernicus Browser and can be downloaded in the .SAFE format from there. I have not looked into their API yet, but it should be possible to implement the download of products from the Copernicus Dataspace.

adelenelai commented 1 month ago

thanks a lot

indrek-sunter commented 1 month ago

I think this workaround would be outside the scope of the KappaMask base image though. You could implement it as an additional script in a derived Docker image. I hope this is alright.