insarlab / MintPy-tutorial

MintPy tutorials in Jupyter Notebook
https://mintpy.readthedocs.io/
GNU General Public License v3.0
111 stars 52 forks source link

ERA5 data cannot be downloaded in mintpy-(jupyter notebook) #66

Open zhangxing-sigma opened 1 month ago

zhangxing-sigma commented 1 month ago

Unable to download ERA5 data in correct-troposphere step. Unable to download data due to update of CDS URL and key. Unable to connect to new URL, always connected to old URL during operation. error: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2 WARNING: the 1 attempt to download failed, retry it.

https://cds.climate.copernicus.eu/api/v2 is old URL

codeautopilot[bot] commented 1 month ago

Your repository exceeds the current size limit of 4MB. You can fix this by ignoring files/folders: https://docs.codeautopilot.com/configuring-autopilot#excluding-files-and-folders

zhangxing-sigma commented 1 month ago

script: correct_tropo = "Perform" in tropo_choice.value or "Rerun" in tropo_choice.value era5_path = mint_path/"ERA5" timeseries_era5_path = mint_path/"timeseries_ERA5.h5" inputs_era5_path = mint_path/"inputs/ERA5.h5"

if "Delete" in tropo_choice.value: for f in [timeseries_era5_path, inputs_era5_path]: try: f.unlink() except FileNotFoundError: pass try: shutil.rmtree(era5_path) except FileNotFoundError: pass

if correct_tropo: set_troposhperic_correction_mintpy(config_path, "pyaps") !smallbaselineApp.py $config_path --work-dir {mint_path} --dostep load_data !smallbaselineApp.py $config_path --work-dir {mint_path} --dostep correct_troposphere else: set_troposhperic_correction_mintpy(config_path, "no") !smallbaselineApp.py $config_path --work-dir {mint_path} --dostep load_data full error: downloading weather model data using PyAPS ... number of grib files to download: 7

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2 WARNING: the 1 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2 WARNING: the 2 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api/v2


WARNING: downloading failed for 3 times, stop trying and continue.


EJFielding commented 1 month ago

Are you using the most recent version of MintPy and PyAPS3?

zhangxing-sigma commented 1 month ago

I have used the latest PyAPS3, but the problem still persists and I am unable to download it. I saw the new announcement released by CDS, do you want to replace the URL.

Today 26th September 2024, CDS-Beta has officially become the new CDS:

https://cds.climate.copernicus.eu/ The legacy system is now decommissioned and no longer accessible. All API requests attempting to retrieve data from the legacy system will systematically fail. However, no further support will be provided on the legacy system.

If you are a CDS-beta API user, requests will be automatically redirected from the beta URL to the proper one until 20th October 2024. You are advised to update the URL in your .cdsapirc file at your earliest convenience by 20th October 2024 (login here 228 to check URL to use in .cdsapirc file).

url: [https://cds-beta.climate.copernicus.eu/api to (https://cds-beta.climate.copernicus.eu/api) → url: https://cds.climate.copernicus.eu/api key: xx-xx-xx-xx-xx

Following the CDS-Beta phase, the new CDS is in its early days of full operations and still undergoing enhancements and fine tuning. Some disruptions are to be expected with the implementation of improvements. Some issues are yet to be fully addressed: for example we are aware of unexpectedly long queue times and are actively working at improving the situation.

We thank you all again for your patience during this significant modernisation of our Data Stores and eagerly await for your constructive feedback 9. Your feedback is key to improve the user experience on the new CDS for the benefit of everyone.

Thank you.

ECMWF Support on behalf of the Data Stores team