motuclient error and file download skipped

c-scale-community / workflow-coastal-hydrowaq

Porting and deploying the HiSea use case on C-SCALE

Apache License 2.0

3 stars 1 forks source link

motuclient error and file download skipped #28

Closed backeb closed 1 year ago

backeb commented 1 year ago

Referring to https://github.com/c-scale-community/use-case-hisea/blob/main/scripts/download/download_cmems_physics.py

motuclient sometimes returns the below error [ERROR] 010-1 : Sorry, the system is currently not available. Please try again later. If the error persists, please contact the service desk. As a result the file that it was trying to download is skipped.

[ ] Create functionality to ensure all data are downloaded

cc @lorincmeszaros

backeb commented 1 year ago

Resolved with

check_file = Path('/data/tmp/cmems_'+str(var)+'_'+str(day)+'.nc')
while not check_file.is_file():
   subprocess.run(['python', '-m', 'motuclient', ...

lorincmeszaros commented 1 year ago

@backeb Nice solution! I forgot to communicate that I became a member of the Copernicus Champion User Group (Deltares representative). This allows us to get our problems fixed quicker but I would also like us to communicate our C-SCALE tests and feedback to CMEMS in a meeting. Justto keep it in mind ;)

backeb commented 1 year ago

need to fix this again...

the error is here: while not check_file.is_file() or run < max_runs:

always returns True