search

ecmwf-lab / ai-models

Apache License 2.0
323 stars 44 forks source link

issue with download asset with Mars access #31

Closed seonyeongyang closed 3 months ago

seonyeongyang commented 5 months ago

I am trying to download asset data using Mars as shown in the readme, but it is failing. image

I think it's an access permission issue, correct? I used the following command: image

https://github.com/ecmwf-lab/ai-models

Do I need a commercial license to obtain this data? Is there another way to download asset data?

chengshenlian commented 5 months ago

I am currently exploring how to achieve real-time 10-day weather forecasting similar to that of the official ECMWF. According to the information I have gathered, there is approximately a five-day delay in the ERA5 dataset accessed via the CDS API. This has led me to question: if I have access to the MARS API, would it be possible to obtain data up to yesterday, thereby enabling real-time 10-day weather forecasting? Similar Issue Link: https://github.com/ecmwf-lab/ai-models/issues/18

mrydz commented 5 months ago

There is a 24hr delay on MARS input data, ai-models defaults to 12z the previous day, so if you run between 0 and 12z on the current day, it will fail since yesterday's 12z data hasn't passed its 24hr mark. You'll need to pass a date and time > 24hrs, such as --date 20240130 --time 0000

seonyeongyang commented 5 months ago

@mrydz I set it to June 1, 2023 and did it. And instead of downloading input data, I tried to download asset data that was explained as necessary for initial model execution. Could this be related too?

Isaaciwd commented 4 months ago

I'm having the same issue. When trying to install assets necessary to run a model using the "ai-models --download-assets " command the following issue is raised.

ecmwfapi.api.APIException: "ecmwf.API error 1: User 'isaaciwd@gmail.com' has no access to services/mars"

I do not need to run forecasts from the most recent MARS data, I'm fine to use CDS. I do not know why I need access to MARS to download the model assets. This happens for both panguweather and fourcastnet which are the only two I've tested so far.

JackBananas commented 4 months ago

Had the same problem with MARS so I tried with CDS. Received the following error:

requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://cds.climate.copernicus.eu/resources/reanalysis-era5-single-levels

Is this API not available?

Isaaciwd commented 4 months ago

I also tried with CDS but the operation hung for me. However, I did find that even though the MARS error is thrown while downloading assets, all the models still run properly for me. So it seems despite the error, the assets are properly downloaded.