search

Ouranosinc / miranda

A modern Python utility library for climate data collection and management
Apache License 2.0
17 stars 2 forks source link

Missing CMIP6 files #46

Closed juliettelavoie closed 2 years ago

juliettelavoie commented 2 years ago

Some files are missing in the CMIP6 datasets. Could you try to download them again, please ?

Zeitsperre commented 2 years ago

Some files are missing in the CMIP6 datasets. Could you try to download them again, please ?

* Missing 1850-1950 and 2000-2014  in  `simulations/raw/CMIP/CMIP6/global/BCC/BCC-CSM2-MR/historical/r1i1p1f1/day/tasmax/`

I can't seem to find those years. The only ones available that I can see in the ESGF database are already on disk: image

* Missing 2015-2250 in `/simulations/raw/ScenarioMIP/CMIP6/global/CSIRO-ARCCSS/ACCESS-CM2/ssp585/r1i1p1f1/day/pr/`

Presently being downloaded. Should be in our database today.

juliettelavoie commented 2 years ago

Thank you! I will try to find the contact and email the BCC-CSM2-MR people and the esgf people to ask.

juliettelavoie commented 2 years ago

If you click Show all replicas and Show all versions, you can see the 20181126 version that has everything! tasmin and pr are also the 20181126 versions. It looks like they uploaded an incomplete version of tasmax in 2020, weird...

Capture d’écran, le 2022-07-28 à 11 52 52
Zeitsperre commented 2 years ago

Weird!

Zeitsperre commented 2 years ago

Transferring files over now:

Database
└── simulation
    └── raw
        └── CMIP6
            ├── CMIP
            │   └── global
            │       └── BCC
            │           └── BCC-CSM2-MR
            │               └── historical
            │                   └── r1i1p1f1
            │                       └── day
            │                           └── tasmax
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_18500101-18741231.nc
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_18500101-18741231.vNotFound
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_18750101-18991231.nc
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_18750101-18991231.vNotFound
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_19000101-19241231.nc
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_19000101-19241231.vNotFound
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_19250101-19491231.nc
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_19250101-19491231.vNotFound
            │                               ├── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_20000101-20141231.nc
            │                               └── tasmax_day_BCC-CSM2-MR_historical_r1i1p1f1_gn_20000101-20141231.vNotFound
            └── ScenarioMIP
                └── global
                    └── CSIRO-ARCCSS
                        └── ACCESS-CM2
                            └── ssp585
                                └── r1i1p1f1
                                    └── day
                                        └── pr
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_20150101-20641231.nc
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_20150101-20641231.v20191108
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_20650101-21001231.nc
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_20650101-21001231.v20191108
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_21010101-21501231.nc
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_21010101-21501231.v20210317
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_21510101-22001231.nc
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_21510101-22001231.v20210317
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_22010101-22501231.nc
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_22010101-22501231.v20210317
                                            ├── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_22510101-23001231.nc
                                            └── pr_day_ACCESS-CM2_ssp585_r1i1p1f1_gn_22510101-23001231.v20210317