search

ideas-lab-nus / epwshiftr

Create future EnergyPlus Weather files using CMIP6 data
https://ideas-lab-nus.github.io/epwshiftr/
Other
30 stars 7 forks source link

downloading CMIP6 models get sutck with some variables #56

Open IsaakBM opened 2 years ago

IsaakBM commented 2 years ago

Hello! I've been having issues downloading models. For some reason, it get stuck in most of the files that I've tried to pull. See some examples using this code for the variable o2.

Thanks for any help!

idx <- init_cmip6_index(
  # only consider ScenarioMIP activity
    activity = "ScenarioMIP",
  # specify dry-bulb temperature and relative humidity
    variable = "o2",
  # specify report frequent
    frequency = "mon",
  # specify experiment name
    experiment = c("ssp126", "ssp245", "ssp585"),
  # specify GCM name
    source = NULL,
  # specify variant
    variant = "r1i1p1f1",
  # More options
    replica = FALSE,
    latest = TRUE,
    resolution = NULL,
    data_node = NULL,
  # specify years of interest
    years = c(seq(2022, 2100, 1)),
  # save to data dictionary
    save = TRUE,
)

esm <- idx$file_url[1]

download.file(url = esm[1],
              destfile = paste0("inputs/o2/", basename(esm[1])),
              cacheOK = TRUE,
              extra = "--random-wait --retry-on-http-error=503",
              mode = "wb")
hongyuanjia commented 2 years ago

Hi. Sorry for the late. The data nodes that hold the CMIP experiment results sometimes can down. You can run get_data_node() to see if that specific data node went down at the current time. This probably is the reason.

                    data_node status
                       <char> <char>
 1:            aims3.llnl.gov     UP
 2:           cmip.bcc.cma.cn     UP
 3:          cordexesg.dmi.dk     UP
 4:     crd-esgf-drc.ec.gc.ca     UP
 5:      data.meteo.unican.es     UP
 6:    dpesgf03.nccs.nasa.gov     UP
 7:   esg-cccr.tropmet.res.in     UP
 8:        esg-dn1.nsc.liu.se     UP
 9:          esg-dn1.ru.ac.th     UP
10:        esg-dn2.nsc.liu.se     UP
11:            esg.camscma.cn     UP
12:            esg.lasg.ac.cn     UP
13:        esg.pik-potsdam.de     UP
14:          esg1.umr-cnrm.fr     UP
15:          esg2.umr-cnrm.fr     UP
16:     esgdata.gfdl.noaa.gov     UP
17:    esgf-cnr.hpc.cineca.it     UP
18:          esgf-data.csc.fi     UP
19:     esgf-data1.diasjp.net     UP
20:       esgf-data1.llnl.gov     UP
21:       esgf-data2.llnl.gov     UP
22:     esgf-data3.diasjp.net     UP
23: esgf-nimscmip6.apcc21.org     UP
24:         esgf-node.cmcc.it     UP
25:        esgf-node2.cmcc.it     UP
26:              esgf.anl.gov     UP
27:           esgf.apcc21.org     UP
28:               esgf.bsc.es     UP
29:           esgf.ceda.ac.uk     UP
30:               esgf.dwd.de     UP
31:        esgf.nccs.nasa.gov     UP
32:   esgf.rcec.sinica.edu.tw     UP
33:             esgf2.dkrz.de     UP
34:         vesg.ipsl.upmc.fr     UP
35: cmip.dess.tsinghua.edu.cn   DOWN
36:           cmip.fio.org.cn   DOWN
37:  dataserver.nccs.nasa.gov   DOWN
38:      dist.nmlab.snu.ac.kr   DOWN
39:       eridanus.eoc.dlr.de   DOWN
40:        esgf-data.ucar.edu   DOWN
41:     esgf-data2.diasjp.net   DOWN
42:   esgf-ictp.hpc.cineca.it   DOWN
43:             esgf.ichec.ie   DOWN
44:           esgf.nci.org.au   DOWN
45:             esgf1.dkrz.de   DOWN
46:             esgf3.dkrz.de   DOWN
47:     noresg.nird.sigma2.no   DOWN
48:        polaris.pknu.ac.kr   DOWN
                    data_node status