ideas-lab-nus / epwshiftr

Create future EnergyPlus Weather files using CMIP6 data
https://ideas-lab-nus.github.io/epwshiftr/
Other
30 stars 7 forks source link

`data_node` input in `esgf_query()` did not work #64

Closed hongyuanjia closed 1 year ago

hongyuanjia commented 1 year ago

When execute a search that targets specific data nodes, the shards parameter should be used instead of data_node. Ref: Shard Queries

hongyuanjia commented 1 year ago

It already works. The only thing to be careful about is to pick up a sensible data node that contains the model outputs of interest.

q <- init_cmip6_index(
    activity = "ScenarioMIP",
    variable = "tas",
    frequency = "day",
    experiment = "ssp585",
    source = "AWI-CM-1-1-MR",
    variant = "r1i1p1f1",
    replica = TRUE,
    latest = TRUE,
    resolution = "100 km",
    years = 2100,
    limit = 10000L,
    data_node = "esgf-data1.llnl.gov",
    save = FALSE
)

q                                                                                                                                                    file_id
#                                                                                                                                                        <char>
# 1: CMIP6.ScenarioMIP.AWI.AWI-CM-1-1-MR.ssp585.r1i1p1f1.day.tas.gn.v20190529.tas_day_AWI-CM-1-1-MR_ssp585_r1i1p1f1_gn_20990101-20991231.nc|esgf-data1.llnl.gov
# 2: CMIP6.ScenarioMIP.AWI.AWI-CM-1-1-MR.ssp585.r1i1p1f1.day.tas.gn.v20190529.tas_day_AWI-CM-1-1-MR_ssp585_r1i1p1f1_gn_21000101-21001231.nc|esgf-data1.llnl.gov
#                                                                                      dataset_id mip_era activity_drs
#                                                                                          <char>  <char>       <char>
# 1: CMIP6.ScenarioMIP.AWI.AWI-CM-1-1-MR.ssp585.r1i1p1f1.day.tas.gn.v20190529|esgf-data1.llnl.gov   CMIP6  ScenarioMIP
# 2: CMIP6.ScenarioMIP.AWI.AWI-CM-1-1-MR.ssp585.r1i1p1f1.day.tas.gn.v20190529|esgf-data1.llnl.gov   CMIP6  ScenarioMIP
#    institution_id     source_id experiment_id member_id table_id frequency grid_label  version nominal_resolution
#            <char>        <char>        <char>    <char>   <char>    <char>     <char>   <char>             <char>
# 1:            AWI AWI-CM-1-1-MR        ssp585  r1i1p1f1      day       day         gn 20190529             100 km
# 2:            AWI AWI-CM-1-1-MR        ssp585  r1i1p1f1      day       day         gn 20190529             100 km
#    variable_id           variable_long_name variable_units datetime_start datetime_end file_size           data_node
#         <char>                       <char>         <char>         <POSc>       <POSc>     <int>              <char>
# 1:         tas Near-Surface Air Temperature              K     2099-01-01   2099-12-31  81930980 esgf-data1.llnl.gov
# 2:         tas Near-Surface Air Temperature              K     2100-01-01   2100-12-31  81927411 esgf-data1.llnl.gov
#                                                                                                                                                                                           file_url
#                                                                                                                                                                                             <char>
# 1: http://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/AWI/AWI-CM-1-1-MR/ssp585/r1i1p1f1/day/tas/gn/v20190529/tas_day_AWI-CM-1-1-MR_ssp585_r1i1p1f1_gn_20990101-20991231.nc
# 2: http://esgf-data1.llnl.gov/thredds/fileServer/css03_data/CMIP6/ScenarioMIP/AWI/AWI-CM-1-1-MR/ssp585/r1i1p1f1/day/tas/gn/v20190529/tas_day_AWI-CM-1-1-MR_ssp585_r1i1p1f1_gn_21000101-21001231.nc
#                                          dataset_pid                                       tracking_id
#                                               <char>                                            <char>

# 1: hdl:21.14100/a336f13f-a4d3-3b57-a45a-8f27f0ba01b8 hdl:21.14100/a024f82a-003b-4188-bdef-e9ad578d7c1f
# 2: hdl:21.14100/a336f13f-a4d3-3b57-a45a-8f27f0ba01b8 hdl:21.14100/483a6110-934c-474e-b715-44cd92e03317