search

ESPRI-Mod / synda

ESGF Downloader (this is a deprecated repository, the tool has now moved to https://github.com/ESGF/esgf-download)
https://espri-mod.github.io/synda/
21 stars 11 forks source link

dataset name in selection file #80

Closed painter1 closed 2 years ago

painter1 commented 7 years ago

Often I have to work with a list of dataset names which we need. We want exactly those datasets, and no more. Therefore I would like to provide a list of dataset names in the selection file, e.g.

 cmip5.output1.FIO.FIO-ESM.historical.mon.atmos.Amon.r3i1p1
 cmip5.output1.ICHEC.EC-EARTH.historical.mon.atmos.Amon.r5i1p1
 cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r1i1p1
 cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r2i1p1
 cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r3i1p1
 cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r4i1p2
 cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r5i1p2
 cmip5.output1.MRI.MRI-ESM1.historical.mon.atmos.Amon.r1i1p1
 cmip5.output1.NOAA-GFDL.GFDL-CM2p1.historical.mon.atmos.Amon.r10i1p1
 cmip5.output1.NOAA-GFDL.GFDL-CM2p1.historical.mon.atmos.Amon.r1i1p1
 cmip5.output1.NOAA-GFDL.GFDL-CM2p1.historical.mon.atmos.Amon.r4i1p1
 cmip5.output1.NOAA-GFDL.GFDL-CM3.historical.mon.atmos.Amon.r4i1p1

The idea is that a single selection file, and a single "synda install" command will install all these datasets, and no more. With the present selection file format, I needed six selection files to get exactly this list of datasets.

This feature would be especially useful when a script generates the selection files.

pjournou-ipsl commented 2 years ago

Today, the only solution we can give you is to create a single selection file that contains the list of the ids of the datasets you want to install.

An example with two of them : dataset_id="cmip5.output1.ICHEC.EC-EARTH.historical.mon.atmos.Amon.r5i1p1.v20171115|esgf.ichec.ie" dataset_id="cmip5.output1.MRI.MRI-CGCM3.historical.mon.atmos.Amon.r1i1p1.v20120701|esgf-data1.diasjp.net"

Please see issue #88 for further details.