search

CCI-Tools / cate

ESA CCI Toolbox (Cate)
MIT License
50 stars 15 forks source link

Show all ODP data sources #788

Open forman opened 6 years ago

forman commented 6 years ago

Expected behavior

Cate Desktop should show all available CCI data sources available through the ODP. Also CLI and API should list all of them.

Data sources that cannot be accessed through ODP "standard" protocols HTTP and OPeNDAP URLs should provide a URL for manual download, e.g. from FTP. GUI should display that link.

Expansion stages:

  1. If the FTP URL is known, the Cate ODP data store should make transparent use of that same as for HTTP, i.e. synchronize it locally.
  2. Ideally, CCI data sources that are known to have limited functionality in Cate should be labelled. GUI, CLI, API Desktop should display/provide those labels.

Actual behavior

Cate only shows ODP data sources for gridded data that have a NetCDF file representation. This is because we derive data sources from ODP ESGF service and expand it with metadata from ODP CSW.

Actually we should do it the other way round, query the CSW for all data sources and obtain extra meta-data and URLs for the gridded datasets from ESGF.

Steps to reproduce the problem

  1. Go to ODP web page and see all available datasets
  2. Start Cate Desktop and have a look at all available datasets in DATA SOURCES panel
  3. Recognise the difference.

Specifications

Cate 1.0 - 2.0.dev20

philipkershaw commented 6 years ago

Looks good to me:

Actually we should do it the other way round, query the CSW for all data sources and obtain extra meta-data and URLs for the gridded datasets from ESGF.

Nb. FTP is a "standard" protocol for the ODP :)