CSISS / cc

NSF EarthCube CyberConnector
http://cube.csiss.gmu.edu/CyberConnector
MIT License
13 stars 10 forks source link

Unable to successfully load .nc file from THREDDS server #58

Open sjskhalsa opened 4 years ago

sjskhalsa commented 4 years ago

https://thredds.met.no/thredds/catalog/alertness/YOPP_supersite/arpege/YOPP-NH/Tanggula/catalog.html?dataset=alertness/YOPP_supersite/arpege/YOPP-NH/Tanggula/arpege_tanggula_2018092612.nc

file passes nc checkers yet CC throws error: Screen Shot 2020-10-02 at 9 41 28 AM

scvetojevic1402 commented 4 years ago

@sjskhalsa I tried loading this file into ncWMS2 server and I get an error that the dataset doesn't have an underlying grid. Please see the entire error message below:

Status of dataset thredds (for debugging) State: ERROR Loading progress Starting loading Using dataset factory: class uk.ac.rdg.resc.edal.dataset.cdm.CdmGridDatasetFactory Error report Stack trace: uk.ac.rdg.resc.edal.exceptions.EdalException: Problem creating dataset thredds at D:\CyberConnector\ncWMS data\arpege_tanggula_2018092612.nc uk.ac.rdg.resc.edal.dataset.cdm.CdmDatasetFactory.createDataset(CdmDatasetFactory.java:115) uk.ac.rdg.resc.edal.dataset.cdm.CdmDatasetFactory.createDataset(CdmDatasetFactory.java:1) uk.ac.rdg.resc.edal.catalogue.jaxb.DatasetConfig.createDataset(DatasetConfig.java:254) uk.ac.rdg.resc.edal.catalogue.jaxb.DatasetConfig.refresh(DatasetConfig.java:213) uk.ac.rdg.resc.edal.catalogue.jaxb.CatalogueConfig$1.run(CatalogueConfig.java:154) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748)

Caused by: uk.ac.rdg.resc.edal.exceptions.DataReadingException: No grids found in underlying NetCDF dataset uk.ac.rdg.resc.edal.util.cdm.CdmUtils.getGridDataset(CdmUtils.java:123) uk.ac.rdg.resc.edal.dataset.cdm.CdmGridDatasetFactory.getNonStaggeredGriddedVariableMetadata(CdmGridDatasetFactory.java:143) uk.ac.rdg.resc.edal.dataset.cdm.CdmGridDatasetFactory.generateGridDataset(CdmGridDatasetFactory.java:134) uk.ac.rdg.resc.edal.dataset.cdm.CdmGridDatasetFactory.generateDataset(CdmGridDatasetFactory.java:124) uk.ac.rdg.resc.edal.dataset.cdm.CdmDatasetFactory.createDataset(CdmDatasetFactory.java:88) uk.ac.rdg.resc.edal.dataset.cdm.CdmDatasetFactory.createDataset(CdmDatasetFactory.java:1) uk.ac.rdg.resc.edal.catalogue.jaxb.DatasetConfig.createDataset(DatasetConfig.java:254) uk.ac.rdg.resc.edal.catalogue.jaxb.DatasetConfig.refresh(DatasetConfig.java:213) uk.ac.rdg.resc.edal.catalogue.jaxb.CatalogueConfig$1.run(CatalogueConfig.java:154) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:748)

sjskhalsa commented 4 years ago

Dear @scvetojevic1402 , Thanks so much for the reply. I am helping the WMO's Year of Polar Prediction Model-Site Intercomparison Experiment with the design of their .nc files (my part is the semantics, I'm not a netCDF expert). The idea is to have the modelers and observationalists create files with the same structure and same variable names to make intercomparison easy, and it looked like CC was the perfect tool to do quick comparisons. RIght now there are just the model outputs in the yopp data portal, but the observation files are being prepare now. The model files include just a few cells around the location of the observatory location, but the observatory files will have just one horizontal location. So, I tried to have CC read in a gridded file and CC doesn't like it either: https://thredds.met.no/thredds/catalog/mepslatest/catalog.html?dataset=mepslatest/meps_lagged_6_h_latest_2_5km_latest.nc

sjskhalsa commented 4 years ago

another gridded dataset CC is unable to ingest https://thredds.met.no/thredds/catalog/aromearcticarchive/2020/09/30/catalog.html?dataset=aromearcticarchive/2020/09/30/arome_arctic_vtk_20200930T21Z.nc

ZihengSun commented 4 years ago

Dear @sjskhalsa this should be an issue with ncWMS. It requires specific grid axis variable names. The problem has been discussed here