JGCRI / CEDS

Community Emissions Data System (CEDS)
https://www.pnnl.gov/projects/ceds
95 stars 29 forks source link

VOC17 corrupt 1850-1899 file? #41

Open GregoryFaluvegi opened 2 years ago

GregoryFaluvegi commented 2 years ago

Hello.

I have successfully been working with files from the PNNL DataHub of individual VOCs. However, downloading a particular file: VOC17-other-arom-em-speciated-VOC-anthro_input4MIPs_emissions_CMIP_CEDS-2021-04-21-supplemental-data_gn_185001-189912.nc

(i.e. https://g-83fdd0.1beed.03c0.data.globus.org/CEDS/CEDS_gridded_data_2021-04-21/data/VOC-speciated/VOC17-other/individual_files/VOC17-other-arom-em-speciated-VOC-anthro_input4MIPs_emissions_CMIP_CEDS-2021-04-21-supplemental-data_gn_185001-189912.nc )

... seems to be significantly smaller size than e.g. the same species for 1750-1799 (not just on my machine but the size noted on PNNL DataHub). Then ncdump gives errors like below. Any chance someone can check whether this file is corrupted?

Best, Greg

globus_downloads/2021-04-21> ncdump -h VOC17-other-arom-em-speciated-VOC-anthro_input4MIPs_emissions_CMIP_CEDS-2021-04-21-supplemental-data_gn_185001-189912.nc | more
HDF5-DIAG: Error detected in HDF5 (1.10.4) thread 46912530532224:
  #000: H5F.c line 509 in H5Fopen(): unable to open file
    major: File accessibilty
    minor: Unable to open file
  #001: H5Fint.c line 1400 in H5F__open(): unable to open file
    major: File accessibilty
    minor: Unable to open file
  #002: H5Fint.c line 1700 in H5F_open(): unable to read superblock
    major: File accessibilty
    minor: Read failed
  #003: H5Fsuper.c line 623 in H5F__super_read(): truncated file: eof = 162138234, sblock->base_addr = 0, stored_eof = 559945761
    major: File accessibilty
    minor: File has been truncated
ncdump: VOC17-other-arom-em-speciated-VOC-anthro_input4MIPs_emissions_CMIP_CEDS-2021-04-21-supplemental-data_gn_185001-189912.nc: NetCDF: HDF error
hahsan1 commented 2 years ago

Hi @GregoryFaluvegi, yes something looks wrong with that file on the datahub. We'll look into it.

In the meantime, here is an ftp link where you can directly download that file: https://dtn2.pnl.gov/data/gcam/CEDS_emissions/CEDS_gridded_data_2021-04-21/VOC17-other-arom-em-speciated-VOC-anthro_input4MIPs_emissions_CMIP_CEDS-2021-04-21-supplemental-data_gn_185001-189912.nc

GregoryFaluvegi commented 2 years ago

Many thanks.