search

eurec4a / eurec4a-intake

Intake catalogue for EUREC4A field campaign datasets
17 stars 19 forks source link

Add further BCO isotope product #153

Open observingClouds opened 10 months ago

observingClouds commented 10 months ago
observingClouds commented 10 months ago

@leonie-villiger I encountered an issue with the PICARRO dataset. The time dimension has an unsupported unit leading to an error in the CI but also when opening the dataset with common tools like panoply as the time dimension cannot be interpreted. Could you change that and release a new version of the dataset?

netcdf EUREC4A_BCO_PICARRO_WVISOS_L1.nc {
  dimensions:
    time = 51838;
  variables:
    double time(time=51838);
      :units = "seconds since 19700101_00";

seconds since 1970-01-01 00:00:00 would work for example if the time is given in UTC. Please have a look at the time dimension information given in CF-Conventions which are widely supported.

observingClouds commented 10 months ago

@leonie-villiger I also encountered an issue with the rainwater isotope product. The variable flag has the type long (int64). This is generally fine but when accessing the file via OPeNDAP this causes an issue because the datatype is not supported. AERIS provides this access to your dataset via this protocol (see Download | Data access section at https://doi.org/10.25326/242) and we generally try to access these datasets the same way as it allows us to load the datasets lazily, i.e. do not need to download the entire dataset.

Looking at the dataset it seems the flag has only the values [0,1,2] so you could just use short (int16) instead. @d70-t has put together a nice overview about problematic data types at https://howto.eurec4a.eu/netcdf_datatypes.html

Could you look into this as well a release a version of the dataset with a different datatype? In this particular case, we might also use a different access protocol to circumvent this issue because the dataset is in total only 21KB 🤣 and downloading the entire dataset does not hurt.

leonie-villiger commented 9 months ago

@observingClouds: working on both issues. I will let you know as soon as we succeeded releasing new versions of the datasets