bnlawrence / cfs

Rebooting cfstore, leaner and meaner
0 stars 1 forks source link

Configuration for projects and template loading identifies b-metadata attributes to push into KeyProperties #1

Open bnlawrence opened 2 months ago

bnlawrence commented 2 months ago

Currently KeyProperties have to be the ones in the Variable Property list, but we should allow a "standard template" to upload key properties which will be re-usable.

E.g. Here is the list of proxied variables for the first variable we loaded in the canari test. Much of it could go into key properties and not be duplicated.

{"realm": "atmos", "_proxied": {"Conventions": "CF-1.11 CFA-0.6.2", "grid_label": "gn", 
"source": "HadGEM3-GC31-MM (2016):\n=aerosol: UKCA-GLOMAP-mode\n=atmos: MetUM-HadGEM3-GA7.1 (N216; 432 x 324 longitude/latitude; 85 levels; top level 85 km)\n=atmosChem: none\n=land: JULES-HadGEM3-GL7.1\n=landIce: none\n=ocean: NEMO-HadGEM3-GO6.0 (eORCA025 tripolar primarily 0.25 deg; 1440 x 1205 longitude/latitude; 75 levels; top grid cell 0-1 m)\n=ocnBgchem: none\n=seaIce: CICE-HadGEM3-GSI8 (eORCA025 tripolar primarily 0.25 deg; 1440 x 1205 longitude/latitude)", 
"project": "Coupled Climate", "grid": "Native N216 grid; 432 x 324 longitude/latitude", 
"source_index": "HadGEM3-GC31-MM", "owner": "rosalynhatcher", "experiment_id": "", "experiment": "HIST2", "parent_activity_id": "", "license": "", 
"further_info_url": "https://github.com/NCAS-CMS/canari-data", "description": "UM output", "institution": "NCAS", "parent_source_id": "CMIP6.CMIP.MOHC.HadGEM3-GC31-MM.piControl.r1i1p1f3", "parent_experiment_id": "historical", "contact": "", "branch_time_in_parent": "1950", "nominal_resolution": "100km", "parent_variant_label": "r1i1p1f3", 
"physics_index": "1", "initialization_index": "1", "parent_time_units": "days since 1850-01-01", "title": "[CANARI] GC3.1 N216 ORCA025 UM11.6", "activity_id": "CANARI-LE", "forcing_index": "3", "frequency": "", "source_type": "AOGCM", "branch_time_in_child": "1950", 
"branch_method": "micro initialisation from CMIP6 macro parent", "parent_mip_era": "CMIP6", "variant_id": "r1i1p1f3", "realization_index": "1", "name": "/mnt/lustre/a2fs-nvme/work/n02/n02/rosn02/cylc-run/u-cn134-nvme/share/cycle/19500101T0000Z/cn134a_999_6hr_u_pt_cordex_", 
"creation_date": "2024-Jan-16 20:12:29 GMT", 
"tracking_id": "2cff478b-8ad5-46f0-9824-04c03618f663", "units": "m s-1", "online_operation": "instant", "interval_operation": "6 h", "interval_write": "6 h", "_FillValue": -1073741824.0, "missing_value": -1073741824.0}}