aidanheerdegen
commented
1 month ago Here is a proposed directory structure
.
├── /g/data/vk83/experiments/inputs/access-esm1p5/
├── ocean/
│ ├── biogeochemistry/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── bgc_param.nc
│ │ ├── cfc_auscom.nc
│ │ ├── co2_obs.nc
│ │ ├── dust.nc
│ │ ├── ocmip2_abiotic_c14_atm_hist_om3_bc-1-9999.nc
│ │ ├── ocmip2_fice_monthly_om1p5_bc.nc
│ │ ├── ocmip2_press_monthly_om1p5_bc.nc
│ │ ├── ocmip2_siple_co2_atm_am2_bc-1-9999.nc
│ │ └── ocmip2_xkw_monthly_om1p5_bc.nc
│ ├── grids/
│ │ └── mosaic/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ └── grid_spec.nc
│ ├── shortwave_penetration/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ └── ssw_atten_depth.nc
│ └── tides/
│ └── global.1deg/
│ └── 2020.05.19/
│ ├── roughness_amp.nc
│ └── tideamp.nc
├── atmosphere/
│ ├── land/
│ │ ├── biogeochem/
│ │ │ └── global.1deg/
│ │ │ └── 2020.05.19/
│ │ │ ├── modis_phenology_csiro.txt
│ │ │ └── pftlookup_csiro_v16_17tiles_wtlnds.csv
│ │ ├── biogeophys/
│ │ │ └── global.1deg/
│ │ │ └── 2020.05.19/
│ │ │ ├── def_soil_params.txt
│ │ │ └── def_veg_params.txt
│ │ ├── climatology/
│ │ │ └── global.1deg/
│ │ │ └── 2020.05.19/
│ │ │ ├── qrclim.slt
│ │ │ └── qrclim.smow
│ │ ├── soiltype/
│ │ │ └── global.1deg/
│ │ │ └── 2020.05.19/
│ │ │ └── qrparm.soil_igbp_vg
│ │ └── vegetation/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ └── cable_vegfunc_N96.anc
│ ├── aerosol/
│ │ └── global.1deg/
│ │ └── 2020.05.19 /
│ │ ├── ozone_1850_ESM1.anc
│ │ ├── BC_hi_1850_ESM1.anc
│ │ ├── Bio_1850_ESM1.anc
│ │ ├── biogenic_351sm.N96L38
│ │ └── scycl_1850_ESM1_v4.anc
│ ├── chemistry/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── DMS_conc.N96
│ │ └── sulpc_oxidants_N96_L38
│ ├── grids/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── qrparm.mask
│ │ └── vertlevs_G3
│ ├── spectral/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── spec3a_lw_hadgem1_6on
│ │ └── spec3a_sw_hadgem1_6on
│ ├── forcing/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ └── volcts_18502000ave.dat
│ └── unknown/
│ ├── Ndep_1850_ESM1.anc
│ └── OCFF_1850_ESM1.anc
├── coupler/
│ ├── grids/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── areas.nc
│ │ ├── grids.nc
│ │ └── masks.nc
│ └── remapping_weights/
│ └── global.1deg/
│ └── 2020.05.19 /
│ ├── rmp_cice_to_um1t_CONSERV_FRACNNEI.nc
│ ├── rmp_cice_to_um1u_CONSERV_FRACNNEI.nc
│ ├── rmp_cice_to_um1v_CONSERV_FRACNNEI.nc
│ ├── rmp_um1t_to_cice_CONSERV_DESTAREA.nc
│ ├── rmp_um1t_to_cice_CONSERV_FRACNNEI.nc
│ ├── rmp_um1u_to_cice_CONSERV_FRACNNEI.nc
│ └── rmp_um1v_to_cice_CONSERV_FRACNNEI.nc
├── ice/
│ ├── grids/
│ │ └── global.1deg/
│ │ └── 2020.05.19/
│ │ ├── grid.nc
│ │ └── kmt.nc
│ └── climatology/
│ └── global.1deg/
│ └── 2020.05.19/
│ └── monthly_sstsss.nc
├── stash/
│ ├── stasets
│ └── STASHmasterIt is viewable/editable here*%20%20JW*KJ%3DJ%5BQ%3DX%5BXU%2BXrmp_W%5CnXJ*Y%5D.ancZ.ncj_monthly_om1p5bcZ%22%2Fg%2Fdata%2Fvk83%2Fexperiments%2F%23Xocmip2%24ts%2Faccess-esm1p5%2FW%25cice_to_um1%26_to_cice%2B_CONSERV_FRACNNEIZ%2CWgrids%3A_bc-1-9999Z%23%3Bw_hadgem1_6on%3CatmosphereW%3Dglobal.1deg%3E_params.txt%3Fclimatology%40biogeochem%5B2020.05.19%5D_1850_ESM1%01%5D%5B%40%3F%3E%3D%3C%3B%3A%2C%2B%26%25%24%23%22jZYXWUQKJ)
I have just used the version (date) as the one in the COECMS access-esm original directory tree, but I know these are much older than that in general. I've also not checked all those dates thoroughly, just assumed they were all the same, but I would check when rearranging.
@MartinDix can you take a look and tell me what you think. I have pretty much ignored the fact that this is just the pre-industrial, and and waiting for another config to see what files are common and where we might need configuration specific trees.
Note I've done away with the historical "CABLE-AUX" structure, which would entail commensurate changes to paths in the config.
MartinDix
blimlim
anton-seaice
dougiesquire
ccarouge
The ACCESS-ESM1.5 input directories inherit a structure from the COECMS experiments
Details
``` $ tree -L 3 /g/data/vk83/experiments/inputs/access-esm1p5/ /g/data/vk83/experiments/inputs/access-esm1p5/ ├── common │ └── ocean │ ├── basin_mask.nc │ ├── geothermal_heating.nc │ ├── grid_spec.nc │ ├── roughness_amp.nc │ ├── ssw_atten_depth.nc │ └── tideamp.nc └── pre-industrial ├── atmosphere │ ├── BC_hi_1850_ESM1.anc │ ├── Bio_1850_ESM1.anc │ ├── biogenic_351sm.N96L38 │ ├── CABLE-AUX-1.4 │ ├── cable_vegfunc_N96.anc │ ├── DMS_conc.N96 │ ├── Ndep_1850_ESM1.anc │ ├── OCFF_1850_ESM1.anc │ ├── ozone_1850_ESM1.anc │ ├── qrclim.slt │ ├── qrclim.smow │ ├── qrparm.mask │ ├── qrparm.soil_igbp_vg │ ├── scycl_1850_ESM1_v4.anc │ ├── SOURCES │ ├── spec3a_lw_hadgem1_6on │ ├── spec3a_sw_hadgem1_6on │ ├── stasets │ ├── STASHmaster │ ├── sulpc_oxidants_N96_L38 │ ├── vertlevs_G3 │ └── volcts_18502000ave.dat ├── coupler │ ├── areas.nc │ ├── cf_name_table.txt │ ├── grids.nc │ ├── masks.nc │ ├── rmp_cice_to_um1t_CONSERV_FRACNNEI.nc │ ├── rmp_cice_to_um1u_CONSERV_FRACNNEI.nc │ ├── rmp_cice_to_um1v_CONSERV_FRACNNEI.nc │ ├── rmp_um1t_to_cice_CONSERV_DESTAREA.nc │ ├── rmp_um1t_to_cice_CONSERV_FRACNNEI.nc │ ├── rmp_um1u_to_cice_CONSERV_FRACNNEI.nc │ └── rmp_um1v_to_cice_CONSERV_FRACNNEI.nc ├── ice │ ├── grid.nc │ ├── kmt.nc │ └── monthly_sstsss.nc ├── ocean │ ├── bgc_param.nc │ ├── cfc_auscom.nc │ ├── co2_obs.nc │ ├── dust.nc │ ├── ocmip2_abiotic_c14_atm_hist_om3_bc-1-9999.nc │ ├── ocmip2_fice_monthly_om1p5_bc.nc │ ├── ocmip2_press_monthly_om1p5_bc.nc │ ├── ocmip2_siple_co2_atm_am2_bc-1-9999.nc │ └── ocmip2_xkw_monthly_om1p5_bc.nc └── restart ├── atmosphere ├── coupler ├── ice └── ocean 15 directories, 48 files ````
They need to be rearranged to permit versioning and organised by function.
For example, the ACCESS-OM2 configurations have a top level that separates by function
and within each functional grouping it is split by extent and resolution, and then further by versions