this issue is so there's a place to discuss what we decide to do with the /glade/p files
Use case
/glade/p/ is going away. much of what's there that is owned by current group members needs to be maintained. the process for generating reanalysis obs is there in the Observations dir. the DART_test_cases directory has restart/initial files for many models both for our testing and for local users who make use of our test files. this is separate from the RDA_strawman directory although there may be some minor overlap. here is a list of which models have initial/restart files for running filter for testing:
cheyenne2> cd DART_test_cases/
cheyenne2> ls -l
total 8375142
drwxrwxr-x+ 4 nancy dart 4096 Nov 11 2015 bgrid
-rwxrwxr-x+ 1 1742 dart 9162 Jun 30 2021 bundle_test_data.sh
drwxrwxr-x+ 4 nancy dart 4096 Feb 15 2017 cam
drwxrwxr-x+ 6 nancy dart 4096 May 7 2019 cice
-rwxrwxr-x+ 1 nancy p86850054 669 Aug 22 2019 clean_test_build_datasets.sh
drwxrwxr-x+ 5 nancy dart 4096 Aug 28 2017 clm
drwxrwxr-x+ 4 nancy dart 4096 May 26 2016 cm1
drwxrwxr-x+ 3 nancy dart 4096 Dec 27 2017 coamps_nest
drwxr-xr-x+ 6 15717 ncar 4096 Jul 20 2020 CRTM
-rw-r--r--+ 1 1742 dart 18285334 Apr 10 2019 DART_matlab_test.tgz
drwxrwxr-x+ 4 nancy p86850054 4096 Dec 12 2019 gitm
drwxrwxr-x+ 3 nancy dart 4096 May 28 2017 lmdz
drwxr-xr-x+ 4 1742 p86850054 4096 Jun 22 2021 MITgcm_ocean
drwxrwxr-x+ 13 nancy p86850054 4096 Sep 7 10:43 MOM6
drwxrwxr-x+ 6 nancy dart 4096 Jul 26 10:53 mpas
-rw-r--r--+ 1 1742 p86850054 8902 Jun 30 2021 my_list.txt
-rw-rw-r--+ 1 nancy dart 97729 Dec 20 2017 netcdf_files
-r--r--r--+ 1 nancy dart 155735994 Jan 3 2018 obs_seq2015052512
-rw-rw-r--+ 1 nancy dart 6564355 Jan 3 2018 obs_seq.in
drwxrwxr-x+ 2 nancy p86850054 4096 Jun 30 2021 old_test_dataset_tarfiles
drwxr-xr-x+ 6 15717 ncar 4096 Jul 20 2020 petsc
drwxrwxr-x+ 6 nancy dart 4096 Nov 15 2016 pop
-rw-r--r--+ 1 bmraczka ncar 16400 Aug 20 2021 prep_tar.txt
-rw-rw-r--+ 1 nancy dart 4051 Aug 22 2019 README
drwxrwxr-x+ 5 nancy dart 4096 Oct 27 2017 roms
drwxr-xr-x+ 19 15717 ncar 4096 Jun 4 2020 RTTOV
drwxr-xr-x+ 4 15717 ncar 4096 Mar 19 2020 rttov_test
-rw-r--r--+ 1 bmraczka ncar 16400 Aug 20 2021 tar.txt
-rw-r--r--+ 1 1742 p86850054 4125839360 Feb 4 2021 test_build_datasets_preprocess.tar
-rw-r--r--+ 1 1742 p86850054 4125839360 Jun 30 2021 test_build_datasets.tar
drwxrwxr-x+ 2 nancy p86850054 4096 Aug 22 2019 tiegcm
drwxrwxr-x+ 6 nancy dart 4096 May 3 2017 wrf
drwxrwxr-x+ 3 nancy dart 4096 May 1 2017 wrf_chem
-rw-r--r--+ 1 nancy p86850054 143587366 Nov 2 2016 wrfinput_d01.nancy
Is your feature request related to a problem?
cheyenne is going away soon and this directory is disappearing.
Describe your preferred solution
someone needs to sort out what's on /glade/p vs what's already on /glade/campaign - there are redundancies and overlaps. but in particular, it would be nice to have a solid collection of test files so that any model can be tested with the current release to be sure nothing has broken. also for the obs converters. the problem is that many files are quite large, so this needs to be someplace we have enough space to keep them. i'm don't think the RDA is the right place for these.
Describe any alternatives you have considered
helen has a script that is copying /glade/p over to a subdir on campaign storage that's accessible from derecho, but for now it's read only so we don't have problems with updates in multiple places. when cheyenne goes down for good, that dir needs to be accessible to dares folks and some number of other folks.
this issue is so there's a place to discuss what we decide to do with the /glade/p files
Use case
/glade/p/ is going away. much of what's there that is owned by current group members needs to be maintained. the process for generating reanalysis obs is there in the Observations dir. the DART_test_cases directory has restart/initial files for many models both for our testing and for local users who make use of our test files. this is separate from the RDA_strawman directory although there may be some minor overlap. here is a list of which models have initial/restart files for running filter for testing:
Is your feature request related to a problem?
cheyenne is going away soon and this directory is disappearing.
Describe your preferred solution
someone needs to sort out what's on /glade/p vs what's already on /glade/campaign - there are redundancies and overlaps. but in particular, it would be nice to have a solid collection of test files so that any model can be tested with the current release to be sure nothing has broken. also for the obs converters. the problem is that many files are quite large, so this needs to be someplace we have enough space to keep them. i'm don't think the RDA is the right place for these.
Describe any alternatives you have considered
helen has a script that is copying /glade/p over to a subdir on campaign storage that's accessible from derecho, but for now it's read only so we don't have problems with updates in multiple places. when cheyenne goes down for good, that dir needs to be accessible to dares folks and some number of other folks.