Feature request: sort out initial model files/testing files and the rest of /glade/p files

this issue is so there's a place to discuss what we decide to do with the /glade/p files

Use case

/glade/p/ is going away. much of what's there that is owned by current group members needs to be maintained. the process for generating reanalysis obs is there in the Observations dir. the DART_test_cases directory has restart/initial files for many models both for our testing and for local users who make use of our test files. this is separate from the RDA_strawman directory although there may be some minor overlap. here is a list of which models have initial/restart files for running filter for testing:

cheyenne2> cd DART_test_cases/
cheyenne2> ls -l
total 8375142
drwxrwxr-x+  4 nancy    dart            4096 Nov 11  2015 bgrid
-rwxrwxr-x+  1     1742 dart            9162 Jun 30  2021 bundle_test_data.sh
drwxrwxr-x+  4 nancy    dart            4096 Feb 15  2017 cam
drwxrwxr-x+  6 nancy    dart            4096 May  7  2019 cice
-rwxrwxr-x+  1 nancy    p86850054        669 Aug 22  2019 clean_test_build_datasets.sh
drwxrwxr-x+  5 nancy    dart            4096 Aug 28  2017 clm
drwxrwxr-x+  4 nancy    dart            4096 May 26  2016 cm1
drwxrwxr-x+  3 nancy    dart            4096 Dec 27  2017 coamps_nest
drwxr-xr-x+  6    15717 ncar            4096 Jul 20  2020 CRTM
-rw-r--r--+  1     1742 dart        18285334 Apr 10  2019 DART_matlab_test.tgz
drwxrwxr-x+  4 nancy    p86850054       4096 Dec 12  2019 gitm
drwxrwxr-x+  3 nancy    dart            4096 May 28  2017 lmdz
drwxr-xr-x+  4     1742 p86850054       4096 Jun 22  2021 MITgcm_ocean
drwxrwxr-x+ 13 nancy    p86850054       4096 Sep  7 10:43 MOM6
drwxrwxr-x+  6 nancy    dart            4096 Jul 26 10:53 mpas
-rw-r--r--+  1     1742 p86850054       8902 Jun 30  2021 my_list.txt
-rw-rw-r--+  1 nancy    dart           97729 Dec 20  2017 netcdf_files
-r--r--r--+  1 nancy    dart       155735994 Jan  3  2018 obs_seq2015052512
-rw-rw-r--+  1 nancy    dart         6564355 Jan  3  2018 obs_seq.in
drwxrwxr-x+  2 nancy    p86850054       4096 Jun 30  2021 old_test_dataset_tarfiles
drwxr-xr-x+  6    15717 ncar            4096 Jul 20  2020 petsc
drwxrwxr-x+  6 nancy    dart            4096 Nov 15  2016 pop
-rw-r--r--+  1 bmraczka ncar           16400 Aug 20  2021 prep_tar.txt
-rw-rw-r--+  1 nancy    dart            4051 Aug 22  2019 README
drwxrwxr-x+  5 nancy    dart            4096 Oct 27  2017 roms
drwxr-xr-x+ 19    15717 ncar            4096 Jun  4  2020 RTTOV
drwxr-xr-x+  4    15717 ncar            4096 Mar 19  2020 rttov_test
-rw-r--r--+  1 bmraczka ncar           16400 Aug 20  2021 tar.txt
-rw-r--r--+  1     1742 p86850054 4125839360 Feb  4  2021 test_build_datasets_preprocess.tar
-rw-r--r--+  1     1742 p86850054 4125839360 Jun 30  2021 test_build_datasets.tar
drwxrwxr-x+  2 nancy    p86850054       4096 Aug 22  2019 tiegcm
drwxrwxr-x+  6 nancy    dart            4096 May  3  2017 wrf
drwxrwxr-x+  3 nancy    dart            4096 May  1  2017 wrf_chem
-rw-r--r--+  1 nancy    p86850054  143587366 Nov  2  2016 wrfinput_d01.nancy

Is your feature request related to a problem?

cheyenne is going away soon and this directory is disappearing.

Describe your preferred solution

someone needs to sort out what's on /glade/p vs what's already on /glade/campaign - there are redundancies and overlaps. but in particular, it would be nice to have a solid collection of test files so that any model can be tested with the current release to be sure nothing has broken. also for the obs converters. the problem is that many files are quite large, so this needs to be someplace we have enough space to keep them. i'm don't think the RDA is the right place for these.

Describe any alternatives you have considered

helen has a script that is copying /glade/p over to a subdir on campaign storage that's accessible from derecho, but for now it's read only so we don't have problems with updates in multiple places. when cheyenne goes down for good, that dir needs to be accessible to dares folks and some number of other folks.

NCAR / DART