What is the feature/what would you like to discuss?
Issue #230 requires holding onto many CAM snapshot files for an extended (possibly indefinite) period of time. This could potentially introduce a significant storage burden, and make it difficult to run these tests outside of the NCAR computing ecosystem.
To remedy this problem, the snapshots could be post-processed with a script to make them as small as possible while still providing all of the data needed for the physics scheme tests to run properly. This could include the following modifications:
Remove all timesteps except the last two (eventually this may be reduced to just one timestep).
Remove all variables that aren't explicitly required by the physics scheme(s) being tested. This should be doable by using the CCPP-framework scripts directly to determine which variables are needed from the host model, and thus the snapshot file.
Other possibilities may include file compression (although for these tests it may need to be lossless), and removing un-necessary grid cells or vertical levels. However, the first two listed items are likely the only two post-processing steps that will definitely be required, at least for this particular issue.
Is there anyone in particular you want to be part of this conversation?
No response
Will this change (regression test) answers?
No
Will you be implementing this enhancement yourself?
What is the feature/what would you like to discuss?
Issue #230 requires holding onto many CAM snapshot files for an extended (possibly indefinite) period of time. This could potentially introduce a significant storage burden, and make it difficult to run these tests outside of the NCAR computing ecosystem.
To remedy this problem, the snapshots could be post-processed with a script to make them as small as possible while still providing all of the data needed for the physics scheme tests to run properly. This could include the following modifications:
Remove all timesteps except the last two (eventually this may be reduced to just one timestep).
Remove all variables that aren't explicitly required by the physics scheme(s) being tested. This should be doable by using the CCPP-framework scripts directly to determine which variables are needed from the host model, and thus the snapshot file.
Other possibilities may include file compression (although for these tests it may need to be lossless), and removing un-necessary grid cells or vertical levels. However, the first two listed items are likely the only two post-processing steps that will definitely be required, at least for this particular issue.
Is there anyone in particular you want to be part of this conversation?
No response
Will this change (regression test) answers?
No
Will you be implementing this enhancement yourself?
Any Software Engineer can do this