What is the feature/what would you like to discuss?
Once issue #229 has been resolved, then it would help to create a CIME test list of various configurations that all use the FPHYStest compset, but which each use a different physics suite/scheme (whatever we want to test), running with the ncdata_check flag on. For now it is assumed these tests would need to run on Derecho with the GNU compiler (version 12.2.0).
These tests would all be smoke (SMS) tests, but with the ncdata_check endrun option enabled so that if there is a failure it will show up properly as a test failure. Additional conditions may also need to be passed to the CIME create_test routine to avoid any attempt at baseline evaluations, file archiving, etc.
An additional "nice-to-have" would be to use the CIME single-exe option along with CAM-SIMA's ability to build multiple physics suites together to do just one CAM-SIMA build for all of the relevant tests, even if there are many different physics suites and/or schemes being tested.
Finally, these tests should be listed in a CIME testlist XML file, or something similar, so that it is easy for a developer to add new tests to this test suite in the future.
Is there anyone in particular you want to be part of this conversation?
No response
Will this change (regression test) answers?
No
Will you be implementing this enhancement yourself?
What is the feature/what would you like to discuss?
Once issue #229 has been resolved, then it would help to create a CIME test list of various configurations that all use the
FPHYStestcompset, but which each use a different physics suite/scheme (whatever we want to test), running with thencdata_checkflag on. For now it is assumed these tests would need to run on Derecho with the GNU compiler (version 12.2.0).These tests would all be smoke (
SMS) tests, but with thencdata_checkendrun option enabled so that if there is a failure it will show up properly as a test failure. Additional conditions may also need to be passed to the CIMEcreate_testroutine to avoid any attempt at baseline evaluations, file archiving, etc.An additional "nice-to-have" would be to use the CIME
single-exeoption along with CAM-SIMA's ability to build multiple physics suites together to do just one CAM-SIMA build for all of the relevant tests, even if there are many different physics suites and/or schemes being tested.Finally, these tests should be listed in a CIME testlist XML file, or something similar, so that it is easy for a developer to add new tests to this test suite in the future.
Is there anyone in particular you want to be part of this conversation?
No response
Will this change (regression test) answers?
No
Will you be implementing this enhancement yourself?
Any Software Engineer can do this