SHOC tests exibit seemingly random behavior, depending on CTEST_PARALLEL_LEVEL

E3SM-Project / scream

Fork of E3SM used to develop exascale global atmosphere model written in C++

https://e3sm-project.github.io/scream/

Other

80 stars 57 forks source link

SHOC tests exibit seemingly random behavior, depending on CTEST_PARALLEL_LEVEL #742

Closed bartgol closed 4 years ago

bartgol commented 4 years ago

Try to manually run ctest -R shoc_tests and CTEST_PARALLEL_LEVEL=40 ctest -R shoc_tests. The latter, on mappy as well as my laptop, passes, while the former has 3 tests failing. A midground with || level 4 has just 1 test failing.

bartgol commented 4 years ago

If I remove shoc_diag_second_moments_tests.cpp from the list of files to compile into shoc_tests, then tests pass.

This is on mappy (gcc).

jgfouca commented 4 years ago

Just glancing at this, I think there's likely just some team barriers needed. I will investigate.