search

esmf-org / esmf-test-scripts

Scripts for automated regression testing of ESMF
2 stars 6 forks source link

Commit message / folder structure error. #64

Closed ryanlong1004 closed 2 years ago

ryanlong1004 commented 2 years ago

Commit message/folder structure incorrect for some cases.

This is causing a loss in reportable rows.

image image

ryanlong1004 commented 2 years ago

Another example.

Here, you should be able to change the "O" in the url to "g" to get the standard build results, but it doesn't exist.

image

rsdunlapiv commented 2 years ago

This is because there is a commit hash in the URL, and that commit hash might only contain the "O" combination. In general, each commit should be thought of as a single incoming result for a single test combination (i.e., compiler, mpi, O/g) and either the "build" phase or the "test" phase.