Cantera / cantera

Chemical kinetics, thermodynamics, and transport tool suite
https://cantera.org
Other
582 stars 342 forks source link

Improve output of regression test runner #1606

Closed speth closed 10 months ago

speth commented 10 months ago

Changes proposed in this pull request

If applicable, provide an example illustrating new features this pull request is introducing

Results of running scons test-cxx-LiC6-electrode:

Old per-test output (successful test):

...
clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode.o blah blah blah
clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode blah blah blah
* Running test 'cxx-LiC6-electrode'...

Old per-test output (missing output file):

clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode.o blah blah blah
clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode blah blah blah
* Running test 'cxx-LiC6-electrode'...
FAILED

New output (successful test):

clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode.o blah blah blah
clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode blah blah blah
* Running test 'cxx-LiC6-electrode'...
Comparing 'LiC6_electrode_blessed.csv' with 'LiC6_electrode_output.csv'
PASSED

New output (missing output file):

clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode.o blah blah blah
clang++ -o build/samples/cxx/LiC6_electrode/LiC6_electrode blah blah blah
* Running test 'cxx-LiC6-electrode'...
Output file 'LiC6_electrode_output.csv' not found
FAILED

Checklist