When a simulation stops via stop count e.g. caused by a failure, the EndOfTestsReport procedure is not called. Thus, no YAML summary file is written.
This causes the TCL scripting to identify the test as "not run", while it was started, but didn't finish properly.
Expected behavior:
Report such tests as e.g. aborted in the HTML reporting.
Create a HTML report page for this test and link compile / simulation logs from simulators and maybe written transcript files if found on disk.
(This helps investigating aborted tests on CI servers without rerunning locally to identify the issue.)
(Issue was discussed before via Gitter chat.)
When a simulation stops via stop count e.g. caused by a failure, the
EndOfTestsReport
procedure is not called. Thus, no YAML summary file is written.This causes the TCL scripting to identify the test as "not run", while it was started, but didn't finish properly.
Expected behavior:
(This helps investigating aborted tests on CI servers without rerunning locally to identify the issue.)