byte-physics / igortest

Igor Pro Universal Testing Framework
https://docs.byte-physics.de/igor-unit-testing-framework/
BSD 3-Clause "New" or "Revised" License
7 stars 2 forks source link

Summary not showing test case where assertion failed. #464

Open MichaelHuth opened 7 months ago

MichaelHuth commented 7 months ago

Scenario: A test case uses reentry feature and while waiting for the reentry a background function calls assertions. The assumption that the test case can be determined from the stack trace is wrong, that shows in the first four assertions of the summary, where from the summary output the causing test case is unknown.

...
Leaving test case "AnalysisFunctionTesting#AFT7:SUTTER"
  Failed with 11 errors
  Leaving test suite "UTF_AnalysisFunctionManagement.ipf"
  Test finished with 11 errors
    ▶ Assertion "CHECK_GE_VAR(s.lastKnownRowIndexAD, 0)" failed in DQM_FIFOMonitor➔ValidFunc_V3 (UserAnalysisFunctions.ipf, line 144➔412)
    ▶ Assertion "CHECK_GE_VAR(s.lastKnownRowIndexDA, 0)" failed in DQM_FIFOMonitor➔ValidFunc_V3 (UserAnalysisFunctions.ipf, line 144➔416)
    ▶ Assertion "CHECK_GE_VAR(s.lastKnownRowIndexAD, 0)" failed in DQM_FIFOMonitor➔ValidFunc_V3 (UserAnalysisFunctions.ipf, line 144➔412)
    ▶ Assertion "CHECK_GE_VAR(s.lastKnownRowIndexDA, 0)" failed in DQM_FIFOMonitor➔ValidFunc_V3 (UserAnalysisFunctions.ipf, line 144➔416)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "CHECK_EQUAL_VAR(NumberByKey("LOCK", WaveInfo(DAQDataWave, 0)), 1)" failed in AnalysisFunctionTesting#AFT7➔ValidMultHS_V1 (UserAnalysisFunctions.ipf, line 897➔137)
    ▶ Assertion "FAIL()" failed in AnalysisFunctionTesting#AFT7➔AcquireData_NG (UTF_HardwareHelperFunctions.ipf, line 897➔1576)
  End of test "MIES with HardwareBasic-SUTTER"