search

openndr / ndr-build-env

NDR Build Environment Component
https://openndr.org
Other
0 stars 2 forks source link

Coverage field of 'NTS_REPORT' does not work. #8

Closed Revimal closed 6 years ago

Revimal commented 6 years ago

I'm using test framework of 'ndr-build-env' to write self-tests for the 'ndrte'. I wrote down test-cases and ran it. According to 'NTS_REPORT', a test case named 'lfqueue_sp_sc' failed due to 9,989,013 failures. So, the coverage must be 0.10 percent. But it didn't.

Here is my nts result

[*] TESTCASE Coverage report
 | TC Name  : lfqueue_single
 | Result   : PASS
 | Tested   : 10000000
 | Passed   : 10000000
 | Failed   : 0
 | Ignored  : 0
 | Coverage : 100.00%
[*]

[*] TESTCASE Coverage report
 | TC Name  : lfqueue_sp_sc
 | Result   : FAILED
 | Tested   : 10000000
 | Passed   : 10987
 | Failed   : 9989013
 | Ignored  : 0
 | Coverage : 0.00%
[*]
Revimal commented 6 years ago

Also, wording 'coverage' is invalid. It must change to the right expression, such as "success rate". Good luck :p