search

apjanke / octave-testify

New BIST (Built-In Self Test) functions for GNU Octave
GNU General Public License v3.0
4 stars 2 forks source link

M-file tests are being run twice #78

Closed apjanke closed 5 years ago

apjanke commented 5 years ago

If you look through the progress log, you'll see each failure for an M-code test occurs twice:

[~/octave/testify/logs/test-suite/testsuite-angharad.local-macOS-20190419_194818]
$ grep ' FAIL' -B 1 results.log
  <Octave/tests>/libinterp/corefcn/cellfun.cc-tst ............. PASS    122/130
                                                                FAIL      4
--
  <Octave/tests>/libinterp/corefcn/mappers.cc-tst ............. PASS    414/421
                                                                FAIL      1
--
  <Octave/m>/general/logspace.m ............................... PASS     14/16
                                                                FAIL      2
--
  <Octave/m>/miscellaneous/inputname.m ........................ PASS      9/11
                                                                FAIL      2
--
  <Octave/m>/miscellaneous/tar.m .............................. PASS      5/6
                                                                FAIL      1
--
  <Octave/m>/plot/draw/isocaps.m .............................. PASS     27/29
                                                                FAIL      2
--
  <Octave/m>/plot/draw/isosurface.m ........................... PASS     26/30
                                                                FAIL      3
--
  <Octave/m>/plot/draw/reducevolume.m ......................... PASS     17/22
                                                                FAIL      5
--
  <Octave/m>/general/logspace.m ............................... PASS     14/16
                                                                FAIL      2
--
  <Octave/m>/miscellaneous/inputname.m ........................ PASS      9/11
                                                                FAIL      2
--
  <Octave/m>/miscellaneous/tar.m .............................. PASS      5/6
                                                                FAIL      1
--
  <Octave/m>/plot/draw/isocaps.m .............................. PASS     27/29
                                                                FAIL      2
--
  <Octave/m>/plot/draw/isosurface.m ........................... PASS     26/30
                                                                FAIL      3
--
  <Octave/m>/plot/draw/reducevolume.m ......................... PASS     17/22
                                                                FAIL      5
--
  PASS                            18810
  FAIL                               35

No wonder my PASS counts are higher than Octave's __run_test_suite__!