search

Raku / old-issue-tracker

Tickets from RT
https://github.com/Raku/old-issue-tracker/issues
2 stars 1 forks source link

harness6 runs incorrect number of tests when spec or stresstesting #6166

Closed p6rt closed 7 years ago

p6rt commented 7 years ago

Migrated from rt.perl.org#131075 (status was 'resolved')

Searchable as RT131075$

p6rt commented 7 years ago

From @dogbert17

When running spectest (or stresstest) under harness6 not all files in spectest.data that should be run are being run. For example​:

'make spectest TEST_JOBS=3', i.e. harness5 tests 1168 files

on the other hand

'make spectest HARNESS_TYPE=6 TEST_JOBS=3' only tests 1160 files

The two harnesses should test the same number of files. There's reason to believe that the bug hides in harness6.

p6rt commented 7 years ago

From @dogbert17

On Wed, 29 Mar 2017 09​:52​:00 -0700, jan-olof.hendig@​bredband.net wrote​:

When running spectest (or stresstest) under harness6 not all files in spectest.data that should be run are being run. For example​:

'make spectest TEST_JOBS=3', i.e. harness5 tests 1168 files

on the other hand

'make spectest HARNESS_TYPE=6 TEST_JOBS=3' only tests 1160 files

The two harnesses should test the same number of files. There's reason to believe that the bug hides in harness6.

Fixed with commit 876637010edef3155953cda3ea2cff57f7d7dd07

p6rt commented 7 years ago

@dogbert17 - Status changed from 'new' to 'resolved'