search

Test-More / TB2

Test::Builder version 2, the next generation of building testing modules in Perl
Other
1 stars 0 forks source link

perl-blead / Test-Harness #206

Closed schwernbot closed 10 years ago

schwernbot commented 10 years ago

From: @celogeek Date: Sunday Apr 15, 2012 at 21:21 GMT Orig: https://github.com/Test-More/test-more/issues/282

I have integrate TB2 to perl-blead by replacing Test-Simple by the git version. I have regenerate the MANIFEST, and run tests.

Test-Harness failed

new-host-2:Test-Harness (topic/tb2 *) geistteufel$ make test
PERL_DL_NONLAZY=1 ../../perl "-I../../lib" "-I../../lib" "-MExtUtils::Command::MM" "-e" "test_harness(0, '../../lib', '../../lib')" t/*.t
t/000-load.t ........... 1/? # Testing Test::Harness 3.23, Perl 5.015009, /Users/geistteufel/Documents/Project/hackathon/perl/perl
t/000-load.t ........... ok    
t/aggregator.t ......... ok    
t/bailout.t ............ ok    
t/base.t ............... ok    
t/callbacks.t .......... ok    
t/console.t ............ ok   
t/errors.t ............. ok    
t/file.t ............... ok    
t/glob-to-regexp.t ..... ok    
t/grammar.t ............ ok    
t/harness-bailout.t .... ok   
t/harness-subclass.t ... ok    
t/harness.t ............ ok     
t/iterator_factory.t ... ok    
t/iterators.t .......... ok    
t/multiplexer.t ........ ok    
t/nested.t ............. ok   
t/nofork-mux.t ......... ok    
t/nofork.t ............. ok   
t/object.t ............. ok   
t/parse.t .............. ok     
t/parser-config.t ...... ok   
t/parser-subclass.t .... ok    
t/perl5lib.t ........... ok   
t/premature-bailout.t .. ok    
t/process.t ............ ok    
t/prove.t .............. ok      
t/proveenv.t ........... ok   
t/proverc.t ............ ok   
t/proverun.t ........... ok   
t/proveversion.t ....... ok   
t/regression.t ......... 781/? 
#   Failed test '... and is_plan should return a reasonable value (inc_taint/1)'
#   at t/regression.t line 3308.

#   Failed test ''inc_taint' should parse successfully'
#   at t/regression.t line 3235.
# Can't locate object method "tests_planned" via package "TAP::Parser::Result::Unknown" at t/regression.t line 3317, <GEN60> line 1.
t/regression.t ......... 2348/? 
#   Failed test '... and is_comment should return a reasonable value (stdout_stderr/1)'
#   at t/regression.t line 3308.

#   Failed test ''stdout_stderr' should parse successfully'
#   at t/regression.t line 3235.
# Can't locate object method "comment" via package "TAP::Parser::Result::Version" at t/regression.t line 3317, <GEN124> line 1.

#   Failed test '... and is_plan should return a reasonable value (taint/1)'
#   at t/regression.t line 3308.

#   Failed test ''taint' should parse successfully'
#   at t/regression.t line 3235.
# Can't locate object method "tests_planned" via package "TAP::Parser::Result::Unknown" at t/regression.t line 3309, <GEN136> line 1.
t/regression.t ......... 5096/? Can't locate Test/More.pm in @INC (@INC contains: t/lib t/lib examples /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9 /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9) at t/sample-tests/inc_taint line 3.
BEGIN failed--compilation aborted at t/sample-tests/inc_taint line 3.

#   Failed test '... and we should have the correct number of results (inc_taint)'
#   at t/regression.t line 3323.
#          got: '2'
#     expected: '0'

#   Failed test '... and tests_run should return a reasonable value (inc_taint)'
#   at t/regression.t line 3249.

#   Failed test '... and actual_passed should be the correct amount (inc_taint)'
#   at t/regression.t line 3262.
#          got: '0'
#     expected: '1'

#   Failed test '... and actual_passed should be the correct values (inc_taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = Does not exist
#     $expected->[0] = '1'

#   Failed test '... and exit should equal 0 (inc_taint)'
#   at t/regression.t line 3258.
#          got: '2'
#     expected: '0'

#   Failed test '... and plan should equal 1..1 (inc_taint)'
#   at t/regression.t line 3258.
#          got: ''
#     expected: '1..1'

#   Failed test '... and tests_planned should equal 1 (inc_taint)'
#   at t/regression.t line 3258.
#          got: undef
#     expected: '1'

#   Failed test '... and good_plan should return a reasonable value (inc_taint)'
#   at t/regression.t line 3249.

#   Failed test '... and parse_errors should be the correct amount (inc_taint)'
#   at t/regression.t line 3262.
#          got: '1'
#     expected: '0'

#   Failed test '... and parse_errors should be the correct values (inc_taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = 'No plan found in TAP output'
#     $expected->[0] = Does not exist

#   Failed test '... and passed should be the correct amount (inc_taint)'
#   at t/regression.t line 3262.
#          got: '0'
#     expected: '1'

#   Failed test '... and passed should be the correct values (inc_taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = Does not exist
#     $expected->[0] = '1'

#   Failed test '... and is_good_plan should return a reasonable value (inc_taint)'
#   at t/regression.t line 3249.

#   Failed test '... and wait should equal 0 (inc_taint)'
#   at t/regression.t line 3258.
#          got: '512'
#     expected: '0'
t/regression.t ......... 6362/? Can't locate lib.pm in @INC (@INC contains: t/lib /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9 /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9) at t/sample-tests/taint line 3.
BEGIN failed--compilation aborted at t/sample-tests/taint line 3.

#   Failed test '... and we should have the correct number of results (taint)'
#   at t/regression.t line 3323.
#          got: '2'
#     expected: '0'

#   Failed test '... and tests_run should return a reasonable value (taint)'
#   at t/regression.t line 3249.

#   Failed test '... and actual_passed should be the correct amount (taint)'
#   at t/regression.t line 3262.
#          got: '0'
#     expected: '1'

#   Failed test '... and actual_passed should be the correct values (taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = Does not exist
#     $expected->[0] = '1'

#   Failed test '... and exit should equal 0 (taint)'
#   at t/regression.t line 3258.
#          got: '2'
#     expected: '0'

#   Failed test '... and plan should equal 1..1 (taint)'
#   at t/regression.t line 3258.
#          got: ''
#     expected: '1..1'

#   Failed test '... and tests_planned should return a reasonable value (taint)'
#   at t/regression.t line 3249.

#   Failed test '... and good_plan should return a reasonable value (taint)'
#   at t/regression.t line 3249.

#   Failed test '... and parse_errors should be the correct amount (taint)'
#   at t/regression.t line 3262.
#          got: '1'
#     expected: '0'

#   Failed test '... and parse_errors should be the correct values (taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = 'No plan found in TAP output'
#     $expected->[0] = Does not exist

#   Failed test '... and passed should be the correct amount (taint)'
#   at t/regression.t line 3262.
#          got: '0'
#     expected: '1'

#   Failed test '... and passed should be the correct values (taint)'
#   at t/regression.t line 3264.
#     Structures begin differing at:
#          $got->[0] = Does not exist
#     $expected->[0] = '1'

#   Failed test '... and is_good_plan should return a reasonable value (taint)'
#   at t/regression.t line 3249.

#   Failed test '... and wait should equal 0 (taint)'
#   at t/regression.t line 3258.
#          got: '512'
#     expected: '0'
#34 tests of 7275 failed.
t/regression.t ......... Dubious, test returned 34 (wstat 8704, 0x2200)
Failed 34/7275 subtests 
    (less 72 skipped subtests: 7169 okay)
t/results.t ............ ok     
t/scheduler.t .......... ok     
t/source.t ............. ok    
t/source_handler.t ..... 1/? Can't locate Test/More.pm in @INC (@INC contains: t/lib t/lib /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9 /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9) at t/source_tests/source line 8.
BEGIN failed--compilation aborted at t/source_tests/source line 8.

#   Failed test '... line 1'
#   at t/source_handler.t line 383.
#          got: undef
#     expected: '1..1'

#   Failed test '... line 2'
#   at t/source_handler.t line 383.
#          got: undef
#     expected: 'ok 1 - source'
Can't locate Test/More.pm in @INC (@INC contains: t/lib /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9 /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9) at t/source_tests/source line 8.
BEGIN failed--compilation aborted at t/source_tests/source line 8.

#   Failed test '... line 1'
#   at t/source_handler.t line 383.
#          got: undef
#     expected: '1..1'

#   Failed test '... line 2'
#   at t/source_handler.t line 383.
#          got: undef
#     expected: 'ok 1 - source'
#4 tests of 79 failed.
t/source_handler.t ..... Dubious, test returned 4 (wstat 1024, 0x400)
Failed 4/79 subtests 
    (less 4 skipped subtests: 71 okay)
t/spool.t .............. ok   
t/state.t .............. ok    
t/state_results.t ...... ok    
t/streams.t ............ ok    
t/taint.t .............. Can't locate strict.pm in @INC (@INC contains: foo bar /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/site_perl/5.15.9 /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9/darwin-thread-multi-2level /Users/geistteufel/perl5/perlbrew/perls/perl-blead/lib/5.15.9).
BEGIN failed--compilation aborted.
t/taint.t .............. 1/? 
#   Failed test at t/taint.t line 34.
#1 test of 1 failed.
t/taint.t .............. Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/1 subtests 
t/testargs.t ........... ok    
t/unicode.t ............ ok    
t/utils.t .............. ok    
t/yamlish-output.t ..... ok   
t/yamlish-writer.t ..... ok     
t/yamlish.t ............ ok     

Test Summary Report
-------------------
t/regression.t       (Wstat: 8704 Tests: 7275 Failed: 34)
  Failed tests:  1473, 1476, 2692-2693, 2816, 2819, 5125
                5127-5129, 5132, 5137-5138, 5142-5144, 5146-5147
                5150-5151, 6439, 6441-6443, 6446, 6451-6452
                6456-6458, 6460-6461, 6464-6465
  Non-zero exit status: 34
t/source_handler.t   (Wstat: 1024 Tests: 79 Failed: 4)
  Failed tests:  13-14, 39-40
  Non-zero exit status: 4
t/taint.t            (Wstat: 256 Tests: 1 Failed: 1)
  Failed test:  1
  Non-zero exit status: 1
Files=47, Tests=11445, 29 wallclock secs ( 2.79 usr  0.34 sys + 22.11 cusr  2.04 csys = 27.28 CPU)
Result: FAIL
Failed 3/47 test programs. 39/11445 subtests failed.
schwernbot commented 10 years ago

From: @celogeek Date: Sunday Apr 15, 2012 at 21:27 GMT Orig: https://github.com/Test-More/test-more/issues/282#issuecomment-5142774

It work with TB2 and perl 5.14.2 (out of compile)

schwernbot commented 10 years ago

From: @schwern Date: Tuesday Apr 24, 2012 at 20:13 GMT Orig: https://github.com/Test-More/test-more/issues/282#issuecomment-5316358

Wacky. The t/taint.t failure is particularly suspect as it doesn't seem to have much to do with Test::More.

Try installing blead and running the Test::Harness tests with TB2, just to see if this isn't just a blead bug.

schwernbot commented 10 years ago

From: @schwern Date: Friday Mar 14, 2014 at 20:16 GMT Orig: https://github.com/Test-More/test-more/issues/282#issuecomment-37690657

Closing this as it appears to have been a bug in blead.