search

Test-More / TB2

Test::Builder version 2, the next generation of building testing modules in Perl
Other
1 stars 0 forks source link

perl-blead / Test-Simple #207

Closed schwernbot closed 10 years ago

schwernbot commented 10 years ago

From: @celogeek Date: Sunday Apr 15, 2012 at 21:23 GMT Orig: https://github.com/Test-More/test-more/issues/283


new-host-2:Test-Simple (topic/tb2 *) geistteufel$ make test
PERL_DL_NONLAZY=1 ../../perl "-I../../lib" "-I../../lib" "-MExtUtils::Command::MM" "-e" "test_harness(0, '../../lib', '../../lib')" t/*.t t/*/*.t t/*/*/*.t
t/00compile.t .............................. ok    
t/00test_harness_check.t ................... ok   
t/bad_plan.t ............................... ok   
t/BEGIN_require_ok.t ....................... ok   
t/BEGIN_use_ok.t ........................... ok   
t/buffer.t ................................. ok    
t/Builder/bail_out.t ....................... ok   
t/Builder/Builder.t ........................ ok   
t/Builder/carp.t ........................... ok   
t/Builder/context.t ........................ ok   
t/Builder/create.t ......................... ok   
t/Builder/current_test/no_tests.t .......... ok   
t/Builder/current_test/test_number.t ....... ok   
t/Builder/current_test/without_plan.t ...... ok   
t/Builder/details.t ........................ ok   
t/Builder/done_testing.t ................... ok   
t/Builder/done_testing_double.t ............ ok   
t/Builder/done_testing_null_plan.t ......... ok   
t/Builder/done_testing_plan_mismatch.t ..... ok   
t/Builder/done_testing_with_no_plan.t ...... ok   
t/Builder/done_testing_with_number.t ....... ok   
t/Builder/done_testing_with_plan.t ......... ok   
t/Builder/expected_tests.t ................. ok   
t/Builder/fail.t ........................... ok   
t/Builder/fork_with_new_stdout.t ........... ok   
t/Builder/has_plan.t ....................... ok   
t/Builder/has_plan2.t ...................... ok   
t/Builder/in_subtest.t ..................... ok   
t/Builder/is_fh.t .......................... ok    
t/Builder/is_passing.t ..................... ok    
t/Builder/last_test_skipped.t .............. ok   
t/Builder/maybe_regex.t .................... ok    
t/Builder/name.t ........................... ok    
t/Builder/no_diag.t ........................ ok   
t/Builder/no_ending.t ...................... ok   
t/Builder/no_formatter.t ................... ok   
t/Builder/no_header.t ...................... ok   
t/Builder/no_plan.t ........................ ok   
t/Builder/no_plan_at_all.t ................. ok   
t/Builder/ok_obj.t ......................... ok   
t/Builder/output.t ......................... ok   
t/Builder/reset.t .......................... ok    
t/Builder/reset_outputs.t .................. ok   
t/Builder/set_formatter.t .................. ok   
t/Builder/skip_all.t ....................... ok   
t/Builder/test_start.t ..................... ok   
t/Builder/use_numbers.t .................... ok   
t/Builder2/assert.t ........................ ok   
t/Builder2/assert_dies.t ................... ok   
t/Builder2/AssertRecord.t .................. ok    
t/Builder2/AssertStack.t ................... ok    
t/Builder2/context.t ....................... ok   
t/Builder2/done_testing.t .................. ok   
t/Builder2/HasDefault.t .................... ok   
t/Builder2/is.t ............................ ok   
t/Builder2/Mouse.t ......................... ok   
t/Builder2/Mouse_before_TB2.t .............. skipped: Mouse not installed
t/Builder2/NoWarnings.t .................... ok   
t/Builder2/ok_starts_a_stream.t ............ ok   
t/Builder2/SimpleBuilder2.t ................ ok    
t/Builder2/Stack.t ......................... ok    
t/Builder2/StackBuilder.t .................. ok    
t/Builder2/subtest.t ....................... ok   
t/Builder2/TB2_before_Mouse.t .............. skipped: Mouse not installed
t/Builder2/top.t ........................... ok   
t/c_flag.t ................................. ok   
t/CanDupFilehandles.t ...................... ok    
t/CanLoad.t ................................ ok   
t/CanOpen.t ................................ ok   
t/CanTry.t ................................. ok    
t/circular_data.t .......................... ok    
t/cmp_ok.t ................................. ok    
t/dependents.t ............................. skipped: Dependents only tested when releasing
t/diag.t ................................... ok   
t/died.t ................................... ok   
t/dont_overwrite_die_handler.t ............. ok   
t/eq_set.t ................................. ok   
t/Event/Abort.t ............................ ok   
t/Event/Comment.t .......................... ok   
t/Event/default_formatter_class.t .......... ok   
t/Event/Event.t ............................ ok   
t/Event/EventCoordinator.t ................. ok    
t/Event/EventHandler.t ..................... ok   
t/Event/Events.t ........................... ok    
t/Event/Log.t .............................. ok    
t/Event/post_order.t ....................... ok   
t/Event/SetPlan.t .......................... ok    
t/Event/subtest_handler.t .................. ok   
t/Event/SubtestEnd.t ....................... ok    
t/Event/SubtestStart.t ..................... ok    
t/Event/TestEnd.t .......................... ok   
t/Event/TestMetadata.t ..................... ok   
t/Event/TestStart.t ........................ ok   
t/Event/TestState.t ........................ ok    
t/exit.t ................................... ok     
t/explain.t ................................ ok   
t/extra.t .................................. ok   
t/extra_one.t .............................. ok   
t/fail-like.t .............................. ok   
t/fail-more.t .............................. ok    
t/fail_one.t ............................... ok   
t/filehandles.t ............................ 1/? # this diagnostic should be seen
t/filehandles.t ............................ ok   
t/fork.t ................................... ok   
t/Formatter/Formatter.t .................... ok   
t/Formatter/Multi.t ........................ ok    
t/Formatter/Null.t ......................... ok   
t/Formatter/PlusMinus.t .................... ok   
t/Formatter/POSIX.t ........................ ok   
t/Formatter/POSIX_plus_Builder.t ........... ok   
t/Formatter/reset_streamer.t ............... ok   
t/Formatter/subtest.t ...................... ok   
t/Formatter/TAP/abort.t .................... ok   
t/Formatter/TAP/basic.t .................... ok    
t/Formatter/TAP/ending_commentary.t ........ ok    
t/Formatter/TAP/escapes.t .................. ok   
t/Formatter/TAP/indent.t ................... ok   
t/Formatter/TAP/log.t ...................... ok    
t/Formatter/TAP/subtest.t .................. ok   
t/Formatter/TAP/TB1.t ...................... ok   
t/Formatter/TAP/v12.t ...................... ok   
t/harness_active.t ......................... ok   
t/HasObjectID.t ............................ ok   
t/History/child_process.t .................. ok    
t/History/History.t ........................ ok    
t/History/HistoryStats.t ................... ok    
t/History/in_test.t ........................ ok    
t/History/plan.t ........................... ok   
t/History/test_was_successful.t ............ ok    
t/import.t ................................. ok   
t/is_deeply_dne_bug.t ...................... ok   
t/is_deeply_fail.t ......................... ok     
t/is_deeply_with_threads.t ................. skipped: many perls have broken threads.  Enable with AUTHOR_TESTING.
t/missing.t ................................ ok   
t/Module/doesnt_set_exported_to.t .......... ok   
t/Module/formatter.t ....................... ok   
t/More.t ................................... ok    
t/new_ok.t ................................. ok    
t/no_plan.t ................................ ok     
t/no_tests.t ............................... ok   
t/note.t ................................... ok   
t/OnlyOnePlan/basics.t ..................... ok    
t/OnlyOnePlan/no_state.t ................... ok   
t/overload.t ............................... ok    
t/overload_threads.t ....................... ok   
t/plan.t ................................... ok   
t/plan_bad.t ............................... ok    
t/plan_is_noplan.t ......................... ok   
t/plan_no_plan.t ........................... ok   
t/plan_shouldnt_import.t ................... ok   
t/plan_skip_all.t .......................... skipped: Just testing plan & skip_all
t/pod-coverage.t ........................... skipped: set RELEASE_TESTING to test Pod coverage
t/pod.t .................................... skipped: Test::Pod 1.00 required for testing POD
t/require_ok.t ............................. ok   
t/Result/accessors.t ....................... ok   
t/Result/basics.t .......................... ok    
t/shared_test_state.t ...................... ok   
t/Simple/builder.t ......................... ok   
t/Simple/load.t ............................ ok   
t/Simple/no_plan.t ......................... ok   
t/Simple/pass.t ............................ ok   
t/skip.t ................................... ok    
t/skip_before_plan.t ....................... ok   
t/skipall.t ................................ ok   
t/strays.t ................................. skipped: not completed
t/Streamer/stdout.t ........................ ok   
t/Streamer/Streamer.t ...................... ok   
t/Streamer/threads.t ....................... ok   
t/Streamer/ThreadSafeFilehandleAccessor.t .. 1/? # Failed at t/Streamer/ThreadSafeFilehandleAccessor.t line 68
#      got "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000from the thread\n"
# expected "before the threads\nfrom the thread\n"
t/Streamer/ThreadSafeFilehandleAccessor.t .. 5/? # Failed at t/Streamer/ThreadSafeFilehandleAccessor.t line 68
#      got "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000from the thread\n"
# expected "before the threads\nfrom the thread\n"
# Failed at t/Streamer/ThreadSafeFilehandleAccessor.t line 68
#      got "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000from the thread\n"
# expected "before the threads\nfrom the thread\n"
# Failed at t/Streamer/ThreadSafeFilehandleAccessor.t line 68
#      got "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000from the thread\n"
# expected "before the threads\nfrom the thread\n"
# Failed at t/Streamer/ThreadSafeFilehandleAccessor.t line 68
#      got "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000from the thread\n"
# expected "before the threads\nfrom the thread\n"
t/Streamer/ThreadSafeFilehandleAccessor.t .. All 5 subtests passed 
t/subtest/args.t ........................... ok   
t/subtest/bail_out.t ....................... ok   
t/subtest/basic.t .......................... ok   
t/subtest/default.t ........................ ok   
t/subtest/die.t ............................ ok   
t/subtest/do.t ............................. ok   
t/subtest/fork.t ........................... ok   
t/subtest/implicit_done.t .................. ok   
t/subtest/line_numbers.t ................... ok   
t/subtest/plan.t ........................... ok   
t/subtest/predicate.t ...................... ok   
t/subtest/return.t ......................... ok   
t/subtest/threads.t ........................ ok   
t/subtest/todo.t ........................... ok    
t/subtest/wstat.t .......................... ok   
t/TB1vsTB2.t ............................... ok   
t/test_pl/can_isa_ok.t ..................... ok    
t/Tester/args.t ............................ ok     
t/Tester/basic.t ........................... ok   
t/Tester/change_formatter.t ................ ok   
t/Tester/die.t ............................. ok   
t/Tester/errormess.t ....................... ok   
t/Tester/faildiag.t ........................ ok   
t/Tester/fhrestore.t ....................... ok   
t/Tester/import.t .......................... ok    
t/Tester/line_num.t ........................ ok   
t/Tester/skip.t ............................ ok   
t/Tester2/capture.t ........................ ok   
t/Tester2/state_untouched.t ................ ok   
t/thread_taint.t ........................... ok   
t/threads.t ................................ ok      
t/threads_shared.t ......................... ok   
t/todo.t ................................... ok    
t/todo_skip_before_plan.t .................. ok   
t/todo_warnings.t .......................... ok   
t/true_value.t ............................. ok   
t/Types/int.t .............................. ok    
t/Types/stringify.t ........................ ok   
t/undef.t .................................. ok    
t/use_ok.t ................................. ok    
t/use_ok_leaking.t ......................... ok   
t/useing.t ................................. ok   
t/utf8.t ................................... ok   
t/versions.t ............................... ok   

Test Summary Report
-------------------
t/Streamer/ThreadSafeFilehandleAccessor.t (Wstat: 0 Tests: 10 Failed: 5)
  Failed tests:  5, 5, 5, 5, 5
  Parse errors: Tests out of sequence.  Found (5) but expected (6)
                Tests out of sequence.  Found (5) but expected (7)
                Tests out of sequence.  Found (5) but expected (8)
                Tests out of sequence.  Found (5) but expected (9)
                Tests out of sequence.  Found (5) but expected (10)
Displayed the first 5 of 6 TAP syntax errors.
Re-run prove with the -p option to see them all.
Files=212, Tests=3091, 55 wallclock secs ( 1.69 usr  0.66 sys + 45.83 cusr  3.52 csys = 51.70 CPU)
Result: FAIL
Failed 1/212 test programs. 5/3091 subtests failed.
make: *** [test_dynamic] Error 255
schwernbot commented 10 years ago

From: @celogeek Date: Sunday Apr 15, 2012 at 21:27 GMT Orig: https://github.com/Test-More/test-more/issues/283#issuecomment-5142772

this is ok in perl 5.14.2 out of the box.

schwernbot commented 10 years ago

From: @schwern Date: Tuesday Apr 24, 2012 at 20:10 GMT Orig: https://github.com/Test-More/test-more/issues/283#issuecomment-5316253

It's entirely possible you've encountered a bleadperl bug, probably to do with threads. Try installing blead and running the TB2 tests against it, that will eliminate the possibility of some bad interaction because TB2 is in the core.

schwernbot commented 10 years ago

From: @schwern Date: Friday Mar 14, 2014 at 20:16 GMT Orig: https://github.com/Test-More/test-more/issues/283#issuecomment-37690611

I'm going to close this out as it appeared to be a bug in blead.