search

dart-lang / sdk

The Dart SDK, including the VM, JS and Wasm compilers, analysis, core libraries, and more.
https://dart.dev
BSD 3-Clause "New" or "Revised" License
10.11k stars 1.57k forks source link

service/get_retained_size_rpc_test is flaky #28193

Open sigmundch opened 7 years ago

sigmundch commented 7 years ago

Sample failure:

FAILED: none-vm release_ia32 service/get_retained_size_rpc_test
Expected: Pass 
Actual: RuntimeError
CommandOutput[vm]:

stdout:
** Launching SERVICE_TEST_TESTEE=true out/ReleaseIA32/dart -DDART_SERVICE_USE_AUTH=false --error_on_bad_type --error_on_bad_override --optimization-counter-threshold=5 --ignore-unrecognized-flags --packages=/mnt/data/b/build/slave/vm-linux-release-ia32-optcounter-threshold-be/build/sdk/.packages --enable-vm-service:0 /mnt/data/b/build/slave/vm-linux-release-ia32-optcounter-threshold-be/build/sdk/runtime/observatory/tests/service/get_retained_size_rpc_test.dart
>testee>out> Observatory listening on http://127.0.0.1:34944/
** Signaled to run test queries on http://127.0.0.1:34944/
>testee>out> 
Loading VM...
Done loading VM
Running get_retained_size_rpc_test.dart [1/1]
** Killing script
Unexpected exception in service tests: Expected: a positive value
  Actual: <-200>
   Which: is not a positive value

package:unittest/src/matcher/expect.dart 117:5                          DefaultFailureHandler.fail
package:unittest/src/matcher/expect.dart 121:5                          DefaultFailureHandler.failMatch
package:unittest/src/matcher/expect.dart 95:20                          expect
runtime/observatory/tests/service/get_retained_size_rpc_test.dart 53:5  tests.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/future_impl.dart 22                                          _Completer.completeError
runtime/observatory/tests/service/get_retained_size_rpc_test.dart 68:4  tests.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/zone.dart 1073                                               _CustomZone.registerUnaryCallback
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper
runtime/observatory/tests/service/get_retained_size_rpc_test.dart       tests.<fn>
runtime/observatory/tests/service/test_helper.dart 324:23               _ServiceTesterRunner.run.<fn>.<async>.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/zone.dart 1073                                               _CustomZone.registerUnaryCallback
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper
runtime/observatory/tests/service/test_helper.dart                      _ServiceTesterRunner.run.<fn>.<async>.<fn>
package:stack_trace/src/chain.dart 87:24                                Chain.capture.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 1503                                               runZoned
package:stack_trace/src/chain.dart 85:12                                Chain.capture
runtime/observatory/tests/service/test_helper.dart 296:13               _ServiceTesterRunner.run.<fn>.<async>
dart:async/future.dart 184                                              Future.Future.microtask.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage

stderr:
Unhandled exception:
Expected: a positive value
  Actual: <-200>
   Which: is not a positive value

package:unittest/src/matcher/expect.dart 117:5                          DefaultFailureHandler.fail
package:unittest/src/matcher/expect.dart 121:5                          DefaultFailureHandler.failMatch
package:unittest/src/matcher/expect.dart 95:20                          expect
runtime/observatory/tests/service/get_retained_size_rpc_test.dart 53:5  tests.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/future_impl.dart 22                                          _Completer.completeError
runtime/observatory/tests/service/get_retained_size_rpc_test.dart 68:4  tests.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/zone.dart 1073                                               _CustomZone.registerUnaryCallback
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper
runtime/observatory/tests/service/get_retained_size_rpc_test.dart       tests.<fn>
runtime/observatory/tests/service/test_helper.dart 324:23               _ServiceTesterRunner.run.<fn>.<async>.<fn>.<async>
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper.<fn>
package:stack_trace/src/stack_zone_specification.dart 135:26            StackZoneSpecification.registerUnaryCallback.<fn>.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 135:14            StackZoneSpecification.registerUnaryCallback.<fn>
dart:async/zone.dart 1158                                               _rootRunUnary
dart:async/zone.dart 1037                                               _CustomZone.runUnary
dart:async/future_impl.dart 131                                         _FutureListener.handleValue
dart:async/future_impl.dart 637                                         _Future._propagateToListeners.handleValueCallback
dart:async/future_impl.dart 667                                         _Future._propagateToListeners
dart:async/future_impl.dart 477                                         _Future._completeWithValue
dart:async/future_impl.dart 528                                         _Future._asyncComplete.<fn>
package:stack_trace/src/stack_zone_specification.dart 206:15            StackZoneSpecification._run
package:stack_trace/src/stack_zone_specification.dart 125:48            StackZoneSpecification.registerCallback.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 924                                                _CustomZone.runGuarded
dart:async/zone.dart 951                                                _CustomZone.bindCallback.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage
===== asynchronous gap ===========================
dart:async/zone.dart 1073                                               _CustomZone.registerUnaryCallback
dart:async-patch/async_patch.dart 27                                    _asyncThenWrapperHelper
runtime/observatory/tests/service/test_helper.dart                      _ServiceTesterRunner.run.<fn>.<async>.<fn>
package:stack_trace/src/chain.dart 87:24                                Chain.capture.<fn>
dart:async/zone.dart 1150                                               _rootRun
dart:async/zone.dart 1026                                               _CustomZone.run
dart:async/zone.dart 1503                                               runZoned
package:stack_trace/src/chain.dart 85:12                                Chain.capture
runtime/observatory/tests/service/test_helper.dart 296:13               _ServiceTesterRunner.run.<fn>.<async>
dart:async/future.dart 184                                              Future.Future.microtask.<fn>
dart:async/schedule_microtask.dart 41                                   _microtaskLoop
dart:async/schedule_microtask.dart 50                                   _startMicrotaskLoop
dart:isolate-patch/isolate_patch.dart 96                                _runPendingImmediateCallback
dart:isolate-patch/isolate_patch.dart 149                               _RawReceivePortImpl._handleMessage

Command[vm]: DART_CONFIGURATION=ReleaseIA32 out/ReleaseIA32/dart --error_on_bad_type --error_on_bad_override --optimization-counter-threshold=5 --ignore-unrecognized-flags --packages=/mnt/data/b/build/slave/vm-linux-release-ia32-optcounter-threshold-be/build/sdk/.packages /mnt/data/b/build/slave/vm-linux-release-ia32-optcounter-threshold-be/build/sdk/runtime/observatory/tests/service/get_retained_size_rpc_test.dart
Took 0:00:04.784877

Short reproduction command (experimental):
    python tools/test.py -mrelease -aia32 -t60 --vm-options --optimization-counter-threshold=5 service/get_retained_size_rpc_test

===
=== 1 test failed
===

https://build.chromium.org/p/client.dart/builders/vm-linux-release-ia32-optcounter-threshold-be/builds/3523/steps/vm%20tests/logs/stdio

whesse commented 7 years ago

Area-test is not for test failures specific to a component. Area-test shouldn't even exist.