search

dart-lang / sdk

The Dart SDK, including the VM, JS and Wasm compilers, analysis, core libraries, and more.
https://dart.dev
BSD 3-Clause "New" or "Revised" License
10.22k stars 1.57k forks source link

Isolate ping and shutdown test times out #35002

Open dcharkes opened 6 years ago

dcharkes commented 6 years ago

The test co19_2/LibTest/isolate/Isolate/ping_A02_t01 timed out twice in the same manner last 30 build on the build bot.

The test seems to make sense: a busy waiting isolate that gets pinged, replies, and gets shut down.

There is no thread busy waiting in the threads dump, which indicates the busy waiting thread has shut down. However, the test framework still expects a test ending signal: unittest-suite-wait-for-done.

FAILED: dartk-vm release_x64 co19_2/LibTest/isolate/Isolate/ping_A02_t01
Expected: Pass
Actual: Timeout

--- Command "vm" (took 01:00.000206s):
DART_CONFIGURATION=ReleaseX64 out/ReleaseX64/dart --sync-async --ignore-unrecognized-flags --packages=/b/s/w/ir/.packages /b/s/w/ir/tests/co19_2/src/LibTest/isolate/Isolate/ping_A02_t01.dart

exit code:
-15

diagnostics:
Process list including children: [19654]
Trying to capture stack trace for pid 19654
PID 19654 - process
TID 19654:
#0  0x00007fcb9b489404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x0000564c3a9c2308 dart::Monitor::WaitMicros(long)
#2  0x0000564c3abd0e1a Dart_RunLoop
#3  0x0000564c3a682b11 dart::bin::RunMainIsolate(char const*, dart::bin::CommandLineOptions*)
#4  0x0000564c3a683636 dart::bin::main(int, char**)
#5  0x0000564c3a683ee9 main
#6  0x00007fcb9a6adf45 __libc_start_main
#7  0x0000564c3a682029 _start
TID 19657:
#0  0x00007fcb9a78a6d3 epoll_wait
#1  0x0000564c3a68ac55 dart::bin::EventHandlerImplementation::Poll(unsigned long)
#2  0x0000564c3a6aa40e dart::bin::ThreadStart(void*)
#3  0x00007fcb9b485184 start_thread
#4  0x00007fcb9a78a03d __clone
TID 19661:
#0  0x00007fcb9b489404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x0000564c3a9c2308 dart::Monitor::WaitMicros(long)
#2  0x0000564c3ab9ad2a dart::BackgroundCompiler::Run()
#3  0x0000564c3aa6608d dart::ThreadPool::Worker::Loop()
#4  0x0000564c3aa65f24 dart::ThreadPool::Worker::Main(unsigned long)
#5  0x0000564c3a9c1bd9 dart::ThreadStart(void*)
#6  0x00007fcb9b485184 start_thread
#7  0x00007fcb9a78a03d __clone
TID 19663:
#0  0x00007fcb9b489404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x0000564c3a9c2308 dart::Monitor::WaitMicros(long)
#2  0x0000564c3ab9ad2a dart::BackgroundCompiler::Run()
#3  0x0000564c3aa6608d dart::ThreadPool::Worker::Loop()
#4  0x0000564c3aa65f24 dart::ThreadPool::Worker::Main(unsigned long)
#5  0x0000564c3a9c1bd9 dart::ThreadStart(void*)
#6  0x00007fcb9b485184 start_thread
#7  0x00007fcb9a78a03d __clone

stdout:
unittest-suite-wait-for-done

--- Re-run this test:
python tools/test.py -m release -n dartk-linux-release-x64 co19_2/LibTest/isolate/Isolate/ping_A02_t01
alexmarkov commented 6 years ago

Test co19_2/LibTest/isolate/Isolate/kill_A01_t01 also timed out on bot:

FAILED: dartk-vm debug_simdbc64 co19_2/LibTest/isolate/Isolate/kill_A01_t01
Expected: Pass
Actual: Timeout

--- Command "vm_compile_to_kernel" (took 532ms):
DART_CONFIGURATION=DebugSIMDBC64 /b/s/w/ir/pkg/vm/tool/gen_kernel --no-aot --platform=out/DebugSIMDBC64/vm_platform_strong.dill -o /b/s/w/ir/out/DebugSIMDBC64/generated_compilations/dartk/tests_co19_2_src_LibTest_isolate_Isolate_kill_A01_t01/out.dill /b/s/w/ir/tests/co19_2/src/LibTest/isolate/Isolate/kill_A01_t01.dart --packages=/b/s/w/ir/.packages -Ddart.developer.causal_async_stacks=true

exit code:
0

--- Command "vm" (took 08:00.000055s):
DART_CONFIGURATION=DebugSIMDBC64 out/DebugSIMDBC64/dart --sync-async --ignore-unrecognized-flags --packages=/b/s/w/ir/.packages /b/s/w/ir/out/DebugSIMDBC64/generated_compilations/dartk/tests_co19_2_src_LibTest_isolate_Isolate_kill_A01_t01/out.dill

exit code:
-15

diagnostics:
Process list including children: [31052]
Trying to capture stack trace for pid 31052
PID 31052 - process
TID 31052:
#0  0x00007f5ae36be404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x000055ee6cb8b084 dart::Monitor::WaitMicros(long)
#2  0x000055ee6cddd1da Dart_RunLoop
#3  0x000055ee6c7e1b3a dart::bin::RunMainIsolate(char const*, dart::bin::CommandLineOptions*)
#4  0x000055ee6c7e27d6 dart::bin::main(int, char**)
#5  0x000055ee6c7e3189 main
#6  0x00007f5ae28e2f45 __libc_start_main
#7  0x000055ee6c7e1029 _start
TID 31056:
#0  0x00007f5ae29bf6d3 epoll_wait
#1  0x000055ee6c7eba15 dart::bin::EventHandlerImplementation::Poll(unsigned long)
#2  0x000055ee6c8154de dart::bin::ThreadStart(void*)
#3  0x00007f5ae36ba184 start_thread
#4  0x00007f5ae29bf03d __clone
TID 31065:
#0  0x00007f5ae36be404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x000055ee6cb8b084 dart::Monitor::WaitMicros(long)
#2  0x000055ee6cd91d6a dart::BackgroundCompiler::Run()
#3  0x000055ee6cc4d021 dart::ThreadPool::Worker::Loop()
#4  0x000055ee6cc4cafc dart::ThreadPool::Worker::Main(unsigned long)
#5  0x000055ee6cb8a295 dart::ThreadStart(void*)
#6  0x00007f5ae36ba184 start_thread
#7  0x00007f5ae29bf03d __clone

stdout:
unittest-suite-wait-for-done

--- Re-run this test:
python tools/test.py -m debug -a simdbc64 -n dartk-linux-debug-simdbc64 co19_2/LibTest/isolate/Isolate/kill_A01_t01

However, I was not able to reproduce it by running 1000 times.

sstrickl commented 5 years ago

Another failure of co19/LibTest/isolate/Isolate/kill_A01_t01 (log), with the same failure to reproduce as Alex.

FAILED: dartk-vm debug_simdbc64 co19_2/LibTest/isolate/Isolate/kill_A01_t01
Expected: Pass
Actual: Timeout

--- Command "vm_compile_to_kernel" (took 667ms):
DART_CONFIGURATION=DebugSIMDBC64 /b/s/w/ir/pkg/vm/tool/gen_kernel --no-aot --platform=out/DebugSIMDBC64/vm_platform_strong.dill -o /b/s/w/ir/out/DebugSIMDBC64/generated_compilations/dartk/tests_co19_2_src_LibTest_isolate_Isolate_kill_A01_t01/out.dill /b/s/w/ir/tests/co19_2/src/LibTest/isolate/Isolate/kill_A01_t01.dart --packages=/b/s/w/ir/.packages -Ddart.developer.causal_async_stacks=true

exit code:
0

--- Command "vm" (took 08:00.000272s):
DART_CONFIGURATION=DebugSIMDBC64 out/DebugSIMDBC64/dart --sync-async --ignore-unrecognized-flags --packages=/b/s/w/ir/.packages /b/s/w/ir/out/DebugSIMDBC64/generated_compilations/dartk/tests_co19_2_src_LibTest_isolate_Isolate_kill_A01_t01/out.dill

exit code:
-15

diagnostics:
Process list including children: [31973]
Trying to capture stack trace for pid 31973
PID 31973 - process
TID 31973:
#0  0x00007f670f8e9404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x000056501d834654 dart::Monitor::WaitMicros(long)
#2  0x000056501da8913a Dart_RunLoop
#3  0x000056501d48fe06 dart::bin::RunMainIsolate(char const*, dart::bin::CommandLineOptions*)
#4  0x000056501d490bf7 dart::bin::main(int, char**)
#5  0x000056501d4915f9 main
#6  0x00007f670f027f45 __libc_start_main
#7  0x000056501d48f029 _start
TID 31974:
#0  0x00007f670f1046d3 epoll_wait
#1  0x000056501d49a005 dart::bin::EventHandlerImplementation::Poll(unsigned long)
#2  0x000056501d4c37fe dart::bin::ThreadStart(void*)
#3  0x00007f670f8e5184 start_thread
#4  0x00007f670f10403d __clone
TID 31984:
#0  0x00007f670f8e9404 pthread_cond_wait@@GLIBC_2.3.2
#1  0x000056501d834654 dart::Monitor::WaitMicros(long)
#2  0x000056501da3f36a dart::BackgroundCompiler::Run()
#3  0x000056501d8f217c dart::ThreadPool::Worker::Loop()
#4  0x000056501d8f1c5a dart::ThreadPool::Worker::Main(unsigned long)
#5  0x000056501d833875 dart::ThreadStart(void*)
#6  0x00007f670f8e5184 start_thread
#7  0x00007f670f10403d __clone

stdout:
unittest-suite-wait-for-done

--- Re-run this test:
python tools/test.py -n dartk-linux-debug-simdbc64 co19_2/LibTest/isolate/Isolate/kill_A01_t01