search

tarantool / test-run

Tarantool functional testing framework
14 stars 15 forks source link

Hanged out test is not reported as failed #388

Open ligurio opened 1 year ago

ligurio commented 1 year ago

Relevant part of log in CI:

[110] etcd-client/etcd_client_error_http_unit_test.l>                 [ pass ]
[110] etcd-client/etcd_client_etcd_unit_test.lua                      [ pass ]
No output during 10 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 20 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 30 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 40 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 51 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 61 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 71 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 81 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 91 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 101 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 111 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 121 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 131 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 141 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 151 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 162 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 172 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 182 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 192 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 202 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 212 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 222 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 232 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 242 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 252 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 263 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 273 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 283 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 293 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 303 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 313 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
No output during 323 seconds. Will abort after 320 seconds without output. List of workers not reporting the status:
- 110_etcd-client [etcd-client/etcd_client_general_integration_test.lua, None] at /tmp/t/110_etcd-client/etcd_client_general_integration.result:0
Test hung! Result content mismatch:
[File does not exist: etcd-client/etcd_client_general_integration.result]

[Main process] No output from workers. It seems that we hang. Send SIGKILL to workers; exiting...
---------------------------------------------------------------------------------
Duration of failed tests (seconds):
*  20.14 etcd-client/etcd_client_auth_integration_test.lua            

Top 10 longest tests (seconds):
*  65.99 replication-luatest/quorum_orphan_test.lua                   
*  53.98 box/gh-5422-broken_snapshot.test.lua                         
*  49.52 app-luatest/http_client_test.lua                             
*  37.09 enterprise-luatest/audit_test.lua                            
*  32.69 replication-luatest/gh_4669_applier_reconnect_test.lua       
*  27.48 sql-tap/in2.test.lua:memtx                                   
*  26.95 enterprise-luatest/flightrec_test.lua                        
*  25.39 replication-luatest/quorum_misc_test.lua                     
*  25.25 wal_off/alter.test.lua                                       
*  24.48 app-luatest/console_debugger_session_test.lua                
---------------------------------------------------------------------------------
Statistics:
* disabled: 167
* pass: 1604 (flaky: 1)
* skip: 3
* fail: 1
Flaked tasks:
- [enterprise-luatest/security_test.lua, null]
# logfile:        /private/tmp/t/log/009_enterprise-luatest.log
# reproduce file: /private/tmp/t/reproduce/009_enterprise-luatest.list.yaml
Failed tasks:
- [etcd-client/etcd_client_auth_integration_test.lua, null]
# logfile:        /private/tmp/t/log/110_etcd-client.log
# reproduce file: /private/tmp/t/reproduce/110_etcd-client.list.yaml
---
- [etcd-client/etcd_client_auth_integration_test.lua, null]
- [etcd-client/etcd_client_auth_integration_test.lua, null]
- [etcd-client/etcd_client_auth_integration_test.lua, null]
- [etcd-client/etcd_client_auth_integration_test.lua, null]
- [etcd-client/etcd_client_client_http_unit_test.lua, null]
- [etcd-client/etcd_client_client_jsstream_unit_test.lua, null]
- [etcd-client/etcd_client_error_etcd_unit_test.lua, null]
- [etcd-client/etcd_client_error_http_unit_test.lua, null]
- [etcd-client/etcd_client_etcd_unit_test.lua, null]
- [etcd-client/etcd_client_general_integration_test.lua, null]
...
* undone: 6
make: *** [.github.mk:31: run-test] Error 1

Full log: https://github.com/tarantool/tarantool-ee/actions/runs/4894130925/jobs/8741182480?pr=444 test-run version affa13f2740f401e540659b58ddef49e8df02607

Raw log: 2.txt

Totktonada commented 1 year ago

Isn't the cause the same as in #382 (which should be fixed by PR #384)?

ligurio commented 1 year ago

I suppose these problems are connected, but about different problems. And I suspect that a fix for #382 will hide a problem described in this issue.

Totktonada commented 1 year ago

I suspect that a fix for #382 will hide a problem described in this issue.

The problem that is described in the issue is the following (quoted the title):

Hanged out test is not reported as failed

That's all the information about the problem except logs.

Using the knowledge about given test (it's from a private repository) I can assume that the issue is about core = luatest test suites.

A hung test from a core = luatest test suite now should be reported as failed due to the added test timeout logic.

As for me, it means that the quoted problem is fixed.

I see no description of another problem that stay there hidden or not.