tarantool / tarantool-qa

QA related issues of Tarantool
3 stars 0 forks source link

Flaky test box-luatest/gh_8192_feedback_daemon_metrics_test.lua #312

Closed ylobankov closed 1 year ago

ylobankov commented 1 year ago

Test box-luatest/gh_8192_feedback_daemon_metrics_test.lua is very unstable. It has failed 254 times for last 30 days.

Screenshot 2023-04-07 at 17 16 55

Failure example:

[006] box-luatest/gh_8192_feedback_daemon_metrics_te>                 [ fail ]
[006] Test failed! Output from reject file /tmp/t/rejects/box-luatest/gh_8192_feedback_daemon_metrics.reject:
[006] Tarantool version is 3.0.0-entrypoint-159-ga6c577c0d
[006] TAP version 13
[006] 1..6
[006] # Started on Fri Apr  7 16:56:51 2023
[006] # Starting group: Feedback daemon metrics
[006] default | 'strip_core' is set but unsupported
[006] not ok 1  Feedback daemon metrics.test_metrics
[006] #   ...est/box-luatest/gh_8192_feedback_daemon_metrics_test.lua:70: Values are not almost equal
[006] #   Actual: 3, expected: 30, delta 27 above margin of 25
[006] #   stack traceback:
[006] #     ...est/box-luatest/gh_8192_feedback_daemon_metrics_test.lua:41: in function 'Feedback daemon metrics.test_metrics'
[006] #     ...
[006] #     [C]: in function 'xpcall'
[006] #   artifacts:
[006] #     default -> /tmp/t/006_box-luatest/artifacts/default-swmXxCvtRw0R
[006] ok 2  # SKIP ...est/box-luatest/gh_8192_feedback_daemon_metrics_test.lua:83: (no reason specified)
[006] not ok 3  Feedback daemon metrics.test_metrics_no_collect
[006] #   ...est/box-luatest/gh_8192_feedback_daemon_metrics_test.lua:101: expected: nil, actual: {{1, 2}}
[006] #   stack traceback:
[006] #     ...est/box-luatest/gh_8192_feedback_daemon_metrics_test.lua:92: in function 'Feedback daemon metrics.test_metrics_no_collect'
[006] #     ...
[006] #     [C]: in function 'xpcall'
[006] ok     4  Feedback daemon metrics.test_disable_metrics
[006] ok     5  Feedback daemon metrics.test_metrics_old_version
[006] ok     6  Feedback daemon metrics.test_memory_limit
[006] # Ran 5 tests in 2.386 seconds, 3 succeeded, 2 failed, 1 skipped
Totktonada commented 1 year ago

See also https://github.com/tarantool/tarantool/commit/3ac464be11fd42bf63950412aca81f4aa8d129bd.