search

grafana / mimir

Grafana Mimir provides horizontally scalable, highly available, multi-tenant, long-term storage for Prometheus.
https://grafana.com/oss/mimir/
GNU Affero General Public License v3.0
3.98k stars 503 forks source link

Flaky TestSchedulerProcessor_processQueriesOnSingleStream #7888

Open pracucci opened 4 months ago

pracucci commented 4 months ago

Seen a flaky run of TestSchedulerProcessor_processQueriesOnSingleStream (CI):

--- FAIL: TestSchedulerProcessor_processQueriesOnSingleStream (1.65s)
    --- FAIL: TestSchedulerProcessor_processQueriesOnSingleStream/should_not_cancel_query_execution_if_scheduler_client_returns_a_non-cancellation_error (0.51s)
        scheduler_processor_test.go:253: 
                Error Trace:    /__w/mimir/mimir/pkg/querier/worker/scheduler_processor_test.go:253
                Error:          Not equal: 
                                expected: 2
                                actual  : 1
                Test:           TestSchedulerProcessor_processQueriesOnSingleStream/should_not_cancel_query_execution_if_scheduler_client_returns_a_non-cancellation_error
                Messages:       Expected number of calls (2) does not match the actual number of calls (1).
FAIL
FAIL    github.com/grafana/mimir/pkg/querier/worker 4.198s
zenador commented 1 month ago

Another example in https://github.com/grafana/mimir/actions/runs/9909349624/job/27377221017?pr=8685:

--- FAIL: TestSchedulerProcessor_processQueriesOnSingleStream (1.54s)
    --- FAIL: TestSchedulerProcessor_processQueriesOnSingleStream/should_not_cancel_query_execution_if_scheduler_client_returns_a_non-cancellation_error (0.52s)
        scheduler_processor_test.go:255: 
                Error Trace:    /__w/mimir/mimir/pkg/querier/worker/scheduler_processor_test.go:255
                Error:          Not equal: 
                                expected: 2
                                actual  : 1
                Test:           TestSchedulerProcessor_processQueriesOnSingleStream/should_not_cancel_query_execution_if_scheduler_client_returns_a_non-cancellation_error
                Messages:       Expected number of calls (2) does not match the actual number of calls (1).