search

grafana / mimir

Grafana Mimir provides horizontally scalable, highly available, multi-tenant, long-term storage for Prometheus.
https://grafana.com/oss/mimir/
GNU Affero General Public License v3.0
4.11k stars 526 forks source link

Flaky `TestIngester_Push_CircuitBreaker_DeadlineExceeded` #9740

Open dimitarvdimitrov opened 1 day ago

dimitarvdimitrov commented 1 day ago 
--- FAIL: TestIngester_Push_CircuitBreaker_DeadlineExceeded (4.01s)
    --- FAIL: TestIngester_Push_CircuitBreaker_DeadlineExceeded/test_slow_push_with_initial_delay_disabled (2.00s)
        circuitbreaker_test.go:868: 
                Error Trace:    /__w/mimir/mimir/pkg/ingester/circuitbreaker_test.go:868
                Error:          Received unexpected error:
                                circuit breaker open on push request type with remaining delay 9.999971526s
                Test:           TestIngester_Push_CircuitBreaker_DeadlineExceeded/test_slow_push_with_initial_delay_disabled
method=Ingester.Shipper.Sync level=info msg="uploading new block to long-term storage" block=00000000010000000000000000
method=Ingester.Shipper.Sync level=debug msg="uploaded file" from=/tmp/TestShipper_DeceivingUploadErrors3414665781/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper_DeceivingUploadErrors3414665781/002"
method=Ingester.Shipper.Sync level=error msg="uploading new block to long-term storage failed" block=00000000010000000000000000 err="upload meta file: base name matches, will fail upload"
FAIL
dimitarvdimitrov commented 1 day ago

@duricanikolic does this ring any bells? I see mostly your name around this test