DataDog / datadog-ci

Use Datadog from your CI.
https://datadoghq.com
Apache License 2.0
129 stars 55 forks source link

[SYNTH-13898] Inform when selective re-run is rate-limited #1367

Closed Drarig29 closed 4 months ago

Drarig29 commented 4 months ago

What and why?

When the internal query that the selective re-run feature does is rate-limited, the endpoint still returns a 200, and re-runs all tests (ignoring the selective re-run).

In that case, the backend now returns a selective_rerun_rate_limited property. This PR adds a log to inform when that happens.

Demo with a rate-limit on staging:

image

How?

Review checklist

datadog-datadog-prod-us1[bot] commented 4 months ago

Datadog Report

Branch report: corentin.girard/SYNTH-13898/inform-rate-limit-selective-rerun Commit report: 78d6625 Test service: datadog-ci-tests

:white_check_mark: 0 Failed, 1556 Passed, 0 Skipped, 1m 54.48s Total duration (1m 30.03s time saved)

teodor2312 commented 4 months ago

internal query that the selective re-run feature does

Just out of curiosity can you tell me what this is?

Drarig29 commented 4 months ago

@teodor2312 this is a query to find the previous batches on the same commit