elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
12.14k stars 4.91k forks source link

Detect failures in CSP inputs and metricsets #39505

Open zmoog opened 4 months ago

zmoog commented 4 months ago

Situation

2 weeks ago, a simple version bump of the core aws-sdk-go-v2 module to 1.26.1 put the AWS SDK module versions mix in an inconsistent state, causing error in multiple AWS inputs and metricsets.

We are addressing this specific error at https://github.com/elastic/beats/pull/39454

Problem Statement

While we could consider this an edge case, the current suite did not catch the dependency problem.

We should probably:

zmoog commented 4 months ago

To improve dependency management, we're setting up Dependabot to handle SDK dependency updates for all major CSPs. See https://github.com/elastic/beats/issues/39492 for more.

elasticmachine commented 3 months ago

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

zmoog commented 1 month ago

Understand why the test suite did not catch the dependency problem.

We didn't catch the dependency problem because the PR introducing the new dependency didn't have the aws label.

The CI runs the AWS integration tests suite only if the PR has the aws label.