Flakey CI builds - Githubissues

cyberark / conjur-oss-helm-chart

Helm chart for deploying Conjur OSS to Kubernetes

Apache License 2.0

28 stars 24 forks source link

Flakey CI builds #73

Closed sgnn7 closed 3 years ago

sgnn7 commented 4 years ago

Summary

CI daily builds seem to have frequent failures from flaky tests.

Steps to Reproduce

Steps to reproduce the behavior:

Go to https://jenkins.conjur.net/job/cyberark--conjur-oss-helm-chart/job/master/
See unstable results

Expected Results

Green builds

Actual Results (including error logs, if applicable)

Sporadic failures

Reproducible

[ ] Always
[x] Sometimes
[ ] Non-Reproducible

Version/Tag number

Latest/master

Environment setup

Jenkins

Additional Information

N/A

diverdane commented 4 years ago

Looks like the cluster bringup used to take about 2 minutes consistently, and now it's taking ~3 minutes, which is what our wait-for-Conjur time is set for. That is, looks like we may be on the hairy edge of working in time. I'm wondering if we're being affected by image pull times.

Build #62 failed waiting for Conjur server at 3 minutes.
For Build #63, Conjur server came up right at the brink of 3 minutes, but then the Helm test failed 5 minutes later.

izgeri commented 4 years ago

I added this to the epic I'm creating to track broken / flaky builds, but I'm not sure this is still relevant?

izgeri commented 3 years ago

@diverdane is this still relevant, or can it be closed?

izgeri commented 3 years ago

Closing, as this no longer seems to be an issue.