RamenDR / ramen

Apache License 2.0
73 stars 53 forks source link

envtest flake: VolumeReplicationGroupVolRepController in primary state [It] set VRG's S3 profile names to empty #1407

Closed ELENAGER closed 3 months ago

ELENAGER commented 4 months ago

Here is the failure: https://github.com/RamenDR/ramen/actions/runs/9159215401/job/25179128902

• [FAILED] [0.006 seconds] VolumeReplicationGroupVolRepController in primary state [It] set VRG's S3 profile names to empty /home/runner/work/ramen/ramen/controllers/vrg_volrep_test.go:547

Timeline >> 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup.vrginstance Updated VRG Status VolRep pvccount (3), VolSync pvccount(0) DataReady Condition (&Condition{Type:DataReady,Status:True,ObservedGeneration:1,LastTransitionTime:2024-05-20 13:10:59 +0000 UTC,Reason:Ready,Message:PVCs in the VolumeReplicationGroup are ready for use,}) {"VolumeReplicationGroup": {"name":"vrg-zymql","namespace":"envtest-ns-zymql"}, "rid": "f1245f41-4684-4754-8a56-185b5486aa46", "State": "primary"} 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup.vrginstance Exiting processing VolumeReplicationGroup {"VolumeReplicationGroup": {"name":"vrg-zymql","namespace":"envtest-ns-zymql"}, "rid": "f1245f41-4684-4754-8a56-185b5486aa46", "State": "primary"} 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup.vrginstance Delay reset because requeue trumps delay {"VolumeReplicationGroup": {"name":"vrg-zymql","namespace":"envtest-ns-zymql"}, "rid": "f1245f41-4684-4754-8a56-185b5486aa46", "State": "primary", "delay": "0s"} 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup Reconcile return {"VolumeReplicationGroup": {"name":"vrg-zymql","namespace":"envtest-ns-zymql"}, "rid": "f1245f41-4684-4754-8a56-185b5486aa46", "result": {"Requeue":true,"RequeueAfter":0}, "VolRep count": 3, "VolSync count": 0} 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup Exiting reconcile loop {"VolumeReplicationGroup": {"name":"vrg-zymql","namespace":"envtest-ns-zymql"}, "rid": "f1245f41-4684-4754-8a56-185b5486aa46"} 2024-05-20T13:11:00.561Z INFO controllers.VolumeReplicationGroup Entering reconcile loop {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897"} 2024-05-20T13:11:00.564Z DEBUG controllers.VolumeReplicationGroup VRG status PVC namespace set already {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "PVC": "testpvc-wstts", "namespace": "vh-hhzwd"} 2024-05-20T13:11:00.564Z DEBUG controllers.VolumeReplicationGroup VRG status PVC namespace set already {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "PVC": "testpvc-lrr8m", "namespace": "vh-hhzwd"} 2024-05-20T13:11:00.564Z DEBUG controllers.VolumeReplicationGroup VRG status PVC namespace set already {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "PVC": "testpvc-p62hn", "namespace": "vh-hhzwd"} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Recipe {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "elements": {"PvcSelector":{"LabelSelector":{"matchLabels":{"ramentest":"backmeup"}},"NamespaceNames":["vh-hhzwd"]},"CaptureWorkflow":null,"RecoverWorkflow":null}} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Fetching PersistentVolumeClaims {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "pvcSelector": "app.kubernetes.io/created-by notin (volsync),ramentest=backmeup"} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Found 9 PVCs using label selector app.kubernetes.io/created-by notin (volsync),ramentest=backmeup {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897"} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Fetching VolumeReplicationClass {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "labeled": ""} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Number of Replication Classes {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897", "count": 1} 2024-05-20T13:11:00.564Z INFO controllers.VolumeReplicationGroup Found 3 PVCs targeted for VolRep and 0 targeted for VolSync {"VolumeReplicationGroup": {"name":"test-vrg-east-tw9gc","namespace":"vh-hhzwd"}, "rid": "b81917b0-49ed-41fc-a2b1-841b1e6a1897"} [FAILED] in [It] - /home/runner/work/ramen/ramen/controllers/vrg_volrep_test.go:1411 @ 05/20/24 13:11:00.564 << Timeline

[FAILED] Expected success, but got an error: <*errors.StatusError | 0xc00200c960>: Operation cannot be fulfilled on volumereplicationgroups.ramendr.openshift.io "vrg-zymql": the object has been modified; please apply your changes to the latest version and try again { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Operation cannot be fulfilled on volumereplicationgroups.ramendr.openshift.io \"vrg-zymql\": the object has been modified; please apply your changes to the latest version and try again", Reason: "Conflict", Details: { Name: "vrg-zymql", Group: "ramendr.openshift.io", Kind: "volumereplicationgroups", UID: "", Causes: nil, RetryAfterSeconds: 0, }, Code: 409, }, } In [It] at: /home/runner/work/ramen/ramen/controllers/vrg_volrep_test.go:1411 @ 05/20/24 13:11:00.564

••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••••SSSSSSS••S•••••••••••••••

Summarizing 1 Failure: [FAIL] VolumeReplicationGroupVolRepController in primary state [It] set VRG's S3 profile names to empty /home/runner/work/ramen/ramen/controllers/vrg_volrep_test.go:1411

Ran 306 of 314 Specs in 79.799 seconds FAIL! -- 305 Passed | 1 Failed | 0 Pending | 8 Skipped --- FAIL: TestAPIs (79.81s) FAIL coverage: 67.6% of statements FAIL github.com/ramendr/ramen/controllers 79.863s ok github.com/ramendr/ramen/controllers/cel 8.747s coverage: [no statements] ok github.com/ramendr/ramen/controllers/util 8.373s coverage: 19.9% of statements ok github.com/ramendr/ramen/controllers/volsync 23.008s coverage: 57.6% of statements FAIL make: *** [Makefile:141: test] Error 1 Error: Process completed with exit code 2.