operator-framework / operator-lifecycle-manager

A management framework for extending Kubernetes with Operators
https://olm.operatorframework.io
Apache License 2.0
1.72k stars 545 forks source link

Flake: Operator Group intersection #2379

Open timflannagan opened 3 years ago

timflannagan commented 3 years ago

The Operator Group intersection test is almost at permafailing status - it's almost always reproducible when running locally, focusing on the intersection It block: https://github.com/operator-framework/operator-lifecycle-manager/blob/master/test/e2e/operator_groups_e2e_test.go#L816.

Example log when running locally, focusing on that individual test:

waiting for d-xvpjb to have installplan ref
15:51:58.6981:  (): nil
waiting for d-xvpjb to have installplan ref
15:51:59.7104:  (): nil
waiting for d-xvpjb to have installplan ref
15:52:00.6979:  (): nil
waiting for d-xvpjb to have installplan ref
...
• Failure [411.088 seconds]
Operator Group
/home/tflannag/Documents/operator-framework/operator-lifecycle-manager/test/e2e/operator_groups_e2e_test.go:34
  intersection [It]
  /home/tflannag/Documents/operator-framework/operator-lifecycle-manager/test/e2e/operator_groups_e2e_test.go:816

    Error Trace:    operator_groups_e2e_test.go:944
                                runner.go:113
                                runner.go:64
                                it_node.go:26
                                spec.go:215
                                spec.go:138
                                spec_runner.go:200
                                spec_runner.go:170
                                spec_runner.go:66
                                suite.go:79
                                ginkgo_dsl.go:238
                                ginkgo_dsl.go:213
                                e2e_test.go:59
    Error:          Received unexpected error:
                    timed out waiting for the condition
    Test:           Operator Group intersection

  /home/tflannag/Documents/operator-framework/operator-lifecycle-manager/vendor/github.com/stretchr/testify/require/require.go:1231
timflannagan commented 3 years ago
$ k get sub -A
NAMESPACE   NAME      PACKAGE   SOURCE          CHANNEL
d-gnwz9     d-kgb7w   d-mfmms   catalog-bvjj6   stable
$  k get ip -A
No resources found
$ k get csv -A
NAMESPACE                    NAME            DISPLAY          VERSION     REPLACES   PHASE
operator-lifecycle-manager   packageserver   Package Server   0.0.0-dev              Succeeded
$ k get sub -A
NAMESPACE   NAME      PACKAGE   SOURCE          CHANNEL
d-gnwz9     d-kgb7w   d-mfmms   catalog-bvjj6   stable
$ k get sub -A -o yaml
apiVersion: v1
items:
- apiVersion: operators.coreos.com/v1alpha1
  kind: Subscription
  metadata:
    creationTimestamp: "2021-09-29T20:00:52Z"
    generation: 1
    labels:
      operators.coreos.com/d-mfmms.d-gnwz9: ""
    name: d-kgb7w
    namespace: d-gnwz9
    resourceVersion: "1148"
    uid: 3a9b9686-8ecb-4b8c-a4c8-1aefd9efdb33
  spec:
    channel: stable
    installPlanApproval: Automatic
    name: d-mfmms
    source: catalog-bvjj6
    sourceNamespace: d-gnwz9
    startingCSV: d-mfmms-stable
  status:
    catalogHealth:
    - catalogSourceRef:
        apiVersion: operators.coreos.com/v1alpha1
        kind: CatalogSource
        name: catalog-bvjj6
        namespace: d-gnwz9
        resourceVersion: "1126"
        uid: b5ef3a19-7fd7-4b87-8b35-c54d4739720a
      healthy: true
      lastUpdated: "2021-09-29T20:00:53Z"
    - catalogSourceRef:
        apiVersion: operators.coreos.com/v1alpha1
        kind: CatalogSource
        name: operatorhubio-catalog
        namespace: operator-lifecycle-manager
        resourceVersion: "1068"
        uid: 9c3e91a4-1738-48c9-aeb9-510172efa694
      healthy: true
      lastUpdated: "2021-09-29T20:00:53Z"
    conditions:
    - lastTransitionTime: "2021-09-29T20:00:53Z"
      message: all available catalogsources are healthy
      reason: AllCatalogSourcesHealthy
      status: "False"
      type: CatalogSourcesUnhealthy
    lastUpdated: "2021-09-29T20:00:53Z"
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""
dinhxuanvu commented 3 years ago

Will address this flake with upcoming PR.