search

GoogleCloudPlatform / terraform-google-enterprise-application

Deploy an enterprise developer platform on Google Cloud
https://registry.terraform.io/modules/GoogleCloudPlatform/enterprise-application/google
Apache License 2.0
30 stars 15 forks source link

Reoccurring error in appsource-verify CI test (servicemesh) #158

Closed apeabody closed 5 months ago

apeabody commented 5 months ago

Last successful CI test started May 24, 2024, 9:16:13 PM:

Initial observed failure CI test started May 26, 2024, 8:00:46 PM

The error presents during appsource-verify as:

"resource mapping not found for name: \"frontend\" namespace: \"\" from \"/workspace/stable/manifest.yaml\": no matches for kind \"DestinationRule\" in version \"networking.istio.io/v1beta1\"\nensure CRDs are installed first\nresource mapping not found for name: \"frontend\" namespace: \"\" from \"/workspace/stable/manifest.yaml\": no matches for kind \"VirtualService\" in version \"networking.istio.io/v1beta1\"\nensure CRDs are installed first\n"

This is because servicemesh failed to install on the cluster(s) during the earlier stages and so the CRDs are not present:

gcloud container hub features describe servicemesh
createTime: '2024-05-29T13:54:40.160204448Z'
fleetDefaultMemberConfig:
  mesh:
    management: MANAGEMENT_AUTOMATIC
membershipSpecs:
  projects/361776789833/locations/us-central1/memberships/cluster-us-central1-development:
    mesh:
      management: MANAGEMENT_AUTOMATIC
    origin:
      type: USER
membershipStates:
  projects/{}/locations/us-central1/memberships/cluster-us-central1-development:
    servicemesh:
      controlPlaneManagement:
        details:
        - code: REVISION_STALLED
          details: 'Failed to provision: asm-managed'
        state: STALLED
      dataPlaneManagement:
        details:
        - code: MANAGED_CONTROL_PLANE_REQUIRED
          details: Requires active managed control plane.
        state: FAILED_PRECONDITION
    state:
      code: ERROR
      description: 'Revision reporting unhealthy: asm-managed. Please visit https://cloud.google.com/service-mesh/docs/troubleshooting/troubleshoot-intro
        for details.'
      updateTime: '2024-05-29T14:03:08.084756592Z'
name: projects/{}/locations/global/features/servicemesh
resourceState:
  state: ACTIVE
spec: {}
updateTime: '2024-05-29T14:02:01.617696060Z'
kubectl describe controlplanerevision asm-managed -n istio-system
Name:         asm-managed
Namespace:    istio-system
Labels:       app.kubernetes.io/created-by=mesh.googleapis.com
              istio.io/owned-by=mesh.googleapis.com
              mesh.cloud.google.com/managed-cni-enabled=true
Annotations:  mesh.cloud.google.com/proxy: {"managed":"true"}
API Version:  mesh.cloud.google.com/v1beta1
Kind:         ControlPlaneRevision
Metadata:
  Creation Timestamp:  2024-05-30T17:17:17Z
  Generation:          1
  Resource Version:    86615
  UID:                 {}
Spec:
  Channel:  regular
  Type:     managed_service
Status:
  Conditions:
    Last Transition Time:  2024-05-30T18:48:51Z
    Message:               The provisioning process has not completed successfully
    Reason:                NotProvisioned
    Status:                False
    Type:                  Reconciled
    Last Transition Time:  2024-05-30T18:48:51Z
    Message:               Provisioning has finished
    Reason:                ProvisioningFinished
    Status:                True
    Type:                  ProvisioningFinished
    Last Transition Time:  2024-05-30T18:48:51Z
    Message:               An internal error has occurred. Please contact customer support. This will be retried within 15 minutes.
    Reason:                ProvisioningFailed
    Status:                True
    Type:                  Stalled
Events:                    <none>

The relevant error message appears to be An internal error has occurred. Please contact customer support. This will be retried within 15 minutes.

apeabody commented 5 months ago

Managed Service Mesh: Failed to provision: asm-managed

apeabody commented 5 months ago

TODO: In addition to MANAGEMENT_AUTOMATIC, we should also validate the membership states:

gcloud container hub features describe servicemesh
createTime: '2024-05-29T13:54:40.160204448Z'
fleetDefaultMemberConfig:
  mesh:
    management: MANAGEMENT_AUTOMATIC
membershipSpecs:
  projects/361776789833/locations/us-central1/memberships/cluster-us-central1-development:
    mesh:
      management: MANAGEMENT_AUTOMATIC
    origin:
      type: USER
membershipStates:
  projects/{}/locations/us-central1/memberships/cluster-us-central1-development:
    servicemesh:
      controlPlaneManagement:
        details:
        - code: REVISION_STALLED
          details: 'Failed to provision: asm-managed'
        state: STALLED
      dataPlaneManagement:
        details:
        - code: MANAGED_CONTROL_PLANE_REQUIRED
          details: Requires active managed control plane.
        state: FAILED_PRECONDITION
    state:
      code: ERROR
      description: 'Revision reporting unhealthy: asm-managed. Please visit https://cloud.google.com/service-mesh/docs/troubleshooting/troubleshoot-intro
        for details.'
      updateTime: '2024-05-29T14:03:08.084756592Z'
name: projects/{}/locations/global/features/servicemesh
resourceState:
  state: ACTIVE
spec: {}
updateTime: '2024-05-29T14:02:01.617696060Z'

https://github.com/GoogleCloudPlatform/terraform-google-enterprise-application/blob/main/test/integration/fleetscope/fleetscope_test.go#L103

CC: @amandakarina

amandakarina commented 5 months ago 
TestFleetscope/development 2024-05-29T18:07:29Z command.go:100: Running command gcloud with args [container hub features describe servicemesh --project eab-gke-development --format json]
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185: {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "createTime": "2024-05-29T12:00:08.078236142Z",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "membershipSpecs": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     "projects/000000000000/locations/us-central1/memberships/cluster-us-central1-production": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "configmanagement": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "configSync": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "git": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gcpServiceAccountEmail": "root-reconciler@eab-gke-production.iam.gserviceaccount.com",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "secretType": "gcpserviceaccount",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "syncRepo": "https://source.developers.google.com/p/eab-gke-production/r/eab-acm"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "sourceFormat": "unstructured"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "policyController": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "enabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "monitoring": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "backends": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "PROMETHEUS",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "CLOUD_MONITORING"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             ]
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "referentialRulesEnabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "templateLibraryInstalled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "updateTime": "2024-05-29T12:00:37.777011195Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     "projects/000000000000/locations/us-east4/memberships/cluster-us-east4-production": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "configmanagement": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "configSync": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "git": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gcpServiceAccountEmail": "root-reconciler@eab-gke-production.iam.gserviceaccount.com",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "secretType": "gcpserviceaccount",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "syncRepo": "https://source.developers.google.com/p/eab-gke-production/r/eab-acm"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "sourceFormat": "unstructured"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "policyController": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "enabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "monitoring": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "backends": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "PROMETHEUS",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "CLOUD_MONITORING"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             ]
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "referentialRulesEnabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "templateLibraryInstalled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "updateTime": "2024-05-29T12:00:28.182967758Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "membershipStates": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     "projects/000000000000/locations/us-central1/memberships/cluster-us-central1-production": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "configmanagement": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "clusterName": "cluster-us-central1-production",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "configSyncState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gitSync": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "reconcilerManager": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "rootReconciler": "INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "reposyncCrd": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "rootsyncCrd": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "state": "CONFIG_SYNC_INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "syncState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "code": "ERROR",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "errors": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "code": "2004",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "errorMessage": "KNV2004: error in the git-sync container: {\"Msg\":\"error syncing repo, will retry\",\"Err\":\"Run(git rev-parse master): exit status 128: { stdout: \\\"master\\\", stderr: \\\"fatal: ambiguous argument 'master': unknown revision or path not in the working tree.\\\\nUse '--' to separate paths from revisions, like this:\\\\n'git \\u003ccommand\\u003e [\\u003crevision\\u003e...] -- [\\u003cfile\\u003e...]'\\\" }\",\"Args\":{\"failCount\":23}}\n\nFor more information, see https://g.co/cloud/acm-errors#knv2004"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             ],
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "lastSyncTime": "2024-05-29T18:07:00Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gitSync": "v4.1.0-gke.7__linux_amd64",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "reconcilerManager": "v1.17.2-rc.1",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "rootReconciler": "v1.17.2-rc.1"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "hierarchyControllerState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "state": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "extension": "NOT_INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "hnc": "NOT_INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {}
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "membershipSpec": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "configSync": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "git": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "gcpServiceAccountEmail": "root-reconciler@eab-gke-production.iam.gserviceaccount.com",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "secretType": "gcpserviceaccount",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "syncRepo": "https://source.developers.google.com/p/eab-gke-production/r/eab-acm"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "sourceFormat": "unstructured"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "hierarchyController": {},
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "policyController": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "enabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "monitoring": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "backends": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "PROMETHEUS",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "CLOUD_MONITORING"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               ]
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "referentialRulesEnabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "templateLibraryInstalled": true
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "operatorState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": "v1.17.2-rc.1"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "policyControllerState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperAudit": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperControllerManagerState": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperMutation": "NOT_INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "migration": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "copyTime": "2024-05-29T12:00:37.777011195Z",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "stage": "POCO_MANAGED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "state": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "code": "ERROR",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "updateTime": "2024-05-29T18:07:13.482389961Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     "projects/000000000000/locations/us-east4/memberships/cluster-us-east4-production": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "configmanagement": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "clusterName": "cluster-us-east4-production",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "configSyncState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gitSync": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "reconcilerManager": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "rootReconciler": "INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "reposyncCrd": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "rootsyncCrd": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "state": "CONFIG_SYNC_INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "syncState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "code": "ERROR",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "errors": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "code": "2004",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "errorMessage": "KNV2004: error in the git-sync container: {\"Msg\":\"error syncing repo, will retry\",\"Err\":\"Run(git rev-parse master): exit status 128: { stdout: \\\"master\\\", stderr: \\\"fatal: ambiguous argument 'master': unknown revision or path not in the working tree.\\\\nUse '--' to separate paths from revisions, like this:\\\\n'git \\u003ccommand\\u003e [\\u003crevision\\u003e...] -- [\\u003cfile\\u003e...]'\\\" }\",\"Args\":{\"failCount\":7}}\n\nFor more information, see https://g.co/cloud/acm-errors#knv2004"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             ],
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "lastSyncTime": "2024-05-29T18:07:11Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gitSync": "v4.1.0-gke.7__linux_amd64",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "reconcilerManager": "v1.17.2-rc.1",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "rootReconciler": "v1.17.2-rc.1"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "hierarchyControllerState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "state": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "extension": "NOT_INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "hnc": "NOT_INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {}
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "membershipSpec": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "configSync": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "git": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "gcpServiceAccountEmail": "root-reconciler@eab-gke-production.iam.gserviceaccount.com",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "secretType": "gcpserviceaccount",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "syncRepo": "https://source.developers.google.com/p/eab-gke-production/r/eab-acm"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "sourceFormat": "unstructured"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "hierarchyController": {},
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "policyController": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "enabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "monitoring": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               "backends": [
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "PROMETHEUS",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:                 "CLOUD_MONITORING"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:               ]
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "referentialRulesEnabled": true,
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "templateLibraryInstalled": true
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "operatorState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": "v1.17.2-rc.1"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "policyControllerState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "deploymentState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperAudit": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperControllerManagerState": "INSTALLED",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "gatekeeperMutation": "NOT_INSTALLED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "migration": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "copyTime": "2024-05-29T12:00:28.182967758Z",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "stage": "POCO_MANAGED"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           "version": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:             "version": "1.17.2"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:           }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       "state": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "code": "ERROR",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:         "updateTime": "2024-05-29T18:07:20.666994453Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:       }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     }
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "name": "projects/eab-gke-production/locations/global/features/configmanagement",
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "resourceState": {
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:     "state": "ACTIVE"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   },
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "spec": {},
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185:   "updateTime": "2024-05-29T12:00:38.810874935Z"
TestFleetscope/production 2024-05-29T18:07:30Z command.go:185: }
apeabody commented 5 months ago

TestFleetscope/development 2024-05-29T18:07:29Z command.go:100: Running command gcloud with args [container hub features describe servicemesh --project eab-gke-development --format json] TestFleetscope/production 2024-05-29T18:07:30Z command.go:185: {

Hey @amandakarina - Given the parallel env testing, this output is actually from two different commands, note the TestFleetscope/development vs TestFleetscope/production prefix.

amandakarina commented 5 months ago

TestFleetscope/development 2024-05-29T18:07:29Z command.go:100: Running command gcloud with args [container hub features describe servicemesh --project eab-gke-development --format json] TestFleetscope/production 2024-05-29T18:07:30Z command.go:185: {

Hey @amandakarina - Given the parallel env testing, this output is actually from two different commands, note the TestFleetscope/development vs TestFleetscope/production prefix.

sorry, The main point of this dump is this message:

KNV2004: error in the git-sync container: {\"Msg\":\"error syncing repo, will retry\",\"Err\":\"Run(git rev-parse master): exit status 128: { stdout: \\\"master\\\", stderr: \\\"fatal: ambiguous argument 'master': unknown revision or path not in the working tree.\\\\nUse '--' to separate paths from revisions, like this:\\\\n'git \\u003ccommand\\u003e [\\u003crevision\\u003e...] -- [\\u003cfile\\u003e...]'\\\" }\",\"Args\":{\"failCount\":23}}\n\nFor more information, see https://g.co/cloud/acm-errors#knv2004"
apeabody commented 5 months ago

TestFleetscope/development 2024-05-29T18:07:29Z command.go:100: Running command gcloud with args [container hub features describe servicemesh --project eab-gke-development --format json] TestFleetscope/production 2024-05-29T18:07:30Z command.go:185: {

Hey @amandakarina - Given the parallel env testing, this output is actually from two different commands, note the TestFleetscope/development vs TestFleetscope/production prefix.

sorry, The main point of this dump is this message:

KNV2004: error in the git-sync container: {\"Msg\":\"error syncing repo, will retry\",\"Err\":\"Run(git rev-parse master): exit status 128: { stdout: \\\"master\\\", stderr: \\\"fatal: ambiguous argument 'master': unknown revision or path not in the working tree.\\\\nUse '--' to separate paths from revisions, like this:\\\\n'git \\u003ccommand\\u003e [\\u003crevision\\u003e...] -- [\\u003cfile\\u003e...]'\\\" }\",\"Args\":{\"failCount\":23}}\n\nFor more information, see https://g.co/cloud/acm-errors#knv2004"

Ahh - Yes, ConfigSync is already running, but the repo isn't populated till the next stage. I don't believe that should interfere, but certain a possibility to investigate! Perhaps we can push an empty branch at repo initialization.