search

GoogleCloudPlatform / pubsec-declarative-toolkit

The GCP PubSec Declarative Toolkit is a collection of declarative solutions to help you on your Journey to Google Cloud. Solutions are designed using Config Connector and deployed using Config Controller.
Apache License 2.0
31 stars 28 forks source link

GKE panic during kpt live apply - panic: runtime error: invalid memory address or nil pointer dereference #580

Open obriensystems opened 9 months ago

obriensystems commented 9 months ago 
policies    ResourceManagerPolicy/compute-disable-ne  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-disable-se  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-disable-vp  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-require-os  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-require-sh  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-require-sh  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-restrict-l  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-restrict-s  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-restrict-v  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-skip-defau  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-trusted-im  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-vm-can-ip-  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/compute-vm-externa  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/essentialcontacts-  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/gcp-restrict-resou  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/iam-allowed-policy  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/iam-disable-servic  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/sql-restrict-publi  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/storage-public-acc  Skipped       Unknown                 -                                         -                                               
policies    ResourceManagerPolicy/storage-uniform-bu  Skipped       Unknown                 -                                         -                                               
projects    ConfigConnectorContext/configconnectorco  Skipped       Unknown                 -                                         -                                               
projects    IAMAuditConfig/logging-project-data-acce  Skipped       Unknown                 -                                         -                                               
projects    IAMPartialPolicy/mgmt-project-cluster-pl  Skipped       Unknown                 -                                         -                                               
projects    IAMPartialPolicy/platform-and-component-  Skipped       Unknown                 -                                         -                                               
projects    IAMPartialPolicy/platform-and-component-  Skipped       Unknown                 -                                         -                                               
projects    IAMPartialPolicy/security-log-bucket-wri  Skipped       Unknown                 -                                         -                                               
projects    RoleBinding/allow-projects-resource-refe  Skipped       Unknown                 -                                         -                                               
projects    RoleBinding/allow-projects-resource-refe  Skipped       Unknown                 -                                         -                                               
projects    RoleBinding/allow-projects-resource-refe  Skipped       Unknown                 -                                         -                                               
projects    Project/dns-project-oi                    Skipped       Unknown                 -                                         -                                               
projects    Project/logging-project-oi                Skipped       Unknown                 -                                         -                                               
projects    Service/dns-project-oi-dns                Skipped       Unknown                 -                                         -                                               
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x1821bb2]

goroutine 757 [running]:
k8s.io/apimachinery/pkg/apis/meta/v1/unstructured.(*Unstructured).GetResourceVersion(...)
        /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.26.9/pkg/apis/meta/v1/unstructured/unstructured.go:282
github.com/GoogleContainerTools/kpt/pkg/live.(*InventoryResourceGroup).ApplyWithPrune(0xc001692ea0?, {0x221cea0?, 0xc002758530?}, {0x223fd10?, 0xc001fa02a0?}, 0x1, {0x68?, 0x92?, 0x1ca6d60?})
        /home/runner/work/kpt/kpt/pkg/live/inventoryrg.go:299 +0x112
sigs.k8s.io/cli-utils/pkg/inventory.(*ClusterClient).Replace(0xc00118c980, {0x22398e8, 0xc000e89040}, {0xc00072b800?, 0x2c, 0x2c}, {0xc000e16000, 0x68, 0x92}, 0x0)
        /home/runner/go/pkg/mod/sigs.k8s.io/cli-utils@v0.35.0/pkg/inventory/inventory-client.go:202 +0x830
sigs.k8s.io/cli-utils/pkg/apply/task.(*DeleteOrUpdateInvTask).updateInventory(0xc000cba300, 0xc000dd8400)
        /home/runner/go/pkg/mod/sigs.k8s.io/cli-utils@v0.35.0/pkg/apply/task/inv_set_task.go:161 +0x294a
sigs.k8s.io/cli-utils/pkg/apply/task.(*DeleteOrUpdateInvTask).Start.func1()
        /home/runner/go/pkg/mod/sigs.k8s.io/cli-utils@v0.35.0/pkg/apply/task/inv_set_task.go:54 +0x3f
created by sigs.k8s.io/cli-utils/pkg/apply/task.(*DeleteOrUpdateInvTask).Start in goroutine 181
        /home/runner/go/pkg/mod/sigs.k8s.io/cli-utils@v0.35.0/pkg/apply/task/inv_set_task.go:49 +0x67
obriensystems commented 9 months ago

recycling cluster

ubectl get pods --all-namespaces
NAMESPACE                         NAME                                                       READY   STATUS    RESTARTS        AGE
cnrm-system                       cnrm-controller-manager-an2pybqaeabb4z3gjrpq-0             1/1     Running   0               3h16m
cnrm-system                       cnrm-controller-manager-qmycxfsx5h3nodk7lssq-0             1/1     Running   0               163m
cnrm-system                       cnrm-deletiondefender-0                                    1/1     Running   0               3h18m
cnrm-system                       cnrm-resource-stats-recorder-5ddf6dff5d-fk9nr              2/2     Running   0               3h18m
cnrm-system                       cnrm-unmanaged-detector-0                                  1/1     Running   0               3h18m
cnrm-system                       cnrm-webhook-manager-769789f764-2spcp                      1/1     Running   0               162m
cnrm-system                       cnrm-webhook-manager-769789f764-l9dz8                      1/1     Running   0               3h18m
cnrm-system                       cnrm-webhook-manager-769789f764-vvmft                      1/1     Running   0               3h18m
config-management-monitoring      otel-collector-85dcff6cb9-mrv8v                            1/1     Running   0               3h16m
config-management-system          config-management-operator-5cbf695585-jj9kx                1/1     Running   0               3h22m
config-management-system          reconciler-manager-6bd756bfbb-mcl9b                        2/2     Running   0               3h22m
configconnector-operator-system   configconnector-operator-0                                 2/2     Running   0               3h22m
gatekeeper-system                 gatekeeper-audit-846bd78f69-lzf94                          1/1     Running   0               3h22m
gatekeeper-system                 gatekeeper-controller-manager-7cf79b95c7-w5hzp             1/1     Running   0               3h22m
gke-gmp-system                    alertmanager-0                                             2/2     Running   2 (3h23m ago)   3h27m
gke-gmp-system                    collector-7bttx                                            2/2     Running   1 (3h19m ago)   3h21m
gke-gmp-system                    collector-7k7bz                                            2/2     Running   2 (3h23m ago)   3h23m
gke-gmp-system                    collector-ntp6w                                            2/2     Running   1 (3h16m ago)   3h17m
gke-gmp-system                    collector-vb2nj                                            2/2     Running   2 (3h23m ago)   3h23m
gke-gmp-system                    gmp-operator-769bd95ddf-jnp9l                              1/1     Running   0               3h27m
gke-gmp-system                    rule-evaluator-846cd74687-6dfrq                            2/2     Running   2 (3h23m ago)   3h24m
krmapihosting-monitoring          krmapihosting-metrics-agent-4lkvx                          1/1     Running   0               96s
krmapihosting-monitoring          krmapihosting-metrics-agent-d9vw8                          1/1     Running   0               102s
krmapihosting-monitoring          krmapihosting-metrics-agent-qgwmd                          1/1     Running   0               100s
krmapihosting-monitoring          krmapihosting-metrics-agent-tlwcm                          1/1     Running   0               98s
krmapihosting-system              bootstrap-5dbbb6b6b5-2wdxt                                 1/1     Running   3 (3h18m ago)   3h25m
kube-system                       anetd-gxfs7                                                1/1     Running   0               3h17m
kube-system                       anetd-lltmp                                                1/1     Running   0               3h24m
kube-system                       anetd-vzhx9                                                1/1     Running   0               3h21m
kube-system                       anetd-zvjkm                                                1/1     Running   0               3h26m
kube-system                       antrea-controller-horizontal-autoscaler-7b69d9bfd7-kgsrj   1/1     Running   0               3h27m
kube-system                       egress-nat-controller-c5f654d7b-l9zmp                      1/1     Running   0               3h27m
kube-system                       event-exporter-gke-7bf6c99dcb-826qg                        2/2     Running   0               3h27m
kube-system                       filestore-node-4vkt4                                       3/3     Running   0               3h26m
kube-system                       filestore-node-6f82g                                       3/3     Running   0               3h24m
kube-system                       filestore-node-crmj2                                       3/3     Running   0               3h21m
kube-system                       filestore-node-tv6kx                                       3/3     Running   0               3h17m
kube-system                       fluentbit-gke-big-8vzqc                                    2/2     Running   0               3h24m
kube-system                       fluentbit-gke-big-z662z                                    2/2     Running   0               3h17m
kube-system                       fluentbit-gke-small-q6jt7                                  2/2     Running   0               3h21m
kube-system                       fluentbit-gke-small-rxmcn                                  2/2     Running   0               3h26m
kube-system                       gcsfusecsi-node-945x5                                      2/2     Running   0               3h17m
kube-system                       gcsfusecsi-node-fmc4z                                      2/2     Running   0               3h24m
kube-system                       gcsfusecsi-node-gbr5q                                      2/2     Running   0               3h26m
kube-system                       gcsfusecsi-node-qcznf                                      2/2     Running   0               3h21m
kube-system                       gke-metadata-server-h5mpb                                  1/1     Running   0               3h21m
kube-system                       gke-metadata-server-kwvv2                                  1/1     Running   0               3h26m
kube-system                       gke-metadata-server-qpl9j                                  1/1     Running   0               3h17m
kube-system                       gke-metadata-server-sl8kh                                  1/1     Running   0               3h24m
kube-system                       gke-metrics-agent-8wffj                                    2/2     Running   0               3h26m
kube-system                       gke-metrics-agent-ct995                                    2/2     Running   0               3h21m
kube-system                       gke-metrics-agent-g89bt                                    2/2     Running   0               3h24m
kube-system                       gke-metrics-agent-gsj69                                    2/2     Running   0               3h17m
kube-system                       image-package-extractor-8lzqf                              1/1     Running   0               3h24m
kube-system                       image-package-extractor-mkgpv                              1/1     Running   0               3h24m
kube-system                       image-package-extractor-mwgft                              1/1     Running   0               3h21m
kube-system                       image-package-extractor-xjjth                              1/1     Running   0               3h17m
kube-system                       ip-masq-agent-n7f9m                                        1/1     Running   0               3h17m
kube-system                       ip-masq-agent-qbrm8                                        1/1     Running   0               3h26m
kube-system                       ip-masq-agent-vsdp9                                        1/1     Running   0               3h24m
kube-system                       ip-masq-agent-xrb9c                                        1/1     Running   0               3h21m
kube-system                       konnectivity-agent-5b687c8dcb-5h5rb                        1/1     Running   0               3h24m
kube-system                       konnectivity-agent-5b687c8dcb-mt2wg                        1/1     Running   0               3h17m
kube-system                       konnectivity-agent-5b687c8dcb-pvzvs                        1/1     Running   0               3h24m
kube-system                       konnectivity-agent-5b687c8dcb-qcxmr                        1/1     Running   0               3h21m
kube-system                       konnectivity-agent-autoscaler-5d9dbcc6d8-59j7r             1/1     Running   0               3h27m
kube-system                       kube-dns-5bfd847c64-7hs5j                                  4/4     Running   0               3h24m
kube-system                       kube-dns-5bfd847c64-csq4v                                  4/4     Running   0               3h28m
kube-system                       kube-dns-autoscaler-84b8db4dc7-6hzrh                       1/1     Running   0               3h28m
kube-system                       l7-default-backend-d86c96845-xxm58                         1/1     Running   0               3h24m
kube-system                       metrics-server-v0.5.2-6bf74b5d5f-zxlh5                     2/2     Running   0               3h24m
kube-system                       netd-8q4zx                                                 1/1     Running   0               3h26m
kube-system                       netd-dwxjm                                                 1/1     Running   0               3h24m
kube-system                       netd-rjdw6                                                 1/1     Running   0               3h21m
kube-system                       netd-xkblb                                                 1/1     Running   0               3h17m
kube-system                       node-local-dns-9q4hp                                       1/1     Running   0               3h24m
kube-system                       node-local-dns-c6rwp                                       1/1     Running   0               3h21m
kube-system                       node-local-dns-ckpww                                       1/1     Running   0               3h26m
kube-system                       node-local-dns-n2pwt                                       1/1     Running   0               3h17m
kube-system                       pdcsi-node-cwrcw                                           2/2     Running   0               3h21m
kube-system                       pdcsi-node-m695m                                           2/2     Running   0               3h17m
kube-system                       pdcsi-node-pr6vt                                           2/2     Running   0               3h26m
kube-system                       pdcsi-node-zqfzw                                           2/2     Running   0               3h24m
resource-group-system             resource-group-controller-manager-74668d66fb-kbmcc         2/2     Running   0               3h22m
deleting lz on kcc-oi3 in region northamerica-northeast1
NAME                                                                AGE     READY   STATUS     STATUS AGE
iamcustomrole.iam.cnrm.cloud.google.com/gke-firewall-admin          3m55s   True    UpToDate   3m48s
iamcustomrole.iam.cnrm.cloud.google.com/tier2-dnsrecord-admin       3m55s   True    UpToDate   3m48s
iamcustomrole.iam.cnrm.cloud.google.com/tier2-vpcpeering-admin      3m55s   True    UpToDate   3m48s
iamcustomrole.iam.cnrm.cloud.google.com/tier3-dnsrecord-admin       3m55s   True    UpToDate   3m48s
iamcustomrole.iam.cnrm.cloud.google.com/tier3-firewallrule-admin    3m54s   True    UpToDate   3m47s
iamcustomrole.iam.cnrm.cloud.google.com/tier3-subnetwork-admin      3m54s   True    UpToDate   3m47s
iamcustomrole.iam.cnrm.cloud.google.com/tier3-vpcsc-admin           3m54s   True    UpToDate   3m47s
iamcustomrole.iam.cnrm.cloud.google.com/tier4-secretmanager-admin   3m53s   True    UpToDate   3m46s

NAME                                                                                       AGE     READY   STATUS     STATUS AGE
iampartialpolicy.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-workload-identity-binding   3m53s   True    UpToDate   3m45s
iampartialpolicy.iam.cnrm.cloud.google.com/hierarchy-sa-workload-identity-binding          3m53s   True    UpToDate   3m45s
iampartialpolicy.iam.cnrm.cloud.google.com/logging-sa-workload-identity-binding            3m53s   True    UpToDate   3m44s
iampartialpolicy.iam.cnrm.cloud.google.com/networking-sa-workload-identity-binding         3m52s   True    UpToDate   3m45s
iampartialpolicy.iam.cnrm.cloud.google.com/policies-sa-workload-identity-binding           3m52s   True    UpToDate   3m44s
iampartialpolicy.iam.cnrm.cloud.google.com/projects-sa-workload-identity-binding           3m52s   True    UpToDate   2m59s

NAME                                                                                                             AGE     READY   STATUS     STATUS AGE
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-editor-permissions                3m52s   True    UpToDate   3m34s
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-serviceaccountadmin-permissions   3m52s   True    UpToDate   3m34s
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-orgroleadmin-permissions                             3m51s   True    UpToDate   3m44s
iampolicymember.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-metric-writer-permissions                          3m51s   True    UpToDate   3m34s
iampolicymember.iam.cnrm.cloud.google.com/hierarchy-sa-folderadmin-permissions                                   3m51s   True    UpToDate   3m15s
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-bigqueryadmin-permissions                                   3m51s   True    UpToDate   3m14s
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-logadmin-permissions                                        3m50s   True    UpToDate   3m25s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-dns-permissions                                          3m50s   True    UpToDate   3m14s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-networkadmin-permissions                                 3m50s   True    UpToDate   3m14s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-security-permissions                                     3m50s   True    UpToDate   3m14s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-service-control-org-permissions                          3m50s   True    UpToDate   3m25s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-servicedirectoryeditor-permissions                       3m49s   True    UpToDate   3m40s
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-xpnadmin-permissions                                     3m49s   True    UpToDate   3m25s
iampolicymember.iam.cnrm.cloud.google.com/policies-sa-orgpolicyadmin-permissions                                 3m49s   True    UpToDate   3m25s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-billinguser-permissions                                    3m49s   True    UpToDate   2m48s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectcreator-permissions                                 3m48s   True    UpToDate   2m55s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectdeleter-permissions                                 3m48s   True    UpToDate   2m37s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectiamadmin-permissions                                3m48s   True    UpToDate   2m37s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectmover-permissions                                   3m47s   True    UpToDate   2m37s
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-serviceusageadmin-permissions                              3m47s   True    UpToDate   2m36s

NAME                                                              AGE     READY   STATUS     STATUS AGE
iamserviceaccount.iam.cnrm.cloud.google.com/gatekeeper-admin-sa   3m47s   True    UpToDate   3m46s
iamserviceaccount.iam.cnrm.cloud.google.com/hierarchy-sa          3m47s   True    UpToDate   3m46s
iamserviceaccount.iam.cnrm.cloud.google.com/logging-sa            3m46s   True    UpToDate   3m45s
iamserviceaccount.iam.cnrm.cloud.google.com/networking-sa         3m46s   True    UpToDate   3m45s
iamserviceaccount.iam.cnrm.cloud.google.com/policies-sa           3m46s   True    UpToDate   3m45s
iamserviceaccount.iam.cnrm.cloud.google.com/projects-sa           3m46s   True    UpToDate   3m

NAME                                                                         AGE     READY   STATUS     STATUS AGE
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-accesscontextmanager   3m49s   True    UpToDate   3m45s
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudbilling           3m48s   True    UpToDate   3m45s
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudresourcemanager   3m48s   True    UpToDate   3m45s
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-serviceusage           3m48s   True    UpToDate   3m45s
delete phase started
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-serviceusage delete successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudresourcemanager delete successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudbilling delete successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-accesscontextmanager delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/projects-sa delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/policies-sa delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/networking-sa delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/logging-sa delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/hierarchy-sa delete successful
iamserviceaccount.iam.cnrm.cloud.google.com/gatekeeper-admin-sa delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-serviceusageadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectmover-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectiamadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectdeleter-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectcreator-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-billinguser-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/policies-sa-orgpolicyadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-xpnadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-servicedirectoryeditor-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-service-control-org-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-security-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-networkadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-dns-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-logadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-bigqueryadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/hierarchy-sa-folderadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-metric-writer-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-orgroleadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-serviceaccountadmin-permissions delete successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-editor-permissions delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/projects-sa-workload-identity-binding delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/policies-sa-workload-identity-binding delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/networking-sa-workload-identity-binding delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/logging-sa-workload-identity-binding delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/hierarchy-sa-workload-identity-binding delete successful
iampartialpolicy.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-workload-identity-binding delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier4-secretmanager-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-vpcsc-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-subnetwork-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-firewallrule-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-dnsrecord-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier2-vpcpeering-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/tier2-dnsrecord-admin delete successful
iamcustomrole.iam.cnrm.cloud.google.com/gke-firewall-admin delete successful
configconnectorcontext.core.cnrm.cloud.google.com/configconnectorcontext.core.cnrm.cloud.google.com delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
namespace/projects delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
namespace/policies delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
namespace/networking delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
namespace/logging delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
namespace/hierarchy delete skipped: inventory policy prevented actuation (strategy: Delete, status: NoMatch, policy: MustMatch)
delete phase finished
reconcile phase started
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-serviceusage reconcile pending
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudresourcemanager reconcile pending
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudbilling reconcile pending
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-accesscontextmanager reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/projects-sa reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/policies-sa reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/networking-sa reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/logging-sa reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/hierarchy-sa reconcile pending
iamserviceaccount.iam.cnrm.cloud.google.com/gatekeeper-admin-sa reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-serviceusageadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectmover-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectiamadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectdeleter-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectcreator-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-billinguser-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/policies-sa-orgpolicyadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-xpnadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-servicedirectoryeditor-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-service-control-org-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-security-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-networkadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-dns-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-logadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-bigqueryadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/hierarchy-sa-folderadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-metric-writer-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-orgroleadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-serviceaccountadmin-permissions reconcile pending
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-editor-permissions reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/projects-sa-workload-identity-binding reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/policies-sa-workload-identity-binding reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/networking-sa-workload-identity-binding reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/logging-sa-workload-identity-binding reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/hierarchy-sa-workload-identity-binding reconcile pending
iampartialpolicy.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-workload-identity-binding reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier4-secretmanager-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier3-vpcsc-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier3-subnetwork-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier3-firewallrule-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier3-dnsrecord-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier2-vpcpeering-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/tier2-dnsrecord-admin reconcile pending
iamcustomrole.iam.cnrm.cloud.google.com/gke-firewall-admin reconcile pending
configconnectorcontext.core.cnrm.cloud.google.com/configconnectorcontext.core.cnrm.cloud.google.com reconcile skipped
namespace/projects reconcile skipped
namespace/policies reconcile skipped
namespace/networking reconcile skipped
namespace/logging reconcile skipped
namespace/hierarchy reconcile skipped
iamserviceaccount.iam.cnrm.cloud.google.com/projects-sa reconcile successful
iamserviceaccount.iam.cnrm.cloud.google.com/policies-sa reconcile successful
iamserviceaccount.iam.cnrm.cloud.google.com/networking-sa reconcile successful
iamserviceaccount.iam.cnrm.cloud.google.com/hierarchy-sa reconcile successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-serviceusage reconcile successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudresourcemanager reconcile successful
iamserviceaccount.iam.cnrm.cloud.google.com/logging-sa reconcile successful
iamserviceaccount.iam.cnrm.cloud.google.com/gatekeeper-admin-sa reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-billinguser-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-logadmin-permissions reconcile successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-accesscontextmanager reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-subnetwork-admin reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-xpnadmin-permissions reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/projects-sa-workload-identity-binding reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/policies-sa-workload-identity-binding reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-vpcsc-admin reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier4-secretmanager-admin reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-dnsrecord-admin reconcile successful
service.serviceusage.cnrm.cloud.google.com/kcc-oi-629-cloudbilling reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier3-firewallrule-admin reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier2-vpcpeering-admin reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/gke-firewall-admin reconcile successful
iamcustomrole.iam.cnrm.cloud.google.com/tier2-dnsrecord-admin reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/networking-sa-workload-identity-binding reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/logging-sa-workload-identity-binding reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/hierarchy-sa-workload-identity-binding reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-serviceusageadmin-permissions reconcile successful
iampartialpolicy.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-workload-identity-binding reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectmover-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectiamadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectcreator-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-servicedirectoryeditor-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-security-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-networkadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-dns-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/logging-sa-bigqueryadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/hierarchy-sa-folderadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/projects-sa-projectdeleter-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/networking-sa-service-control-org-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/policies-sa-orgpolicyadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-editor-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/gatekeeper-admin-sa-metric-writer-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-management-project-serviceaccountadmin-permissions reconcile successful
iampolicymember.iam.cnrm.cloud.google.com/config-control-sa-orgroleadmin-permissions reconcile successful
reconcile phase finished
inventory update started
inventory update finished
delete result: 50 attempted, 44 successful, 6 skipped, 0 failed
reconcile result: 50 attempted, 44 successful, 6 skipped, 0 failed, 0 timed out
Total Duration: 50 sec
Date: Sat 21 Oct 2023 07:07:51 AM UTC
Timestamp: 1697872071
Updated property [core/project].
Switched back to boot project kcc-oi
**** Done ****
michael@cloudshell:~/kcc-oi/github/pubsec-declarative-toolkit/solutions (kcc-oi)$ ./setup.sh -b kcc-oi -u oi -c false -l false -r true -d false -p kcc-oi-629