search

nephio-project / nephio

Nephio is a Kubernetes-based automation platform for deploying and managing highly distributed, interconnected workloads such as 5G Network Functions, and the underlying infrastructure on which those workloads depend.
Apache License 2.0
104 stars 53 forks source link

porch: packagevariant leaves lingering packages after an error during delete #642

Open liamfallon opened 5 months ago

liamfallon commented 5 months ago

Original issue URL: https://github.com/kptdev/kpt/issues/3878 Original issue user: https://github.com/johnbelamaric Original issue created at: 2023-03-13T19:06:04Z Original issue last updated at: 2023-03-18T00:18:30Z Original issue body: ### Expected behavior Package variant resource will not be finalized until the underlying package revisions are deleted.

Actual behavior

If an error occurs during deletion, the resource is still deleted but the revision remains.

Information

I think that's what happened.

I have two PackageVariantSets. One targets the "edge" package at "edge" repos, the other targets the "distribution" package at "regional" repos.

Notice the second line here - the "distribution" package in the "edge-02" repo.

image

Initially, I messed up my label selectors and ended up with both packages in every repo. I fixed, that, and it most packages got cleaned up. But this one lingers. On top of that, this is the same repo exhibiting #3877 so that may be related.

Below are some logs. During the course of these log entries, I:

  1. Created a bogus repo (jbelamaric-us-regional-1-edge-01). You can ignore errors related to that.
  2. Updated all the repos to point to a new GH repos - that is why the initial errors complain about not being allowed to create outside of the directory, then those errors go away. You can ignore those, I filed a separate issue for that.
  3. Created to PVSs with no label selectors, which resulted in lots too many packages.
  4. Modified those PVSs to have the right label selectors, which resulted in most getting cleaned up as expected.

PackageVariant"={"name":"cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" "namespace"="default" "reconcileID"="e7bc0eba-250c-4a9c-a866-98f8e371114c"
I0313 17:59:13.775374       1 packagevariant_controller.go:253] package variant "cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" is creating package revision ""
E0313 17:59:13.790501       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: cannot create cachingdns-edge outside of repository directory \"us-east2-regional\"" "PackageVariant"={"name":"cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" "namespace"="default" "reconcileID"="8726e387-6975-4c46-bd66-076f6c8c5401"
I0313 17:59:13.790724       1 packagevariant_controller.go:253] package variant "cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" is creating package revision ""
E0313 17:59:13.806605       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: cannot create cachingdns-edge outside of repository directory \"us-east2-regional\"" "PackageVariant"={"name":"cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" "namespace"="default" "reconcileID"="4e67c0b0-781e-461e-80d5-7734d15393aa"
I0313 17:59:13.807042       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 17:59:21.236935       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="e666f0dd-3111-4f66-ad51-c816de773207"
E0313 17:59:21.700693       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="d8593223-96ac-4130-878c-14e326d5d30d"
I0313 17:59:36.293245       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="c422fd0a-6171-434a-8b93-4ce1803c5913"
I0313 17:59:51.442873       1 packagevariant_controller.go:391] package variant "cachingdns-distribution-e70d94512a16274168e15bf45a4bd4af16a81af4" is deleting package revision "nephio-testorg-packages-b8a77c9291ed23c13374d15c95701290bca620c4"
I0313 17:59:52.955121       1 packagevariant_controller.go:391] package variant "cachingdns-edge-81efd5d48a18a6c3e5375dbae96e483f65afd166" is deleting package revision "nephio-testorg-packages-2b25be17935446aa51259603f04aea26c7395c83"
I0313 18:01:09.450966       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="55a948ee-5795-450a-8e5f-8bb2591abcd6"
I0313 18:02:55.582905       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"jbelamaric-us-regional-1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="jbelamaric-us-regional-1-edge-01" "namespace"="default" "reconcileID"="a36d9471-8281-4b1f-8141-060042ef79b7"
I0313 18:02:55.666802       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"jbelamaric-us-regional-1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="jbelamaric-us-regional-1-edge-01" "namespace"="default" "reconcileID"="1213723a-fa7a-4b0c-a851-f4a10abbc907"
I0313 18:03:32.021923       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="aaa2239d-2b76-4650-85ac-74c057dac55f"
W0313 18:03:52.625216       1 reflector.go:347] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: watch of *v1alpha1.PackageRevision ended with: very short watch: pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Unexpected watch close - watch lasted less than a second and no items received
W0313 18:03:54.070075       1 reflector.go:424] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:03:54.070311       1 reflector.go:140] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
W0313 18:03:57.053514       1 reflector.go:424] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:03:57.053552       1 reflector.go:140] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:00.740643       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="5bf45fc4-b5b5-45ae-b4e1-de2e7f7c201e"
I0313 18:04:01.030191       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="f5438b21-d24f-4a0f-831f-03c3579b3d40"
I0313 18:04:01.348121       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="d0509244-6f04-4fff-9bc0-64675dcabda5"
I0313 18:04:01.502832       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-01" "namespace"="default" "reconcileID"="084f13d5-380a-4a38-a3ff-807b6b54f320"
W0313 18:04:01.562450       1 reflector.go:424] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:01.562486       1 reflector.go:140] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:01.617193       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="e3277a68-3556-416f-88da-6c9b31d276fb"
I0313 18:04:01.880571       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="2002eb10-0def-4768-b9b9-8c35714d0a3c"
I0313 18:04:02.158217       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="84656ce9-a03e-42a2-a14f-5e7168f9b673"
I0313 18:04:02.543854       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="4aaa8843-5a53-48fb-8973-f1b3e97c544e"
I0313 18:04:03.228167       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="2f14b48d-f439-474c-b117-b92374ecd589"
I0313 18:04:03.612069       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="57a93f6f-cf28-4f4c-afad-f74144b6d103"
I0313 18:04:03.869995       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="3d04cc15-d882-4b67-9bd5-bffa30815cbb"
I0313 18:04:04.120911       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="d4bbc4f5-5831-4663-8d7a-13be99e4a705"
W0313 18:04:12.401806       1 reflector.go:424] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:12.401927       1 reflector.go:140] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
W0313 18:04:29.539444       1 reflector.go:424] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
E0313 18:04:29.539488       1 reflector.go:140] pkg/mod/k8s.io/client-go@v0.25.3/tools/cache/reflector.go:169: Failed to watch *v1alpha1.PackageRevision: failed to list *v1alpha1.PackageRevision: cannot fetch repository default/jbelamaric-us-regional-1-edge-01: repository not found
I0313 18:04:51.501319       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="22dd6269-c7b1-45dc-bd9e-04767d1e97ad"
I0313 18:04:52.191673       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="e87c24bf-fc98-43f5-b0c4-cf6c15a7ac55"
I0313 18:04:52.845884       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="2a77164d-2bb1-4013-98cf-e8eb5ad8475a"
I0313 18:04:53.480927       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-regional" "namespace"="default" "reconcileID"="41496c4a-cd74-429f-b574-e282157ba175"
I0313 18:04:54.224204       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="bec405a0-c9cd-47cc-bc59-8fd1c2271b91"
I0313 18:04:54.812948       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="2a5cd583-165f-498f-a6a0-3b2ef7558993"
I0313 18:04:55.468464       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="24a6ccde-e281-46c7-8f26-6311579340f3"
I0313 18:04:56.102471       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-01" "namespace"="default" "reconcileID"="254110c0-6dc0-46d0-92cd-29170d335473"
I0313 18:04:56.752269       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-regional-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-regional-02" "namespace"="default" "reconcileID"="81de1c65-a269-4b1d-aa00-1b1a7a2a7fb5"
I0313 18:04:57.159524       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-04","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-04" "namespace"="default" "reconcileID"="3e642b4e-13f9-41ca-90aa-ebabffebf5bc"
I0313 18:04:57.400774       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="8fa46897-6ff8-4731-af4e-8ca290953e5d"
I0313 18:07:00.506806       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-0217939f628bf54afb6943a0627f3d09fe742e9d" is creating package revision ""
E0313 18:07:00.691127       1 packagevariantset_controller.go:87] could not update status: %!w(*errors.StatusError=&{{{ } {   <nil>} Failure Operation cannot be fulfilled on packagevariantsets.config.porch.kpt.dev "cachingdns-distribution": the object has been modified; please apply your changes to the latest version and try again Conflict 0xc001a5aea0 409}})
I0313 18:07:10.600419       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-3db2beebe861a3635cb29dbc0b2796831b45e722" is creating package revision ""
I0313 18:07:20.725135       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-52cb15c06dc9252e966897bde315bc6b2e06af4f" is creating package revision ""
I0313 18:07:31.699647       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 18:07:36.849268       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-03","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-03" "namespace"="default" "reconcileID"="527c8d75-a4ab-4b9e-9a6b-c311ce1d196f"
E0313 18:07:40.988387       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="11e7bd73-3f53-4361-b113-929d7a884b33"
I0313 18:07:40.988782       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:07:51.201757       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-da1f6e67333a94395f762b408610024a06551cf6" is creating package revision ""
I0313 18:08:01.270323       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-1e718cfbdb754e386474da9aa91bd159ed27c6d7" is creating package revision ""
I0313 18:08:11.583944       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-e70d94512a16274168e15bf45a4bd4af16a81af4" is creating package revision ""
I0313 18:08:22.098916       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-d1579cce150353b437bdaa9845702b33f0900cdc" is creating package revision ""
I0313 18:08:32.092352       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-d03b4237896078449f4eefd10654a507dc05a5c2" is creating package revision ""
I0313 18:08:41.775837       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-54154c218b775b84e280258f12f684c813e76c49" is creating package revision ""
I0313 18:08:51.780863       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-3474f7e88ab1a657f0f8789641859c5496138bbb" is creating package revision ""
I0313 18:09:01.890495       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa0bd84da557680b052811b54e528625c13907cf" is creating package revision ""
I0313 18:09:12.108607       1 packagevariant_controller.go:253] package variant "cachingdns-edge-edf34f330bd64333cb936090fb4682e1d84f0159" is creating package revision ""
I0313 18:09:14.834905       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-01","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-01" "namespace"="default" "reconcileID"="443b86d8-baee-45fe-9270-13733d667fb6"
I0313 18:09:22.088533       1 packagevariant_controller.go:253] package variant "cachingdns-edge-5fa03feb18a7c84b9d679feaf238fa30b77d0367" is creating package revision ""
I0313 18:09:32.053636       1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:09:41.520419       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="cb295f3f-328a-4b0b-a8cf-9c207429f2ce"
I0313 18:09:41.520692       1 packagevariant_controller.go:253] package variant "cachingdns-edge-d2e51383eec3a112e1eff888b8b7d79f2666dd70" is creating package revision ""
I0313 18:09:51.678636       1 packagevariant_controller.go:253] package variant "cachingdns-edge-81efd5d48a18a6c3e5375dbae96e483f65afd166" is creating package revision ""
I0313 18:09:52.942476       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east2-regional" "namespace"="default" "reconcileID"="46fc8bf6-1144-4e87-ad76-904365342b5d"
I0313 18:10:02.374747       1 packagevariant_controller.go:253] package variant "cachingdns-edge-596ce7b3b682f6eb284d7c1aec74aaaf179ad834" is creating package revision ""
I0313 18:10:12.177360       1 packagevariant_controller.go:253] package variant "cachingdns-edge-3cc7f3a7d7f8d27acc6375cba42b5cc168d70fa0" is creating package revision ""
I0313 18:10:21.909806       1 packagevariant_controller.go:253] package variant "cachingdns-edge-1814fa6e4e19c2507662a33a34990cc2aa10d90c" is creating package revision ""
I0313 18:10:30.526326       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central2-regional","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central2-regional" "namespace"="default" "reconcileID"="0c0e5ca6-d81b-4071-b4dc-33bdc8394fa5"
I0313 18:10:31.975924       1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:10:41.585061       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-central1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-central1-edge-02" "namespace"="default" "reconcileID"="cf84b7ab-acca-452e-925f-4356fd6c30a4"
I0313 18:10:42.007707       1 packagevariant_controller.go:253] package variant "cachingdns-edge-2f8615dd1c070224361d0837bbeb825c7306a223" is creating package revision ""
I0313 18:10:44.245933       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-packages" "namespace"="default" "reconcileID"="129d4337-3db7-4018-8b45-0c971b72c71c"
I0313 18:10:51.998386       1 packagevariant_controller.go:253] package variant "cachingdns-edge-3db6d6fd4034d91b43cfba1b3f214b338dd2c13e" is creating package revision ""
I0313 18:11:02.268616       1 packagevariant_controller.go:253] package variant "cachingdns-edge-44f604043046c915ea89667128b276b9c03211b7" is creating package revision ""
I0313 18:11:11.992835       1 packagevariant_controller.go:253] package variant "cachingdns-edge-6b3bac48e67223051e4e47b5c52095eda9c1ee35" is creating package revision ""
I0313 18:11:18.030204       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"us-east1-edge-02","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="us-east1-edge-02" "namespace"="default" "reconcileID"="dde34ef7-3f6a-48f3-af4f-38184fd0e6c8"
I0313 18:11:21.884452       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
I0313 18:11:22.416078       1 oci.go:39]  "msg"="repository doesn't contain functions" "Repository"={"name":"nephio-testorg-packages","namespace":"default"} "controller"="repository" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="Repository" "name"="nephio-testorg-packages" "namespace"="default" "reconcileID"="3fd1ddd7-3d3d-4b18-8a98-443b035933a3"
E0313 18:11:31.180325       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="c1fabba7-7482-436f-8d27-04cea22f71f6"
I0313 18:11:31.180555       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:11:41.025162       1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:11:50.510744       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="6b9044c6-7070-4735-bb06-fa93d9a6bc1f"
I0313 18:11:50.511850       1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I0313 18:12:00.786544       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:10.181175       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="7a08c516-531d-4d55-b139-fe3c4ce8606a"
I0313 18:12:10.182091       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:12:20.403966       1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:12:29.799489       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="f811d6ad-0252-4bb2-8c80-1b36ab3eaa8b"
I0313 18:12:29.802730       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:38.994049       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="7d67d989-9941-4362-bc42-3c19f8730815"
I0313 18:12:38.995388       1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:12:48.283880       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="71340528-3b30-49bb-be60-0706831204bf"
I0313 18:12:48.285383       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" is creating package revision ""
E0313 18:12:57.990042       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-distribution-508e9c44d7aea66403e66010097caf4e67e376e4" "namespace"="default" "reconcileID"="fc1017fa-27db-4a34-9487-505718fc1c77"
I0313 18:12:57.993438       1 packagevariant_controller.go:253] package variant "cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" is creating package revision ""
E0313 18:13:07.700514       1 controller.go:326]  "msg"="Reconciler error" "error"="Internal error occurred: authentication required" "PackageVariant"={"name":"cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43","namespace":"default"} "controller"="packagevariant" "controllerGroup"="config.porch.kpt.dev" "controllerKind"="PackageVariant" "name"="cachingdns-edge-aacdc2391bc862f00f83fc15f6901573d8c3fa43" "namespace"="default" "reconcileID"="97c47e8c-4a04-4e1b-9aff-72c116fc25b8"
I0313 18:13:07.701225       1 packagevariant_controller.go:253] package variant "cachingdns-distribution-aa744beda50aeca1e21e30a4f051925feb1a2ce1" is creating package revision ""
I0313 18:13:17.589477       1 packagevariant_controller.go:253] package variant "cachingdns-edge-2795d42dbf61192c4c66795f7f35fe2589106ad7" is creating package revision ""
I

Original issue comments:
liamfallon commented 3 months ago

This looks like a serious issue we should address in R4.