search

crossplane-contrib / provider-upjet-aws

Official AWS Provider for Crossplane by Upbound.
https://marketplace.upbound.io/providers/upbound/provider-aws
Apache License 2.0
142 stars 121 forks source link

[Bug]: Crossplane forgets an already created resource by itself (Subnet, SubnetCidrReservation, SecurityGroupRule, NetworkACLRule) #1482

Open woranhun opened 1 week ago

woranhun commented 1 week ago

Is there an existing issue for this?

Affected Resource(s)

ec2.aws.upbound.io/v1beta1 - Subnet ec2.aws.upbound.io/v1beta1 - SubnetCidrReservation ec2.aws.upbound.io/v1beta1 - SecurityGroupRule ec2.aws.upbound.io/v1beta1 - NetworkACLRule

Resource MRs required to reproduce the bug

        {
            "apiVersion": "ec2.aws.upbound.io/v1beta1",
            "kind": "Subnet",
            "metadata": {
                "annotations": {
                    "crossplane.io/composition-resource-name": "subnet-100.64.4.0/28-1-nd-cmg-vrf-pcc-vpc-main-gp0821v-rk4qg-p7wtg",
                    "crossplane.io/external-create-pending": "2024-08-30T12:11:21Z",
                    "crossplane.io/external-create-succeeded": "2024-08-30T12:11:21Z"
                },
                "creationTimestamp": "2024-08-30T12:07:24Z",
                "finalizers": [
                    "finalizer.managedresource.crossplane.io"
                ],
                "generateName": "gp0821v-rk4qg-",
                "generation": 2,
                "labels": {
                    "accountId": "123456789000",
                    "crossplane.io/claim-name": "gp0821v",
                    "crossplane.io/claim-namespace": "default",
                    "crossplane.io/composite": "gp0821v-rk4qg"
                },
                "name": "gp0821v-rk4qg-6km8s",
                "ownerReferences": [
                    {
                        "apiVersion": "saas.nokia.com/v1alpha1",
                        "blockOwnerDeletion": true,
                        "controller": true,
                        "kind": "XNetworkDomain",
                        "name": "gp0821v-rk4qg-p7wtg",
                        "uid": "f45e5bb9-8802-4874-8522-725f6bba20d4"
                    }
                ],
                "resourceVersion": "5578758",
                "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d"
            },
            "spec": {
                "deletionPolicy": "Delete",
                "forProvider": {
                    "availabilityZone": "eu-north-1a",
                    "cidrBlock": "100.64.4.0/28",
                    "mapPublicIpOnLaunch": false,
                    "region": "eu-north-1",
                    "tags": {
                        "Name": "tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg",
                        "crossplane-kind": "subnet.ec2.aws.upbound.io",
                        "crossplane-name": "gp0821v-rk4qg-6km8s",
                        "crossplane-providerconfig": "123456789000",
                        "subnetExposure": "tra",
                        "subnetName": "1",
                        "subnetType": "multus",
                        "subnetVrf": "pcc",
                        "vpcName": "main"
                    },
                    "vpcId": "vpc-0ca7c49c0e6dbb400"
                },
                "initProvider": {},
                "managementPolicies": [
                    "*"
                ],
                "providerConfigRef": {
                    "name": "123456789000"
                }
            },
            "status": {
                "atProvider": {},
                "conditions": [
                    {
                        "lastTransitionTime": "2024-08-30T12:07:27Z",
                        "reason": "Creating",
                        "status": "False",
                        "type": "Ready"
                    },
                    {
                        "lastTransitionTime": "2024-08-30T12:07:27Z",
                        "reason": "ReconcileSuccess",
                        "status": "True",
                        "type": "Synced"
                    },
                    {
                        "lastTransitionTime": "2024-08-30T12:07:29Z",
                        "reason": "Success",
                        "status": "True",
                        "type": "LastAsyncOperation"
                    }
                ]
            }
        },

Steps to Reproduce

We were not able to deterministically reproduce this issue. This issue happens randomly when creating multiple resources of the above.

What happened?

Sometimes when we create a MR via Crossplane the tfID returned from AWS after a successful resource creation is not saved to the "crossplane.io/external-name" annotation. During the next reconciliation a Diff is again detected with the same content as previously. Therefore, Crossplane sends another request to AWS but it fails because the resource already exists on AWS side.

See subnet-create-fail.log for further details. We observed the same behavior with the creation of Subnet, SubnetCidrReservation, SecurityGroupRule, NetworkACLRule.

We also provided a working example subnet-create-ok.log. As you can see the same MR manifest sometimes provides a failed result.

Relevant logs:

Relevant Error Output Snippet

provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:25Z DEBUG   provider-aws    Connecting to the service provider  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z DEBUG   provider-aws    Observing the external resource {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z DEBUG   provider-aws    Diff detected   {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:26Z DEBUG   provider-aws    Async create starting...    {"trackerUID": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "resourceName": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "tfID": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z DEBUG   provider-aws    Creating the external resource  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z DEBUG   provider-aws    Successfully requested creation of external resource    {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5574795", "external-name": "", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:27Z DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    Calling the inner handler for Update event. {"gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "name": "gp0821v-rk4qg-6km8s", "queueLength": 0}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    Connecting to the service provider  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    ongoing async operation {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "opType": "create"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    External resource is up to date {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575071", "external-name": "", "requeue-after": "2024-08-30T12:12:35Z"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:28Z DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Connecting to the service provider  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Async create ended. {"trackerUID": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "resourceName": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "error": null, "tfID": "subnet-085bfcb6fda3cebf5"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Observing the external resource {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Diff detected   {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Waiting for external resource existence to be confirmed {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575071", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:29Z DEBUG   provider-aws    Reconcile request has been requeued.    {"gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "name": "gp0821v-rk4qg-6km8s", "rateLimiterName": "", "when": "0s"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Connecting to the service provider  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Observing the external resource {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Diff detected   {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Waiting for external resource existence to be confirmed {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575212", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:30Z DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:31Z DEBUG   provider-aws    Connecting to the service provider  {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z DEBUG   provider-aws    Observing the external resource {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z DEBUG   provider-aws    Diff detected   {"uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "name": "gp0821v-rk4qg-6km8s", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=Subnet", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"arn\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"assign_ipv6_address_on_creation\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"availability_zone\":*terraform.ResourceAttrDiff{Old:\"\", New:\"eu-north-1a\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"availability_zone_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100.64.4.0/28\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"enable_dns64\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_a_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"enable_resource_name_dns_aaaa_record_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_cidr_block_association_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"ipv6_native\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"map_public_ip_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"owner_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"private_dns_hostname_type_on_launch\":*terraform.ResourceAttrDiff{Old:\"\", New:\"\", NewComputed:true, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.%\":*terraform.ResourceAttrDiff{Old:\"0\", New:\"9\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.Name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra-pcc-multus-1-a-vpc-main-gp0821v-rk4qg\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-kind\":*terraform.ResourceAttrDiff{Old:\"\", New:\"subnet.ec2.aws.upbound.io\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-name\":*terraform.ResourceAttrDiff{Old:\"\", New:\"gp0821v-rk4qg-6km8s\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.crossplane-providerconfig\":*terraform.ResourceAttrDiff{Old:\"\", New:\"123456789000\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetExposure\":*terraform.ResourceAttrDiff{Old:\"\", New:\"tra\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetType\":*terraform.ResourceAttrDiff{Old:\"\", New:\"multus\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.subnetVrf\":*terraform.ResourceAttrDiff{Old:\"\", New:\"pcc\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"tags_all.vpcName\":*terraform.ResourceAttrDiff{Old:\"\", New:\"main\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:false, Sensitive:false, Type:0x0}, \"vpc_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"vpc-0ca7c49c0e6dbb400\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z DEBUG   provider-aws    Waiting for external resource existence to be confirmed {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}, "uid": "3d1af587-9924-450e-bfb4-d329b5a31e5d", "version": "5575212", "external-name": ""}
provider-aws-ec2-5fbe87351f45-5dfff875c8-ljrwn package-runtime 2024-08-30T12:07:32Z DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=subnet", "request": {"name":"gp0821v-rk4qg-6km8s"}}

Crossplane Version

v1.16.0

Provider Version

v1.11.0; v1.13.0

Kubernetes Version

v1.29.7-eks-a18cd3a

Kubernetes Distribution

EKS

Additional Info

FYI: @janosdubovszky @bobh66

bobh66 commented 1 week ago

Another example:

apiVersion: ec2.aws.upbound.io/v1beta1
kind: NetworkACLRule
metadata:
  annotations:
    crossplane.io/composition-resource-name: rule-nacl-permit-all-ingress-10.254.1.0/24-all-0-65535-nacl-acl-0fe2a88c9076d3be6-vrf-sigext-vpc-main-rg-network-k2rbw-5f4bbf59d5
    crossplane.io/external-create-failed: "2024-09-06T15:25:47Z"
    crossplane.io/external-create-pending: "2024-09-06T15:25:47Z"
    crossplane.io/external-create-succeeded: "2024-09-06T14:55:51Z"
  creationTimestamp: "2024-09-06T14:55:20Z"
  finalizers:
  - finalizer.managedresource.crossplane.io
  generateName: rg-network-k2rbw-
  generation: 1
  labels:
    accountId: "xxxxxxxx"
    crossplane.io/claim-name: rg-network
    crossplane.io/claim-namespace: claims-66db15b61bc75e2143e08048
    crossplane.io/composite: rg-network-k2rbw
  name: rg-network-k2rbw-f2shz

the external-name is missing so the provider doesn't know that it created the resource already.

bobh66 commented 1 week ago 
2024-09-06T14:55:20Z    DEBUG   provider-aws    Calling the inner handler for Create event. {"gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "name": "rg-network-k2rbw-f2shz", "queueLength": 0}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Connecting to the service provider  {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Observing the external resource {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Diff detected   {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"10.254.1.0/24\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"egress\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"from_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"0\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"network_acl_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"acl-0fe2a88c9076d3be6\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"protocol\":*terraform.ResourceAttrDiff{Old:\"\", New:\"-1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_action\":*terraform.ResourceAttrDiff{Old:\"\", New:\"allow\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_number\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"to_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"65535\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Async create starting...    {"trackerUID": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "resourceName": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "tfID": ""}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Creating the external resource  {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Successfully requested creation of external resource    {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590732", "external-name": "", "external-name": ""}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Calling the inner handler for Update event. {"gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "name": "rg-network-k2rbw-f2shz", "queueLength": 0}
2024-09-06T14:55:20Z    DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Connecting to the service provider  {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    ongoing async operation {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "opType": "create"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    External resource is up to date {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590781", "external-name": "", "requeue-after": "2024-09-06T15:00:19Z"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Connecting to the service provider  {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Async create ended. {"trackerUID": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "resourceName": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "error": null, "tfID": "nacl-989123708"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Instance state not found in cache, reconstructing...    {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Observing the external resource {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Diff detected   {"uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "name": "rg-network-k2rbw-f2shz", "gvk": "ec2.aws.upbound.io/v1beta1, Kind=NetworkACLRule", "instanceDiff": "*terraform.InstanceDiff{mu:sync.Mutex{state:0, sema:0x0}, Attributes:map[string]*terraform.ResourceAttrDiff{\"cidr_block\":*terraform.ResourceAttrDiff{Old:\"\", New:\"10.254.1.0/24\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"egress\":*terraform.ResourceAttrDiff{Old:\"\", New:\"false\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"from_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"0\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"network_acl_id\":*terraform.ResourceAttrDiff{Old:\"\", New:\"acl-0fe2a88c9076d3be6\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"protocol\":*terraform.ResourceAttrDiff{Old:\"\", New:\"-1\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_action\":*terraform.ResourceAttrDiff{Old:\"\", New:\"allow\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"rule_number\":*terraform.ResourceAttrDiff{Old:\"\", New:\"100\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}, \"to_port\":*terraform.ResourceAttrDiff{Old:\"\", New:\"65535\", NewComputed:false, NewRemoved:false, NewExtra:interface {}(nil), RequiresNew:true, Sensitive:false, Type:0x0}}, Destroy:false, DestroyDeposed:false, DestroyTainted:false, RawConfig:cty.NilVal, RawState:cty.NilVal, RawPlan:cty.NilVal, Meta:map[string]interface {}(nil)}"}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Waiting for external resource existence to be confirmed {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}, "uid": "c7b6217a-3e63-4494-89ef-f76d7f6f0cf5", "version": "1590781", "external-name": ""}
2024-09-06T14:55:21Z    DEBUG   provider-aws    Reconciling {"controller": "managed/ec2.aws.upbound.io/v1beta1, kind=networkaclrule", "request": {"name":"rg-network-k2rbw-f2shz"}}
bobh66 commented 1 week ago

@ulucinar this seems to be a timing issue where the external-name annotation is never added to the resource, or the update fails and the name gets lost is the process.

Can you think of anything that we could try to collect more information, or are there known upjet issues in this area that need to be addressed? Thanks!

bobh66 commented 1 week ago

Related issues and code:

https://github.com/crossplane-contrib/provider-upjet-aws/issues/1346#issuecomment-2220336366

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_subnet.go#L202

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_subnet_cidr_reservation.go#L100

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_security_group_rule.go#L253

https://github.com/hashicorp/terraform-provider-aws/blob/main/internal/service/ec2/vpc_network_acl_rule.go#L185