search

oracle / oci-native-ingress-controller

OCI Native Ingress Controller
https://blogs.oracle.com/cloud-infrastructure/post/oracle-cloud-native-ingress-controller-kubernetes
Universal Permissive License v1.0
17 stars 19 forks source link

BackendSets not being created #56

Closed antoniolago closed 1 month ago

antoniolago commented 2 months ago

Hello, I have installed this controller in a v1.29.1 OKE cluster with an arm64 nodepool These are my install files: https://github.com/antoniolago/free-k8s-oci-tf/tree/master/free-k8s-cluster/oci-native-ingress-controller

And this is my ingress file https://github.com/antoniolago/free-k8s-oci-tf/blob/master/free-k8s-cluster/monitoring/ingress.yaml

The LB is created, but listeners and backendSets not: image

The only backendset created is this one: image

Generating a 400 error when the controller tries to create the backendset's routes: (auth is redacted)

Logs ```I0421 00:09:03.605588 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-04-21 00:09:03.605555407 -0300 -03 m=+10401.051885646" DEBUG 2024/04/21 00:09:03.605819 eventual_consistency.go:331: (pid=1, gid=23140) EcContext.GetEndOfWindow returns DEBUG 2024/04/21 00:09:03.605832 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/04/21 00:09:03.605845 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} I0421 00:09:03.605850 1 loadbalancer.go:202] Creating routing policy with request: { "name": "route_80", "conditionLanguageVersion": "V1", "rules": [ { "name": "k8s_f8532178d8", "condition": "all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')", "actions": [ { "name": "FORWARD_TO_BACKENDSET", "backendSetName": "bs_e38a715fdad0117" } ] } ], "LoadBalancerId": "ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa", "OpcRequestId": null, "OpcRetryToken": null, "IfMatch": null, "RequestMetadata": { "RetryPolicy": null } } DEBUG 2024/04/21 00:09:03.605854 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/04/21 00:09:03.605869 http.go:688: Marshaling to Request: UpdateBackendSetRequest DEBUG 2024/04/21 00:09:03.605888 eventual_consistency.go:331: (pid=1, gid=23173) EcContext.GetEndOfWindow returns DEBUG 2024/04/21 00:09:03.605894 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/04/21 00:09:03.605902 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/04/21 00:09:03.605907 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/04/21 00:09:03.605915 http.go:688: Marshaling to Request: CreateRoutingPolicyRequest DEBUG 2024/04/21 00:09:03.605937 http.go:610: Marshaling to body from field:CreateRoutingPolicyDetails DEBUG 2024/04/21 00:09:03.606049 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId}/routingPolicies DEBUG 2024/04/21 00:09:03.606059 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/04/21 00:09:03.606069 http.go:483: add request id for header: opc-request-id, with value: bb01fa8af0a9d68d053e9841f5f1bd26 DEBUG 2024/04/21 00:09:03.606119 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/04/21 00:09:03.606128 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/04/21 00:09:03.606133 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/04/21 00:09:03.606137 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/04/21 00:09:03.606142 http.go:610: Marshaling to body from field:UpdateBackendSetDetails DEBUG 2024/04/21 00:09:03.606263 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: UrlPath DEBUG 2024/04/21 00:09:03.606273 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Port DEBUG 2024/04/21 00:09:03.606308 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: ReturnCode DEBUG 2024/04/21 00:09:03.606316 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Retries DEBUG 2024/04/21 00:09:03.606321 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: TimeoutInMillis DEBUG 2024/04/21 00:09:03.606326 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: IntervalInMillis DEBUG 2024/04/21 00:09:03.606345 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: ResponseBodyRegex DEBUG 2024/04/21 00:09:03.606371 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: IsForcePlainText DEBUG 2024/04/21 00:09:03.606378 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: SslConfiguration DEBUG 2024/04/21 00:09:03.606383 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: SessionPersistenceConfiguration DEBUG 2024/04/21 00:09:03.606423 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: LbCookieSessionPersistenceConfiguration DEBUG 2024/04/21 00:09:03.606487 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId}/backendSets/{backendSetName} DEBUG 2024/04/21 00:09:03.606522 http.go:606: Marshaling to path from field: BackendSetName in template: /loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/backendSets/{backendSetName} DEBUG 2024/04/21 00:09:03.606559 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/04/21 00:09:03.606566 http.go:483: add request id for header: opc-request-id, with value: dcfc68622da0faac2fd158994d1fb8fd DEBUG 2024/04/21 00:09:03.606573 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/04/21 00:09:03.606600 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/04/21 00:09:03.606616 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/04/21 00:09:03.606624 client.go:604: Attempting to call downstream service DEBUG 2024/04/21 00:09:03.606143 client.go:604: Attempting to call downstream service DEBUG 2024/04/21 00:09:03.611374 client.go:683: Dump Request PUT /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/backendSets/default_ingress HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 190 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT If-Match: "3633896904" Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: dcfc68622da0faac2fd158994d1fb8fd Opc-Retry-Token: Mul5kIAb967EP4CsXc7O5novzOkS9WpB X-Content-Sha256: V4/dqtjqqKY8HladHqawHV/bZLe4bYXeUQdmxv1IDtU= Accept-Encoding: gzip DEBUG 2024/04/21 00:09:03.611470 client.go:683: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: bb01fa8af0a9d68d053e9841f5f1bd26 Opc-Retry-Token: g7A3SzR3YI8xO0pKAG3SEvUQeMETx6yR X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:09:03.724474 client.go:443: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: bb01fa8af0a9d68d053e9841f5f1bd26 Opc-Retry-Token: g7A3SzR3YI8xO0pKAG3SEvUQeMETx6yR X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:09:03.724499 log.go:229: Dump Request Body: {"conditionLanguageVersion":"V1","name":"route_80","rules":[{"actions":[{"backendSetName":"bs_e38a715fdad0117","name":"FORWARD_TO_BACKENDSET"}],"condition":"all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')","name":"k8s_f8532178d8"}]} INFO 2024/04/21 00:09:03.724547 client.go:449: Dump Response HTTP/1.1 400 Bad Request Content-Length: 272 Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Request-Id: bb01fa8af0a9d68d053e9841f5f1bd26/066C67E8F21E288095A6B76D5A9AAB58/197FA07909F1CE387F24F1653E03FB1C Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa" } E0421 00:09:03.724838 1 routingpolicy.go:188] "unable to ensure route policy" err=< Error returned by LoadBalancer Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: bb01fa8af0a9d68d053e9841f5f1bd26/066C67E8F21E288095A6B76D5A9AAB58/197FA07909F1CE387F24F1653E03FB1C. Message: Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa Operation Name: CreateRoutingPolicy Timestamp: 2024-04-21 03:09:03 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://iaas.sa-saopaulo-1.oraclecloud.com/20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this LoadBalancer issue, please contact Oracle support and provide them this full error message. > ingressClass="default-ingress-class" listenerName="route_80" I0421 00:09:03.724893 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="119.331398ms" I0421 00:09:03.724922 1 routingpolicy.go:262] Error syncing routing policy default-ingress-class: error encountered syncing routing policies I0421 00:09:03.724979 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-04-21 00:09:03.724970405 -0300 -03 m=+10401.171300644" I0421 00:09:03.725048 1 loadbalancer.go:202] Creating routing policy with request: { "name": "route_80", "conditionLanguageVersion": "V1", "rules": [ { "name": "k8s_f8532178d8", "condition": "all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')", "actions": [ { "name": "FORWARD_TO_BACKENDSET", "backendSetName": "bs_e38a715fdad0117" } ] } ], "LoadBalancerId": "ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa", "OpcRequestId": null, "OpcRetryToken": null, "IfMatch": null, "RequestMetadata": { "RetryPolicy": null } } DEBUG 2024/04/21 00:09:03.725130 eventual_consistency.go:331: (pid=1, gid=23114) EcContext.GetEndOfWindow returns DEBUG 2024/04/21 00:09:03.725162 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/04/21 00:09:03.725202 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/04/21 00:09:03.725216 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/04/21 00:09:03.725227 http.go:688: Marshaling to Request: CreateRoutingPolicyRequest DEBUG 2024/04/21 00:09:03.725254 http.go:610: Marshaling to body from field:CreateRoutingPolicyDetails DEBUG 2024/04/21 00:09:03.725316 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId}/routingPolicies DEBUG 2024/04/21 00:09:03.725347 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/04/21 00:09:03.725455 http.go:483: add request id for header: opc-request-id, with value: 83c655c46632ef7b013ccfaf0e964c43 DEBUG 2024/04/21 00:09:03.725463 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/04/21 00:09:03.725468 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/04/21 00:09:03.725472 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/04/21 00:09:03.725476 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/04/21 00:09:03.725485 client.go:604: Attempting to call downstream service DEBUG 2024/04/21 00:09:03.729688 client.go:683: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 83c655c46632ef7b013ccfaf0e964c43 Opc-Retry-Token: B4HCPUvnFb3ghNTBf89Ya7M1NDMua6MZ X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:09:03.802666 client.go:443: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 83c655c46632ef7b013ccfaf0e964c43 Opc-Retry-Token: B4HCPUvnFb3ghNTBf89Ya7M1NDMua6MZ X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:09:03.802686 log.go:229: Dump Request Body: {"conditionLanguageVersion":"V1","name":"route_80","rules":[{"actions":[{"backendSetName":"bs_e38a715fdad0117","name":"FORWARD_TO_BACKENDSET"}],"condition":"all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')","name":"k8s_f8532178d8"}]} INFO 2024/04/21 00:09:03.802712 client.go:449: Dump Response HTTP/1.1 400 Bad Request Content-Length: 272 Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Request-Id: 83c655c46632ef7b013ccfaf0e964c43/24E1FC7E1A65E7008B32A68810165DEF/78254082E989F08EDB6E7EBB08D9AB60 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa" } E0421 00:09:03.802865 1 routingpolicy.go:188] "unable to ensure route policy" err=< Error returned by LoadBalancer Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: 83c655c46632ef7b013ccfaf0e964c43/24E1FC7E1A65E7008B32A68810165DEF/78254082E989F08EDB6E7EBB08D9AB60. Message: Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa Operation Name: CreateRoutingPolicy Timestamp: 2024-04-21 03:09:03 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://iaas.sa-saopaulo-1.oraclecloud.com/20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this LoadBalancer issue, please contact Oracle support and provide them this full error message. > ingressClass="default-ingress-class" listenerName="route_80" I0421 00:09:03.802928 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="77.951039ms" I0421 00:09:03.802942 1 routingpolicy.go:262] Error syncing routing policy default-ingress-class: error encountered syncing routing policies DEBUG 2024/04/21 00:09:03.853234 client.go:454: Dump Response HTTP/1.1 204 No Content Content-Length: 0 Content-Type: application/octet-stream Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Request-Id: dcfc68622da0faac2fd158994d1fb8fd/6844F76F7223F00FFE4B91DA1DB98AC4/B896473CE7B4B21F5727AAEFD9866156 Opc-Work-Request-Id: ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaasoodurxw5w4achuszjfx326nh66pzsx7nfiggcllham3gcdj3k7q Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/04/21 00:09:03.853263 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/04/21 00:09:03.853274 http.go:1011: Unmarshaling from header to field: OpcWorkRequestId DEBUG 2024/04/21 00:09:03.853285 http.go:1011: Unmarshaling from header to field: OpcRequestId I0421 00:09:03.853318 1 loadbalancer.go:542] Update backend set response: name: default_ingress, work request id: ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaasoodurxw5w4achuszjfx326nh66pzsx7nfiggcllham3gcdj3k7q, opc request id: dcfc68622da0faac2fd158994d1fb8fd/6844F76F7223F00FFE4B91DA1DB98AC4/B896473CE7B4B21F5727AAEFD9866156. DEBUG 2024/04/21 00:09:03.853373 eventual_consistency.go:331: (pid=1, gid=23182) EcContext.GetEndOfWindow returns DEBUG 2024/04/21 00:09:03.853380 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/04/21 00:09:03.853394 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/04/21 00:09:03.853398 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/04/21 00:09:03.853409 http.go:688: Marshaling to Request: GetWorkRequestRequest DEBUG 2024/04/21 00:09:03.853453 http.go:606: Marshaling to path from field: WorkRequestId in template: /loadBalancerWorkRequests/{workRequestId} DEBUG 2024/04/21 00:09:03.853464 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/04/21 00:09:03.853473 http.go:483: add request id for header: opc-request-id, with value: 812b186c3144c9e44ad975955bdeb2e8 DEBUG 2024/04/21 00:09:03.853479 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/04/21 00:09:03.853484 client.go:604: Attempting to call downstream service DEBUG 2024/04/21 00:09:03.857483 client.go:683: Dump Request GET /20170115/loadBalancerWorkRequests/ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaasoodurxw5w4achuszjfx326nh66pzsx7nfiggcllham3gcdj3k7q HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 812b186c3144c9e44ad975955bdeb2e8 Accept-Encoding: gzip DEBUG 2024/04/21 00:09:03.908507 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 481 Content-Type: application/json Date: Sun, 21 Apr 2024 03:09:03 GMT Opc-Request-Id: 812b186c3144c9e44ad975955bdeb2e8/8D382F8EA19B5BA18AB17F4E6C43509B/A5DE2AAD3E64250AB634EB4AA4A3B930 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/04/21 00:09:03.908533 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/04/21 00:09:03.908540 http.go:1015: Unmarshalling from body to field: WorkRequest DEBUG 2024/04/21 00:09:03.908633 http.go:1011: Unmarshaling from header to field: OpcRequestId I0421 00:10:03.609284 1 nodeBackend.go:96] "Started syncing backends for ingress class" ingressClass="default-ingress-class" startTime="2024-04-21 00:10:03.60925812 -0300 -03 m=+10461.055588359" I0421 00:10:03.609780 1 nodeBackend.go:257] "Syncing default backend" I0421 00:10:03.609786 1 nodeBackend.go:274] "Retrieve default backends" I0421 00:10:03.609791 1 nodeBackend.go:291] "No default backend set for any ingress" I0421 00:10:03.609803 1 loadbalancer.go:476] "no backend update required" lbName="native-ic-lb" lbID="ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa" I0421 00:10:03.609812 1 nodeBackend.go:98] "Finished syncing backends for ingress class" ingressClass="default-ingress-class" duration="546.44µs" I0421 00:10:03.609362 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-04-21 00:10:03.6093442 -0300 -03 m=+10461.055674439" I0421 00:10:03.609870 1 loadbalancer.go:202] Creating routing policy with request: { "name": "route_80", "conditionLanguageVersion": "V1", "rules": [ { "name": "k8s_f8532178d8", "condition": "all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')", "actions": [ { "name": "FORWARD_TO_BACKENDSET", "backendSetName": "bs_e38a715fdad0117" } ] } ], "LoadBalancerId": "ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa", "OpcRequestId": null, "OpcRetryToken": null, "IfMatch": null, "RequestMetadata": { "RetryPolicy": null } } DEBUG 2024/04/21 00:10:03.609933 eventual_consistency.go:331: (pid=1, gid=23340) EcContext.GetEndOfWindow returns DEBUG 2024/04/21 00:10:03.609940 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/04/21 00:10:03.609953 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/04/21 00:10:03.609960 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/04/21 00:10:03.609973 http.go:688: Marshaling to Request: CreateRoutingPolicyRequest DEBUG 2024/04/21 00:10:03.610005 http.go:610: Marshaling to body from field:CreateRoutingPolicyDetails DEBUG 2024/04/21 00:10:03.610069 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId}/routingPolicies DEBUG 2024/04/21 00:10:03.610080 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/04/21 00:10:03.610089 http.go:483: add request id for header: opc-request-id, with value: dbebf273b112feef02e72153cfa4f91c DEBUG 2024/04/21 00:10:03.610098 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/04/21 00:10:03.610103 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/04/21 00:10:03.610107 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/04/21 00:10:03.610111 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/04/21 00:10:03.610117 client.go:604: Attempting to call downstream service DEBUG 2024/04/21 00:10:03.614680 client.go:683: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:10:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: dbebf273b112feef02e72153cfa4f91c Opc-Retry-Token: y9BvyFMQZPZhLplRVg8IrJQyaWEjpUZ1 X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:10:03.701553 client.go:443: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/",algorithm="rsa-sha256",signature="" Content-Type: application/json Date: Sun, 21 Apr 2024 03:10:03 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: dbebf273b112feef02e72153cfa4f91c Opc-Retry-Token: y9BvyFMQZPZhLplRVg8IrJQyaWEjpUZ1 X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/04/21 00:10:03.701577 log.go:229: Dump Request Body: {"conditionLanguageVersion":"V1","name":"route_80","rules":[{"actions":[{"backendSetName":"bs_e38a715fdad0117","name":"FORWARD_TO_BACKENDSET"}],"condition":"all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')","name":"k8s_f8532178d8"}]} INFO 2024/04/21 00:10:03.701614 client.go:449: Dump Response HTTP/1.1 400 Bad Request Content-Length: 272 Content-Type: application/json Date: Sun, 21 Apr 2024 03:10:03 GMT Opc-Request-Id: dbebf273b112feef02e72153cfa4f91c/1BA91AE5BE14B0F0EF91D9F7541D6D95/F5A64DFF6594CB38A0ADF471D47A92A7 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa" } E0421 00:10:03.701703 1 routingpolicy.go:188] "unable to ensure route policy" err=< Error returned by LoadBalancer Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: dbebf273b112feef02e72153cfa4f91c/1BA91AE5BE14B0F0EF91D9F7541D6D95/F5A64DFF6594CB38A0ADF471D47A92A7. Message: Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa Operation Name: CreateRoutingPolicy Timestamp: 2024-04-21 03:10:03 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://iaas.sa-saopaulo-1.oraclecloud.com/20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaajo75w6buyvxazvrqnwz2aagqwgjclaqzrdd4gnvutoaua727qzoa/routingPolicies Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this LoadBalancer issue, please contact Oracle support and provide them this full error message. > ingressClass="default-ingress-class" listenerName="route_80" I0421 00:10:03.701720 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="92.370279ms" I0421 00:10:03.701726 1 routingpolicy.go:262] Error syncing routing policy default-ingress-class: error encountered syncing routing policies ```

Maybe I'm doing something wrong but I've exhausted my attempts, so any help is appreciated.

naguaramaster commented 2 months ago

Did you ckeck the Ingress Parameters yaml ??

It seems to be some parameter that you don't know or could be wrong

Inbaraj-S commented 1 month ago

@antoniolago Please share your entire log from the start. I think the error which caused the backend creation errors were at the begining of the logs.

antoniolago commented 1 month ago

Hello @Inbaraj-S here it is:

Logs from start ```DEBUG 2024/05/07 10:47:45.308057 http.go:167: WARNING json field is tagged with mandatory flags, but the type can not be nil, field name: IpMode DEBUG 2024/05/07 10:47:45.308062 http.go:251: Field ipMode is not present in json, omitting DEBUG 2024/05/07 10:47:45.308070 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: ReservedIps DEBUG 2024/05/07 10:47:45.308075 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Listeners DEBUG 2024/05/07 10:47:45.308081 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Hostnames DEBUG 2024/05/07 10:47:45.308086 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: BackendSets DEBUG 2024/05/07 10:47:45.308094 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: UrlPath DEBUG 2024/05/07 10:47:45.308102 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Port DEBUG 2024/05/07 10:47:45.308107 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: ReturnCode DEBUG 2024/05/07 10:47:45.308112 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Retries DEBUG 2024/05/07 10:47:45.308117 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: TimeoutInMillis DEBUG 2024/05/07 10:47:45.308121 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: IntervalInMillis DEBUG 2024/05/07 10:47:45.308126 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: ResponseBodyRegex DEBUG 2024/05/07 10:47:45.308131 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: IsForcePlainText DEBUG 2024/05/07 10:47:45.308136 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Backends DEBUG 2024/05/07 10:47:45.308141 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: SslConfiguration DEBUG 2024/05/07 10:47:45.308146 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: SessionPersistenceConfiguration DEBUG 2024/05/07 10:47:45.308154 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: LbCookieSessionPersistenceConfiguration DEBUG 2024/05/07 10:47:45.308160 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: NetworkSecurityGroupIds DEBUG 2024/05/07 10:47:45.308165 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Certificates DEBUG 2024/05/07 10:47:45.308170 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: SslCipherSuites DEBUG 2024/05/07 10:47:45.308175 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: PathRouteSets DEBUG 2024/05/07 10:47:45.308180 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: FreeformTags DEBUG 2024/05/07 10:47:45.308185 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: DefinedTags DEBUG 2024/05/07 10:47:45.308193 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: RuleSets DEBUG 2024/05/07 10:47:45.308227 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:47:45.308239 http.go:483: add request id for header: opc-request-id, with value: 4290cdfac61a38bd01621b23f64a11f3 DEBUG 2024/05/07 10:47:45.308248 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/05/07 10:47:45.308253 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:47:45.308259 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:47:45.312277 client.go:683: Dump Request POST /20170115/loadBalancers HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 523 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="cvc8GuSEsjhTGcHrxwCN5Xas7ySCmdBD2ulvVwz+Y6eCGeQ6tk8YAFAAEfrDRco97vGqdVP9rLQ84QENPq+MAFsHoj6MhQnfV59dPnhwNPN7xwkIhjH7VvQrSzUYNIHE9zYK4HmWdaKcfLnUc2U6EG8oz+TMGGHyVBZtN4oPTWGbOkqEhN1bXOA9bdtCoayxm13rNtw22J7BmiNQ1zRITAEsrDUiysxHYzE4S0gnX+zt/pCIfEa6Dp90+2bQGyMwygtjU1k3ab3vVN2y+RIFx64yrshs7YN5R3vp/9yf13DPM6Y6hS/lmZ1b4OSHcwUaD7kW42FVnnGfKgQiWoBVOg==" Content-Type: application/json Date: Tue, 07 May 2024 13:47:45 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 4290cdfac61a38bd01621b23f64a11f3 Opc-Retry-Token: create-lb-db509406-e067-4dd2-aa6c-4492682c3f36 X-Content-Sha256: FpwJStv8vuNVquVXzCWSkWz49jWDE0Z0VtXW6eK0XxA= Accept-Encoding: gzip DEBUG 2024/05/07 10:47:46.120515 client.go:454: Dump Response HTTP/1.1 204 No Content Content-Length: 0 Content-Type: application/octet-stream Date: Tue, 07 May 2024 13:47:45 GMT Opc-Request-Id: 4290cdfac61a38bd01621b23f64a11f3/FBA441364545CA8EEAF4D83AF0B751FB/8804C9FDD0A531626024C7F5B2FC138B Opc-Work-Request-Id: ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaatzv2rv74kxfusex3pnjtl3kevov2lexcn2cqquhk7g5nndzsov7a Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:47:46.120543 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:47:46.120550 http.go:1011: Unmarshaling from header to field: OpcWorkRequestId DEBUG 2024/05/07 10:47:46.120558 http.go:1011: Unmarshaling from header to field: OpcRequestId DEBUG 2024/05/07 10:47:46.120968 eventual_consistency.go:331: (pid=1, gid=256) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:47:46.120980 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:47:46.120994 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:47:46.120999 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:47:46.121017 http.go:688: Marshaling to Request: GetWorkRequestRequest DEBUG 2024/05/07 10:47:46.121061 http.go:606: Marshaling to path from field: WorkRequestId in template: /loadBalancerWorkRequests/{workRequestId} DEBUG 2024/05/07 10:47:46.121069 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:47:46.121080 http.go:483: add request id for header: opc-request-id, with value: 5f2cbb6bce62b2e950f13de8f0fa73ca DEBUG 2024/05/07 10:47:46.121088 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:47:46.121094 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:47:46.125038 client.go:683: Dump Request GET /20170115/loadBalancerWorkRequests/ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaatzv2rv74kxfusex3pnjtl3kevov2lexcn2cqquhk7g5nndzsov7a HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="N5Eres9ndpOXjnPHovDW532z9JDn6mzxzbqKOh9nMmdTsRjM37zdwLKsrZ/w0MJRiD5/XIjr7N2DrulqASEy7qMik5DetkgzAkO48xRgAkYWx8EO/t42ddtU/+BVvVch8MgrqeX8419uikhgf1qrdLHhRC5SM4UN9pwR0L7I8fuYfxnp4hBSTRpt/85sGbha+XmvCFWdkInAVohCA0HE2NpNKtCtiioVSrimdmQR4Tl0UN1KXyJImDE0BdjqpesbA94A9XLkA+miPwH0JvDw5jvYTesOHji/OsUEOGE4mc/5eAuSnDJNmuBrNtvIqyf0Mpn+sHrrZaZ4wfO+ZVG8PQ==" Content-Type: application/json Date: Tue, 07 May 2024 13:47:46 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 5f2cbb6bce62b2e950f13de8f0fa73ca Accept-Encoding: gzip DEBUG 2024/05/07 10:47:46.168638 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 483 Content-Type: application/json Date: Tue, 07 May 2024 13:47:46 GMT Opc-Request-Id: 5f2cbb6bce62b2e950f13de8f0fa73ca/4EB005D46F07A62BCFAF9727FEE52BA2/7C11E0B73099BF5C49479473A6388BA7 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:47:46.168666 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:47:46.168674 http.go:1015: Unmarshalling from body to field: WorkRequest DEBUG 2024/05/07 10:47:46.168777 http.go:1011: Unmarshaling from header to field: OpcRequestId I0507 10:47:55.302116 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:47:55.302102182 -0300 -03 m=+10.464867931" I0507 10:47:55.302596 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="485.84µs" I0507 10:47:55.302611 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:47:55.302604262 -0300 -03 m=+10.465370051" I0507 10:47:55.302621 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="13.84µs" I0507 10:47:55.302122 1 nodeBackend.go:96] "Started syncing backends for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:47:55.302090862 -0300 -03 m=+10.464856651" I0507 10:47:55.302632 1 nodeBackend.go:98] "Finished syncing backends for ingress class" ingressClass="default-ingress-class" duration="537.04µs" I0507 10:47:55.302642 1 nodeBackend.go:96] "Started syncing backends for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:47:55.302636462 -0300 -03 m=+10.465402251" I0507 10:47:55.302647 1 nodeBackend.go:98] "Finished syncing backends for ingress class" ingressClass="default-ingress-class" duration="7.44µs" I0507 10:47:55.302152 1 ingress.go:183] "Started syncing ingress" ingress="monitoring/ingress-monitoring" startTime="2024-05-07 10:47:55.302143062 -0300 -03 m=+10.464908851" I0507 10:47:55.302665 1 ingress.go:185] "Finished syncing ingress" ingress="monitoring/ingress-monitoring" duration="518.88µs" DEBUG 2024/05/07 10:47:56.169017 eventual_consistency.go:331: (pid=1, gid=233) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:47:56.169047 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:47:56.169071 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:47:56.169082 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:47:56.169105 http.go:688: Marshaling to Request: GetWorkRequestRequest DEBUG 2024/05/07 10:47:56.169156 http.go:606: Marshaling to path from field: WorkRequestId in template: /loadBalancerWorkRequests/{workRequestId} DEBUG 2024/05/07 10:47:56.169168 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:47:56.169179 http.go:483: add request id for header: opc-request-id, with value: d13033439fa980d28697c37034c69117 DEBUG 2024/05/07 10:47:56.169188 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:47:56.169196 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:47:56.173700 client.go:683: Dump Request GET /20170115/loadBalancerWorkRequests/ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaatzv2rv74kxfusex3pnjtl3kevov2lexcn2cqquhk7g5nndzsov7a HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="qvs5H3M7MdZggutQmOfTeyVVb7NGzQNHYBDK71Glwp25WJSQVLqLcMQTZl8md4f35/alX6Yb051gVqJOgcjREKNOYa6P9DdvV0dFPe89Zq8dG2jonnGR6KOwImkMRFkIPlE81el0qhLtZtVAwshmCf/XRKFRw0o3Wg3USO2A3sZe4ffr/3wv28PnZlXEx+d+PVyNjHK9ob/f6D+4VKcIbtBXs2asf/UPb0mwB9NrUx3ohKI8+J+volwsaCA08u06YPXKuf8zm5EUoXA0hZh0Y52lR8BD24UsfBHFY8rXXwHmMsMTo++F6Ou9uEluo/Byp4+rfNR6hWD73p+MZvPVow==" Content-Type: application/json Date: Tue, 07 May 2024 13:47:56 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: d13033439fa980d28697c37034c69117 Accept-Encoding: gzip DEBUG 2024/05/07 10:47:56.212827 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 486 Content-Type: application/json Date: Tue, 07 May 2024 13:47:56 GMT Opc-Request-Id: d13033439fa980d28697c37034c69117/37848BAEFE5AF2C3ED92FC2ED93281CA/375E535170E1E88FBD4C86B1A64FE752 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:47:56.212887 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:47:56.212895 http.go:1015: Unmarshalling from body to field: WorkRequest DEBUG 2024/05/07 10:47:56.212952 http.go:1011: Unmarshaling from header to field: OpcRequestId I0507 10:48:25.303761 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:48:25.303734436 -0300 -03 m=+40.466500225" I0507 10:48:25.304342 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="598µs" I0507 10:48:25.305688 1 nodeBackend.go:96] "Started syncing backends for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:48:25.305651236 -0300 -03 m=+40.468417025" I0507 10:48:25.305712 1 nodeBackend.go:98] "Finished syncing backends for ingress class" ingressClass="default-ingress-class" duration="55.72µs" I0507 10:48:25.305729 1 nodeBackend.go:96] "Started syncing backends for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:48:25.305724116 -0300 -03 m=+40.468489905" I0507 10:48:25.305735 1 nodeBackend.go:98] "Finished syncing backends for ingress class" ingressClass="default-ingress-class" duration="8.08µs" I0507 10:48:25.305777 1 routingpolicy.go:103] "Started syncing routing policies for ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:48:25.305770436 -0300 -03 m=+40.468536225" I0507 10:48:25.305788 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="13.88µs" I0507 10:48:25.306872 1 ingress.go:183] "Started syncing ingress" ingress="monitoring/ingress-monitoring" startTime="2024-05-07 10:48:25.306858476 -0300 -03 m=+40.469624265" I0507 10:48:25.306925 1 ingress.go:185] "Finished syncing ingress" ingress="monitoring/ingress-monitoring" duration="61.68µs" DEBUG 2024/05/07 10:48:26.305810 eventual_consistency.go:331: (pid=1, gid=281) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:48:26.305839 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:48:26.305857 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:48:26.305864 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:48:26.305880 http.go:688: Marshaling to Request: GetWorkRequestRequest DEBUG 2024/05/07 10:48:26.305924 http.go:606: Marshaling to path from field: WorkRequestId in template: /loadBalancerWorkRequests/{workRequestId} DEBUG 2024/05/07 10:48:26.305942 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:48:26.305953 http.go:483: add request id for header: opc-request-id, with value: c9bf92135e9d5f1626379204fd24761a DEBUG 2024/05/07 10:48:26.305960 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:48:26.305966 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:48:26.310109 client.go:683: Dump Request GET /20170115/loadBalancerWorkRequests/ocid1.loadbalancerworkrequest.oc1.sa-saopaulo-1.aaaaaaaatzv2rv74kxfusex3pnjtl3kevov2lexcn2cqquhk7g5nndzsov7a HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="CCPxDj+sW/4MOFc/G2+wE/5X7Oxp6xgBb2v10bXJ0MlLtHYNVPFo+QZk5AOfoOprHW7K+EnhCJ9h5v7jKcmaakYxizQUqUA09afDWLBQ+A/MBovpxYwxyicfYoxiUipLzzd5KPvyP9BwCWzkYDHt2j9lzhEegaModZgFnrEAumLF3wtXixaRaiKOw8IKwICAzwwr8HqTDAdZcgB4K4UKzzDJvfxJD72PE2iomDb8mVJThw1uthrDVt3W3lHmp2QIrqT66vBOP69Kr3zP1r9ZfHexUU49X1B0jTUtgAAc+qnWrwhzbeOY8SBxA4m5LuUvfS+1Lq0dkbbpe7Op2Y9xsw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: c9bf92135e9d5f1626379204fd24761a Accept-Encoding: gzip DEBUG 2024/05/07 10:48:26.394867 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 938 Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Opc-Request-Id: c9bf92135e9d5f1626379204fd24761a/2D89DC618AB4EF6C47A6037C4FCDAD54/B0024FCE3B08637BBFE0A4F9BE42E4F8 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:48:26.394901 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:48:26.394908 http.go:1015: Unmarshalling from body to field: WorkRequest DEBUG 2024/05/07 10:48:26.395055 http.go:1011: Unmarshaling from header to field: OpcRequestId DEBUG 2024/05/07 10:48:26.395133 eventual_consistency.go:331: (pid=1, gid=286) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:48:26.395143 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:48:26.395157 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:48:26.395165 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:48:26.395178 http.go:688: Marshaling to Request: GetLoadBalancerRequest DEBUG 2024/05/07 10:48:26.395222 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId} DEBUG 2024/05/07 10:48:26.395231 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:48:26.395241 http.go:483: add request id for header: opc-request-id, with value: fb5f4b080e2f7af3e3593e950f2c42fa DEBUG 2024/05/07 10:48:26.395252 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/05/07 10:48:26.395257 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/05/07 10:48:26.395262 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:48:26.395267 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:48:26.399906 client.go:683: Dump Request GET /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="C7FW/43u5+lJk/EuyIWjrWuFyrAL4U9mwUj0BJBdGR3oESWAjcxIMhxSOWn0TPT5DKuVEACVjZ9zFCYBg7ZmzuxbVL9nv7LyNCN/NLHWi9aEe1/isaNaZ24RCyfQOGj/JyfU9ZIaaQJrLGyA9Hx6pnVVL1j4YTHtHIztGN2F8x28wAyBw28NAZNDWgs97yIm4vmmAkMtmkmcWnfQ2Vnb2Ui8F4q70WWl80WqREHZ5bb99pene3hu5Fq942MBSOs6v1zxVsaBJVOi2+3hvOzVs0NVZRssZ9HDYdcaOd72ZggwXKElC7bvXFI54TxggxiBJHuFQYCt+cRJIoYFbSCzMQ==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: fb5f4b080e2f7af3e3593e950f2c42fa Accept-Encoding: gzip DEBUG 2024/05/07 10:48:26.463429 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 1454 Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Etag: "3689364635" Opc-Request-Id: fb5f4b080e2f7af3e3593e950f2c42fa/F472DB9CCBDF941BFDB95E9BF1B1711D/C0E27C719ECC436664C82D832BC2BA6C Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:48:26.463758 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:48:26.463765 http.go:1015: Unmarshalling from body to field: LoadBalancer DEBUG 2024/05/07 10:48:26.464109 http.go:1011: Unmarshaling from header to field: OpcRequestId DEBUG 2024/05/07 10:48:26.464121 http.go:1011: Unmarshaling from header to field: ETag DEBUG 2024/05/07 10:48:26.464181 eventual_consistency.go:331: (pid=1, gid=220) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:48:26.464234 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:48:26.464256 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:48:26.464261 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:48:26.464383 http.go:688: Marshaling to Request: GetLoadBalancerRequest DEBUG 2024/05/07 10:48:26.464474 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId} DEBUG 2024/05/07 10:48:26.464485 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:48:26.464496 http.go:483: add request id for header: opc-request-id, with value: 9201db1f30463758c21ce9a8bcd9563b DEBUG 2024/05/07 10:48:26.464506 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/05/07 10:48:26.464510 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/05/07 10:48:26.464515 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:48:26.464520 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:48:26.468834 client.go:683: Dump Request GET /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Accept: */* Authorization: Signature version="1",headers="date (request-target) host",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="C7FW/43u5+lJk/EuyIWjrWuFyrAL4U9mwUj0BJBdGR3oESWAjcxIMhxSOWn0TPT5DKuVEACVjZ9zFCYBg7ZmzuxbVL9nv7LyNCN/NLHWi9aEe1/isaNaZ24RCyfQOGj/JyfU9ZIaaQJrLGyA9Hx6pnVVL1j4YTHtHIztGN2F8x28wAyBw28NAZNDWgs97yIm4vmmAkMtmkmcWnfQ2Vnb2Ui8F4q70WWl80WqREHZ5bb99pene3hu5Fq942MBSOs6v1zxVsaBJVOi2+3hvOzVs0NVZRssZ9HDYdcaOd72ZggwXKElC7bvXFI54TxggxiBJHuFQYCt+cRJIoYFbSCzMQ==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 9201db1f30463758c21ce9a8bcd9563b Accept-Encoding: gzip DEBUG 2024/05/07 10:48:26.529635 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 1454 Content-Type: application/json Date: Tue, 07 May 2024 13:48:26 GMT Etag: "3689364635" Opc-Request-Id: 9201db1f30463758c21ce9a8bcd9563b/CFD50F1B89FF3B7FD23999D2EE0FDC23/B55B77F7C78AB904B0EE3A2FB4A14831 Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:48:26.529752 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:48:26.529759 http.go:1015: Unmarshalling from body to field: LoadBalancer DEBUG 2024/05/07 10:48:26.529872 http.go:1011: Unmarshaling from header to field: OpcRequestId DEBUG 2024/05/07 10:48:26.529884 http.go:1011: Unmarshaling from header to field: ETag I0507 10:48:26.530395 1 ingressclass.go:285] "Adding load balancer id to ingress class" lbId="ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa" ingressClass="default-ingress-class" I0507 10:48:26.536057 1 ingressclass.go:107] "Updating ingress class" ingressClass="default-ingress-class" I0507 10:48:26.536902 1 ingressclass.go:300] "checking if updates are required for load balancer" ingressClass="default-ingress-class" I0507 10:48:26.536925 1 ingressclass.go:160] "Finished syncing ingress class" ingressClass="default-ingress-class" duration="41.235571001s" I0507 10:48:26.536947 1 ingressclass.go:158] "Started syncing ingress class" ingressClass="default-ingress-class" startTime="2024-05-07 10:48:26.536937552 -0300 -03 m=+41.699703341" I0507 10:48:26.536966 1 ingressclass.go:300] "checking if updates are required for load balancer" ingressClass="default-ingress-class" I0507 10:48:26.536979 1 ingressclass.go:160] "Finished syncing ingress class" ingressClass="default-ingress-class" duration="37.52µs" If you are unable to resolve this LoadBalancer issue, please contact Oracle support and provide them this full error message. > ingressClass="default-ingress-class" listenerName="route_80" I0507 10:48:35.468653 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="83.401451ms" I0507 10:48:35.468659 1 routingpolicy.go:262] Error syncing routing policy default-ingress-class: error encountered syncing routing policies DEBUG 2024/05/07 10:48:35.471084 client.go:454: Dump Response HTTP/1.1 200 OK Content-Length: 12 Content-Type: application/json Date: Tue, 07 May 2024 13:48:35 GMT Opc-Request-Id: 1d9424fe97dd806494ba40656801311d/A582B546A3B076715B6767C3AF1600A3/31DDA5C35F86A529D586F4F3E3CC3A88 Strict-Transport-Security: max-age=31536000; includeSubDomains Vary: Accept-Encoding X-Content-Type-Options: nosniff X-Content-Type-Options: nosniff DEBUG 2024/05/07 10:48:35.471104 http.go:1039: RawResponse does not contain presentIn tag. Skipping DEBUG 2024/05/07 10:48:35.471110 http.go:1015: Unmarshalling from body to field: CaBundleCollection DEBUG 2024/05/07 10:48:35.471139 http.go:1011: Unmarshaling from header to field: OpcRequestId DEBUG 2024/05/07 10:48:35.471146 http.go:1011: Unmarshaling from header to field: OpcNextPage DEBUG 2024/05/07 10:48:35.471150 http.go:1011: Unmarshalling did not find header with name:opc-next-page I0507 10:48:35.471166 1 util.go:148] Found 0 bundles with name ic-lag0-grafana-certificate in compartment ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha. I0507 10:48:35.471172 1 util.go:153] Found no bundles with name ic-lag0-grafana-certificate in compartment ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha. DEBUG 2024/05/07 10:48:35.474234 eventual_consistency.go:331: (pid=1, gid=385) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:48:35.474255 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:48:35.474272 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:48:35.474277 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:48:35.474289 http.go:688: Marshaling to Request: CreateCaBundleRequest DEBUG 2024/05/07 10:48:35.474315 http.go:610: Marshaling to body from field:CreateCaBundleDetails DEBUG 2024/05/07 10:48:35.474343 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: Description DEBUG 2024/05/07 10:48:35.474432 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: FreeformTags DEBUG 2024/05/07 10:48:35.474481 http.go:167: Adjusting tag: mandatory is false and json tag is valid on field: DefinedTags DEBUG 2024/05/07 10:48:35.474515 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:48:35.474564 http.go:483: add request id for header: opc-request-id, with value: 33340effca7135f2a0ec70019b09ce25 DEBUG 2024/05/07 10:48:35.474589 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/05/07 10:48:35.474601 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:48:35.474608 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:48:35.478580 client.go:683: Dump Request POST /20210224/caBundles HTTP/1.1 Host: certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 153 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="AkuFhNEMtsx6tOLcQQznkUa8ilAFs88mKOqYohcLbygscIy+sHz+zJnoF+PFHZBeV0+N85l0JJex8brbeshhXOJY/smx+S+x5mHvZ6pLJ45Hl7Rrz2Vt8WJkmnMkxlVEJ99t5x6VazVcgXSbVQSXtBjaCSDyDdbQ/VHDfLpIu1wZd0PSIL4X/nty/neZVBDVYkQn8QNFqEBmIrmTc253QsYaP4IT+ywPR5QmhkqRl2hqdx4vkmb4Rlq6wQoI4nQP6YAIMR11ayOu80uDuGwgdPGdKPFTJB/Kp2r0wE9D7Td78dDyp4HjUikhA9qn1UXQcisNSMwYjZ/ao4zFEkuXFw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:35 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 33340effca7135f2a0ec70019b09ce25 Opc-Retry-Token: ic-lag0-grafana-certificate X-Content-Sha256: k0VulLR8aqg3oJTTcCJm6x4jqB2RM4dNiLFgBOnNlTc= Accept-Encoding: gzip INFO 2024/05/07 10:48:35.485722 client.go:443: Dump Request POST /20210224/caBundles HTTP/1.1 Host: certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 153 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="AkuFhNEMtsx6tOLcQQznkUa8ilAFs88mKOqYohcLbygscIy+sHz+zJnoF+PFHZBeV0+N85l0JJex8brbeshhXOJY/smx+S+x5mHvZ6pLJ45Hl7Rrz2Vt8WJkmnMkxlVEJ99t5x6VazVcgXSbVQSXtBjaCSDyDdbQ/VHDfLpIu1wZd0PSIL4X/nty/neZVBDVYkQn8QNFqEBmIrmTc253QsYaP4IT+ywPR5QmhkqRl2hqdx4vkmb4Rlq6wQoI4nQP6YAIMR11ayOu80uDuGwgdPGdKPFTJB/Kp2r0wE9D7Td78dDyp4HjUikhA9qn1UXQcisNSMwYjZ/ao4zFEkuXFw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:35 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: 33340effca7135f2a0ec70019b09ce25 Opc-Retry-Token: ic-lag0-grafana-certificate X-Content-Sha256: k0VulLR8aqg3oJTTcCJm6x4jqB2RM4dNiLFgBOnNlTc= Accept-Encoding: gzip INFO 2024/05/07 10:48:35.485739 log.go:229: Dump Request Body: {"caBundlePem":"","compartmentId":"ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha","name":"ic-lag0-grafana-certificate"} INFO 2024/05/07 10:48:35.485807 client.go:449: Dump Response HTTP/1.1 400 Bad Request Connection: close Content-Length: 95 Content-Type: application/json Date: Tue, 07 May 2024 13:48:35 GMT Opc-Request-Id: 33340effca7135f2a0ec70019b09ce25/4C145997CEC05A6A1089B12C2E7B3034/33B3F003A68679C983D67537C4666458 Strict-Transport-Security: max-age=31536000; includeSubDomains X-Content-Type-Options: nosniff X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "caBundlePem size must be between 1 and 51200" } E0507 10:48:35.485920 1 certificate.go:84] Error creating ca bundle ic-lag0-grafana-certificate, Error returned by CertificatesManagement Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: 33340effca7135f2a0ec70019b09ce25/4C145997CEC05A6A1089B12C2E7B3034/33B3F003A68679C983D67537C4666458. Message: caBundlePem size must be between 1 and 51200 Operation Name: CreateCaBundle Timestamp: 2024-05-07 13:48:35 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com/20210224/caBundles Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. Also see https://docs.oracle.com/iaas/api/#/en/certificatesmgmt/20210224/CaBundle/CreateCaBundle for details on this operation's requirements. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this CertificatesManagement issue, please contact Oracle support and provide them this full error message. I0507 10:48:35.486833 1 ingress.go:185] "Finished syncing ingress" ingress="monitoring/ingress-monitoring" duration="96.725012ms" I0507 10:48:35.486851 1 ingress.go:600] Error syncing ingress monitoring/ingress-monitoring: Error returned by CertificatesManagement Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: 33340effca7135f2a0ec70019b09ce25/4C145997CEC05A6A1089B12C2E7B3034/33B3F003A68679C983D67537C4666458. Message: caBundlePem size must be between 1 and 51200 Operation Name: CreateCaBundle Timestamp: 2024-05-07 13:48:35 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com/20210224/caBundles Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. Also see https://docs.oracle.com/iaas/api/#/en/certificatesmgmt/20210224/CaBundle/CreateCaBundle for details on this operation's requirements. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this CertificatesManagement issue, please contact Oracle support and provide them this full error message. "conditionLanguageVersion": "V1", "rules": [ { "name": "k8s_f8532178d8", "condition": "all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')", "actions": [ { "name": "FORWARD_TO_BACKENDSET", "backendSetName": "bs_e38a715fdad0117" } ] } ], "LoadBalancerId": "ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa", "OpcRequestId": null, "OpcRetryToken": null, "IfMatch": null, "RequestMetadata": { "RetryPolicy": null } } DEBUG 2024/05/07 10:48:45.448661 eventual_consistency.go:331: (pid=1, gid=433) EcContext.GetEndOfWindow returns DEBUG 2024/05/07 10:48:45.448665 retry.go:455: Use default timing and strategy, no EC window set DEBUG 2024/05/07 10:48:45.448677 asm_arm64.s:1172: Retry policy to use: {MaximumNumberAttempts=8, MinSleepBetween=0, MaxSleepBetween=30, ExponentialBackoffBase=2, NonEventuallyConsistentPolicy=} DEBUG 2024/05/07 10:48:45.448681 asm_arm64.s:1172: operation attempt #1 DEBUG 2024/05/07 10:48:45.448689 http.go:688: Marshaling to Request: CreateRoutingPolicyRequest DEBUG 2024/05/07 10:48:45.448713 http.go:610: Marshaling to body from field:CreateRoutingPolicyDetails DEBUG 2024/05/07 10:48:45.448772 http.go:606: Marshaling to path from field: LoadBalancerId in template: /loadBalancers/{loadBalancerId}/routingPolicies DEBUG 2024/05/07 10:48:45.448778 http.go:602: Marshaling to header from field: OpcRequestId DEBUG 2024/05/07 10:48:45.448786 http.go:483: add request id for header: opc-request-id, with value: c719df8897a305d3b0bd19950a3cf7f4 DEBUG 2024/05/07 10:48:45.448792 http.go:602: Marshaling to header from field: OpcRetryToken DEBUG 2024/05/07 10:48:45.448796 http.go:602: Marshaling to header from field: IfMatch DEBUG 2024/05/07 10:48:45.448801 http.go:602: Header value is not mandatory and is nil pointer in field: IfMatch. Skipping header DEBUG 2024/05/07 10:48:45.448805 http.go:661: RequestMetadata does not contain contributes tag. Skipping. DEBUG 2024/05/07 10:48:45.448811 client.go:604: Attempting to call downstream service DEBUG 2024/05/07 10:48:45.453220 client.go:683: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="mrFBFAm0uSRCdeoCIVa8JOP1S4lda6UDbZfTmWh6yvvtBX+jZKZOhd4wJt/mtW1JYijJjUJ6Psa8ifCTiZRDHPexpdhLJ6uPccA3+5jLPbCi0j7zM12Mlwh0Eee025JFNIOWRBKzmIGMZlf5MOCzJI7EjD2NIfcsZ6tHOCPLGCY1Pt8J+FlU9AHfKfX9MxixM/N7KpF/Sf8R+gC/7IKXDVOD0wScsSZwkeCHXsBbmdTAnQ3KpBQDgbpeLVvUt6vFYVx9CpGRpL/KAGBMc3yDOeuXtj8IUaz1YPzYXp0x75uwJTpOAbwiipeewVOHqX7GrsycUiI3ZHUnD396ddszPw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:45 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: c719df8897a305d3b0bd19950a3cf7f4 Opc-Retry-Token: o6s0p9L7p0z6ABJn5Qi3qanOobPDJyW2 X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/05/07 10:48:45.456511 client.go:443: Dump Request POST /20210224/caBundles HTTP/1.1 Host: certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 153 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="Ab35zfcxHegnGjWmb+z/Uejm8o5Ho1tka9KGXzip8tdZ8JqueqhCTVFtOUv+lYzvW/pYmzp6k5Z3Bddhu9rKfxwlHzJv7hVq4bKwEpEKNlbPgP4l/hxwB1S+NdtfobOBJtsy0ImFt/0xpVpyjtpusZ7gjtt/i7spjPsnyg7exw0iZPoCSHrP7X0PrvAcoBfYKDtnNGHauSdUvH8C480g+wWDrfwyQrM6X9OCXTKxpVJWYlHPjYKbTeH6mx9S36OVdNabpgA88lUjyqU7xJnxcd4Cr7njpMccCskYz2j4SnbnvPYmMqYdL31re8Njuum7u+fXswfsLur413Lxt3ZKiw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:45 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: f9c8268ddfa7788e6cc749970970128e Opc-Retry-Token: ic-lag0-grafana-certificate X-Content-Sha256: k0VulLR8aqg3oJTTcCJm6x4jqB2RM4dNiLFgBOnNlTc= Accept-Encoding: gzip INFO 2024/05/07 10:48:45.456534 log.go:229: Dump Request Body: {"caBundlePem":"","compartmentId":"ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha","name":"ic-lag0-grafana-certificate"} INFO 2024/05/07 10:48:45.456643 client.go:449: Dump Response HTTP/1.1 400 Bad Request Connection: close Content-Length: 95 Content-Type: application/json Date: Tue, 07 May 2024 13:48:45 GMT Opc-Request-Id: f9c8268ddfa7788e6cc749970970128e/E91596320AF1ACB3136BF65D7B2E5363/BA0732ABEDB696C17A311B94981DB4E6 Strict-Transport-Security: max-age=31536000; includeSubDomains X-Content-Type-Options: nosniff X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "caBundlePem size must be between 1 and 51200" } E0507 10:48:45.456741 1 certificate.go:84] Error creating ca bundle ic-lag0-grafana-certificate, Error returned by CertificatesManagement Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: f9c8268ddfa7788e6cc749970970128e/E91596320AF1ACB3136BF65D7B2E5363/BA0732ABEDB696C17A311B94981DB4E6. Message: caBundlePem size must be between 1 and 51200 Operation Name: CreateCaBundle Timestamp: 2024-05-07 13:48:45 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com/20210224/caBundles Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. Also see https://docs.oracle.com/iaas/api/#/en/certificatesmgmt/20210224/CaBundle/CreateCaBundle for details on this operation's requirements. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this CertificatesManagement issue, please contact Oracle support and provide them this full error message. I0507 10:48:45.456757 1 ingress.go:185] "Finished syncing ingress" ingress="monitoring/ingress-monitoring" duration="65.877168ms" I0507 10:48:45.456765 1 ingress.go:600] Error syncing ingress monitoring/ingress-monitoring: Error returned by CertificatesManagement Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: f9c8268ddfa7788e6cc749970970128e/E91596320AF1ACB3136BF65D7B2E5363/BA0732ABEDB696C17A311B94981DB4E6. Message: caBundlePem size must be between 1 and 51200 Operation Name: CreateCaBundle Timestamp: 2024-05-07 13:48:45 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://certificatesmanagement.sa-saopaulo-1.oci.oraclecloud.com/20210224/caBundles Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. Also see https://docs.oracle.com/iaas/api/#/en/certificatesmgmt/20210224/CaBundle/CreateCaBundle for details on this operation's requirements. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this CertificatesManagement issue, please contact Oracle support and provide them this full error message. INFO 2024/05/07 10:48:45.537845 client.go:443: Dump Request POST /20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa/routingPolicies HTTP/1.1 Host: iaas.sa-saopaulo-1.oraclecloud.com User-Agent: Oracle-GoSDK/65.34.0 (linux/arm64; go/go1.19.13) Content-Length: 278 Accept: */* Authorization: Signature version="1",headers="date (request-target) host content-length content-type x-content-sha256",keyId="ocid1.tenancy.oc1..aaaaaaaaoecb5imn4etm67dmqojtre7m57lluyxudwmoi2cs7umwolhcxtha/ocid1.user.oc1..aaaaaaaa5wcsh4c5ezax4zppd4lsc2tmbjayaytonevduefesgwdry23karq/f6:48:13:ca:8b:a6:34:70:e4:4d:e4:38:86:3c:39:99",algorithm="rsa-sha256",signature="mrFBFAm0uSRCdeoCIVa8JOP1S4lda6UDbZfTmWh6yvvtBX+jZKZOhd4wJt/mtW1JYijJjUJ6Psa8ifCTiZRDHPexpdhLJ6uPccA3+5jLPbCi0j7zM12Mlwh0Eee025JFNIOWRBKzmIGMZlf5MOCzJI7EjD2NIfcsZ6tHOCPLGCY1Pt8J+FlU9AHfKfX9MxixM/N7KpF/Sf8R+gC/7IKXDVOD0wScsSZwkeCHXsBbmdTAnQ3KpBQDgbpeLVvUt6vFYVx9CpGRpL/KAGBMc3yDOeuXtj8IUaz1YPzYXp0x75uwJTpOAbwiipeewVOHqX7GrsycUiI3ZHUnD396ddszPw==" Content-Type: application/json Date: Tue, 07 May 2024 13:48:45 GMT Opc-Client-Info: Oracle-GoSDK/65.34.0 Opc-Client-Retries: true Opc-Request-Id: c719df8897a305d3b0bd19950a3cf7f4 Opc-Retry-Token: o6s0p9L7p0z6ABJn5Qi3qanOobPDJyW2 X-Content-Sha256: DcFfFBiPbUXoyqDT1hn0rAQuYvhm0HyxVQ65nSPTmcQ= Accept-Encoding: gzip INFO 2024/05/07 10:48:45.537870 log.go:229: Dump Request Body: {"conditionLanguageVersion":"V1","name":"route_80","rules":[{"actions":[{"backendSetName":"bs_e38a715fdad0117","name":"FORWARD_TO_BACKENDSET"}],"condition":"all(http.request.headers[(i 'Host')] eq 'grafana.lag0.com.br' , http.request.url.path sw '/')","name":"k8s_f8532178d8"}]} INFO 2024/05/07 10:48:45.537918 client.go:449: Dump Response HTTP/1.1 400 Bad Request Content-Length: 272 Content-Type: application/json Date: Tue, 07 May 2024 13:48:45 GMT Opc-Request-Id: c719df8897a305d3b0bd19950a3cf7f4/DB9C09A2B7EFBB60636151D53821F978/09C805A5BE676D2C38636217A50B0A8A Strict-Transport-Security: max-age=31536000; includeSubDomains; X-Content-Type-Options: nosniff { "code" : "InvalidParameter", "message" : "Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa" } E0507 10:48:45.538004 1 routingpolicy.go:188] "unable to ensure route policy" err=< Error returned by LoadBalancer Service. Http Status Code: 400. Error Code: InvalidParameter. Opc request id: c719df8897a305d3b0bd19950a3cf7f4/DB9C09A2B7EFBB60636151D53821F978/09C805A5BE676D2C38636217A50B0A8A. Message: Routing Policy 'route_80' contains a rule referencing BackendSet 'bs_e38a715fdad0117' which does not exist in load balancer ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa Operation Name: CreateRoutingPolicy Timestamp: 2024-05-07 13:48:45 +0000 GMT Client Version: Oracle-GoSDK/65.34.0 Request Endpoint: POST https://iaas.sa-saopaulo-1.oraclecloud.com/20170115/loadBalancers/ocid1.loadbalancer.oc1.sa-saopaulo-1.aaaaaaaapfn32vfzydm7q56ljzy7kppoemrwd3ulzqoufiu2njn5nusaldpa/routingPolicies Troubleshooting Tips: See https://docs.oracle.com/iaas/Content/API/References/apierrors.htm#apierrors_400__400_invalidparameter for more information about resolving this error. To get more info on the failing request, you can set OCI_GO_SDK_DEBUG env var to info or higher level to log the request/response details. If you are unable to resolve this LoadBalancer issue, please contact Oracle support and provide them this full error message. > ingressClass="default-ingress-class" listenerName="route_80" I0507 10:48:45.538022 1 routingpolicy.go:105] "Finished syncing routing policies for ingress class" ingressClass="default-ingress-class" duration="89.445412ms" I0507 10:48:45.538028 1 routingpolicy.go:262] Error syncing routing policy default-ingress-class: error encountered syncing routing policies ```

Observing the logs I've noticed the error in creating the certificate due to cert-manager's inability to create a ca.crt as mentioned in https://github.com/cert-manager/cert-manager/issues/1571 , so I thinks that's a dead end for me, I cannot create manually certificates for all my services. If the problem with creating backendSets is related to the ca.crt missing in certificate secret, please close this issue as it's just a symptom, tho it would be good to have a miraculous solution for this, something like: https://github.com/bitnami/charts/pull/3192 https://github.com/redis/redis/issues/11486 In sum, make oci-native-ingress-controller work along with cert-manager's ACME certificates out-of-the-box

antoniolago commented 1 month ago

I've just confirmed the issue is caused by not having ca.crt, I'll be closing this issue and opening a new one (#60) regarding a feature to extract CA certificate from tls.crt instead of using ca.crt, thanks.