Donghui0 commented 3 years ago

Issue description

k8s ingress resource conversion apisix route is ignored

ingress controller config:

ingress resource config:

config ingress_class is the same as kubernetes.io/ingress.class in annotation. value is "traefik"

Environment

your apisix-ingress-controller version: 0.6.0
your Kubernetes cluster version: v1.16.9
ingress apiVersion: extensions/v1beta1

tokers commented 3 years ago

@Donghui0 The configuration seems correct. Are therey any error logs shown when you submit an Ingress resource?

Donghui0 commented 3 years ago

@Donghui0 The configuration seems correct. Are therey any error logs shown when you submit an Ingress resource?

ingress controller start logs:

`2021-05-20T17:08:05+08:00 info ingress/ingress.go:112 apisix ingress controller started 2021-05-20T17:08:05+08:00 info ingress/ingress.go:114 version: Version: 0.6.0 Git SHA: Go Version: go1.13.8 Building OS/Arch: linux/amd64 Running OS/Arch: linux/amd64

2021-05-20T17:08:05+08:00 info ingress/ingress.go:120 use configuration { "log_level": "debug", "log_output": "stderr", "http_listen": ":8080", "enable_profiling": true, "kubernetes": { "kubeconfig": "", "resync_interval": "6h0m0s", "app_namespaces": [ "default", "devops" ], "election_id": "ingress-apisix-leader", "ingress_class": "traefik", "ingress_version": "extensions/v1beta1", "apisix_route_version": "apisix.apache.org/v2alpha1" }, "apisix": { "default_cluster_name": "default", "default_cluster_base_url": "http://10.30.130.125:9080/apisix/admin", "default_cluster_admin_key": "", "base_url": "http://10.30.130.125:9080/apisix/admin", "admin_key": "" } } I0520 17:08:05.799835 1 leaderelection.go:243] attempting to acquire leader lease default/ingress-apisix-leader... 2021-05-20T17:08:05+08:00 warn ingress/controller.go:284 found a new leader ingress-controller-79db98766-pwj77 2021-05-20T17:08:05+08:00 info ingress/controller.go:286 controller now is running as a candidate {"namespace": "default", "pod": "ingress-controller-79db98766-7r6jv"} 2021-05-20T17:08:23+08:00 info ingress/controller.go:246 LeaderElection {"message": "ingress-controller-79db98766-7r6jv became leader", "event_type": "Normal"} I0520 17:08:23.275123 1 leaderelection.go:253] successfully acquired lease default/ingress-apisix-leader 2021-05-20T17:08:23+08:00 warn ingress/controller.go:284 found a new leader ingress-controller-79db98766-7r6jv 2021-05-20T17:08:23+08:00 info ingress/controller.go:321 controller now is running as leader {"namespace": "default", "pod": "ingress-controller-79db98766-7r6jv"} 2021-05-20T17:08:23+08:00 warn apisix/cluster.go:252 waiting cluster default to ready, it may takes a while 2021-05-20T17:08:23+08:00 info apisix/cluster.go:115 syncing cache {"cluster": "default"} 2021-05-20T17:08:23+08:00 debug apisix/route.go:111 try to list routes in APISIX {"cluster": "default", "url": "http://10.30.130.125:9080/apisix/admin/routes"} 2021-05-20T17:08:23+08:00 debug apisix/resource.go:77 got route: {"id":"cb342383","status":1,"labels":{"managed-by":"apisix-ingress-controller"},"update_time":1621499752,"create_time":1621499752,"name":"devops_shorturl-beta-ing_shorturl-beta-ing-279","uris":["\/"],"desc":"Created by apisix-ingress-controller, DO NOT modify it manually","priority":20,"hosts":["shorturl-dev.svc.igetcool.com"],"upstream_id":"9c7d358f","vars":[["http_x_swimlan","==","dev"]]} 2021-05-20T17:08:23+08:00 debug apisix/route.go:135 list route #0, body: {"id":"cb342383","status":1,"labels":{"managed-by":"apisix-ingress-controller"},"update_time":1621499752,"create_time":1621499752,"name":"devops_shorturl-beta-ing_shorturl-beta-ing-279","uris":["\/"],"desc":"Created by apisix-ingress-controller, DO NOT modify it manually","priority":20,"hosts":["shorturl-dev.svc.igetcool.com"],"upstream_id":"9c7d358f","vars":[["http_x_swimlan","==","dev"]]} 2021-05-20T17:08:23+08:00 debug apisix/upstream.go:106 try to list upstreams in APISIX {"url": "http://10.30.130.125:9080/apisix/admin/upstreams", "cluster": "default"} 2021-05-20T17:08:23+08:00 debug apisix/resource.go:107 got upstream: {"id":"9c7d358f","labels":{"managed-by":"apisix-ingress-controller"},"pass_host":"pass","type":"roundrobin","scheme":"http","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","name":"devops_shorturl-beta-svc_8080","nodes":[{"priority":0,"port":8080,"host":"10.30.143.208","weight":100}],"create_time":1621499752,"hash_on":"vars","update_time":1621499752} 2021-05-20T17:08:23+08:00 debug apisix/upstream.go:129 list upstream #0, body: {"id":"9c7d358f","labels":{"managed-by":"apisix-ingress-controller"},"pass_host":"pass","type":"roundrobin","scheme":"http","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","name":"devops_shorturl-beta-svc_8080","nodes":[{"priority":0,"port":8080,"host":"10.30.143.208","weight":100}],"create_time":1621499752,"hash_on":"vars","update_time":1621499752} 2021-05-20T17:08:23+08:00 debug apisix/ssl.go:106 try to list ssl in APISIX {"url": "http://10.30.130.125:9080/apisix/admin/ssl", "cluster": "default"} 2021-05-20T17:08:23+08:00 debug apisix/stream_route.go:110 try to list stream_routes in APISIX {"cluster": "default", "url": "http://10.30.130.125:9080/apisix/admin/stream_routes"} 2021-05-20T17:08:23+08:00 debug apisix/global_rule.go:110 try to list global_rules in APISIX {"cluster": "default", "url": "http://10.30.130.125:9080/apisix/admin/global_rules"} 2021-05-20T17:08:23+08:00 info apisix/cluster.go:122 cache synced {"cost_time": "9.904431ms", "cluster": "default"} 2021-05-20T17:08:23+08:00 warn apisix/cluster.go:258 cluster default now is ready, cost time 10.003809ms 2021-05-20T17:08:23+08:00 info ingress/secret.go:60 secret controller started 2021-05-20T17:08:23+08:00 info ingress/apisix_tls.go:58 ApisixTls controller started 2021-05-20T17:08:23+08:00 info ingress/ingress.go:59 ingress controller started 2021-05-20T17:08:23+08:00 info ingress/endpoint.go:59 endpoints controller started 2021-05-20T17:08:23+08:00 info ingress/apisix_upstream.go:58 ApisixUpstream controller started 2021-05-20T17:08:23+08:00 info ingress/apisix_cluster_config.go:55 ApisixClusterConfig controller started 2021-05-20T17:08:23+08:00 info ingress/apisix_route.go:57 ApisixRoute controller started E0520 17:08:23.289234 1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:167: Failed to watch v2alpha1.ApisixClusterConfig: failed to list v2alpha1.ApisixClusterConfig: the server could not find the requested resource (get apisixclusterconfigs.apisix.apache.org) 2021-05-20T17:08:23+08:00 debug ingress/apisix_route.go:265 ApisixRoute add event arrived {"object": {"kind":"ApisixRoute","apiVersion":"apisix.apache.org/v2alpha1","metadata":{"name":"shorturl-beta-ing","namespace":"devops","selfLink":"/apis/apisix.apache.org/v2alpha1/namespaces/devops/apisixroutes/shorturl-beta-ing","uid":"e83a64f5-af36-4332-ab95-ad7aba8266d8","resourceVersion":"1709332796","generation":1,"creationTimestamp":"2021-05-20T04:08:35Z"},"spec":{"http":[{"name":"shorturl-beta-ing-279","priority":20,"match":{"paths":["/"],"hosts":["shorturl-dev.svc.igetcool.com"],"exprs":[{"subject":{"scope":"Header","name":"X-Swimlan"},"op":"Equal","set":null,"value":"dev"}]},"backend":null,"backends":[{"serviceName":"shorturl-beta-svc","servicePort":8080,"resolveGranularity":"","weight":null}],"websocket":false}]},"status":{}}} 2021-05-20T17:08:23+08:00 debug ingress/ingress.go:213 ignore noneffective ingress add event {"object": {}} 2021-05-20T17:08:23+08:00 debug ingress/endpoint.go:183 endpoints add event arrived {"object-key": "default/kubernetes"} 2021-05-20T17:08:23+08:00 debug ingress/endpoint.go:183 endpoints add event arrived {"object-key": "devops/shorturl-beta-svc"} 2021-05-20T17:08:23+08:00 debug ingress/endpoint.go:183 endpoints add event arrived {"object-key": "devops/shorturl-dev-svc"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/acr-credential-df469bbe2cfaa576fab48b6f52d33a82"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/acr-credential-a0fa064cb4ce770d628e28389a5eff36"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/acr-credential-24854a7970e1cadb8173632e77a2be46"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/default-token-khfn4"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/acr-credential-79873d0d479756dcb41f2157e7ef6512"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/acr-credential-24854a7970e1cadb8173632e77a2be46"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/registry-op"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/acr-credential-a0fa064cb4ce770d628e28389a5eff36"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/acr-credential-64e9a936224ff365bbd88cdc91a39a86"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/default-token-5prgn"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/registry-op"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/acr-credential-df469bbe2cfaa576fab48b6f52d33a82"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "default/apisix-view-serviceaccount-token-vftwb"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/acr-credential-64e9a936224ff365bbd88cdc91a39a86"} 2021-05-20T17:08:23+08:00 debug ingress/secret.go:187 secret add event arrived {"object-key": "devops/acr-credential-79873d0d479756dcb41f2157e7ef6512"} E0520 17:08:24.145402 1 reflector.go:138] pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:167: Failed to watch v2alpha1.ApisixClusterConfig: failed to list v2alpha1.ApisixClusterConfig: the server could not find the requested resource (get apisixclusterconfigs.apisix.apache.org) 2021-05-20T17:08:24+08:00 debug ingress/apisix_route.go:151 translated ApisixRoute {"routes": [{"id":"cb342383","name":"devops_shorturl-beta-ing_shorturl-beta-ing-279","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","labels":{"managed-by":"apisix-ingress-controller"},"hosts":["shorturl-dev.svc.igetcool.com"],"priority":20,"vars":[["http_x_swimlan","==","dev"]],"uris":["/"],"upstream_id":"9c7d358f"}], "upstreams": [{"id":"9c7d358f","name":"devops_shorturl-beta-svc_8080","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","labels":{"managed-by":"apisix-ingress-controller"},"type":"roundrobin","nodes":[{"host":"10.30.143.208","port":8080,"weight":100}],"scheme":"http"}], "apisix_route": {}} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:135 try to create upstream {"name": "devops_shorturl-beta-svc_8080", "url": "http://10.30.130.125:9080/apisix/admin/upstreams", "cluster": "default"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:150 creating upstream {"body": "{\"id\":\"9c7d358f\",\"name\":\"devops_shorturl-beta-svc_8080\",\"desc\":\"Created by apisix-ingress-controller, DO NOT modify it manually\",\"labels\":{\"managed-by\":\"apisix-ingress-controller\"},\"type\":\"roundrobin\",\"nodes\":[{\"host\":\"10.30.143.208\",\"port\":8080,\"weight\":100}],\"scheme\":\"http\"}", "url": "http://10.30.130.125:9080/apisix/admin/upstreams/9c7d358f"} 2021-05-20T17:08:24+08:00 debug apisix/resource.go:107 got upstream: {"id":"9c7d358f","labels":{"managed-by":"apisix-ingress-controller"},"pass_host":"pass","type":"roundrobin","scheme":"http","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","name":"devops_shorturl-beta-svc_8080","nodes":[{"priority":0,"weight":100,"host":"10.30.143.208","port":8080}],"update_time":1621501704,"hash_on":"vars","create_time":1621499752} 2021-05-20T17:08:24+08:00 debug apisix/route.go:142 try to create route {"hosts": ["shorturl-dev.svc.igetcool.com"], "name": "devops_shorturl-beta-ing_shorturl-beta-ing-279", "cluster": "default", "url": "http://10.30.130.125:9080/apisix/admin/routes"} 2021-05-20T17:08:24+08:00 debug apisix/route.go:158 creating route {"body": "{\"id\":\"cb342383\",\"name\":\"devops_shorturl-beta-ing_shorturl-beta-ing-279\",\"desc\":\"Created by apisix-ingress-controller, DO NOT modify it manually\",\"labels\":{\"managed-by\":\"apisix-ingress-controller\"},\"hosts\":[\"shorturl-dev.svc.igetcool.com\"],\"priority\":20,\"vars\":[[\"http_x_swimlan\",\"==\",\"dev\"]],\"uris\":[\"/\"],\"upstream_id\":\"9c7d358f\"}", "url": "http://10.30.130.125:9080/apisix/admin/routes/cb342383"} 2021-05-20T17:08:24+08:00 debug apisix/resource.go:77 got route: {"id":"cb342383","status":1,"labels":{"managed-by":"apisix-ingress-controller"},"update_time":1621501704,"desc":"Created by apisix-ingress-controller, DO NOT modify it manually","name":"devops_shorturl-beta-ing_shorturl-beta-ing-279","create_time":1621499752,"vars":[["http_x_swimlan","==","dev"]],"priority":20,"hosts":["shorturl-dev.svc.igetcool.com"],"upstream_id":"9c7d358f","uris":["\/"]} E0520 17:08:24.304864 1 event.go:264] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"shorturl-beta-ing.1680bb357f9591b1", GenerateName:"", Namespace:"devops", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(time.Location)(nil)}}, DeletionTimestamp:(v1.Time)(nil), DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"ApisixRoute", Namespace:"devops", Name:"shorturl-beta-ing", UID:"e83a64f5-af36-4332-ab95-ad7aba8266d8", APIVersion:"apisix.apache.org/v2alpha1", ResourceVersion:"1709332796", FieldPath:""}, Reason:"ResourcesSynced", Message:"ApisixIngress synced successfully", Source:v1.EventSource{Component:"ApisixIngress", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc021a7a211f941b1, ext:18520623244, loc:(time.Location)(0x290d420)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc021a7a211f941b1, ext:18520623244, loc:(time.Location)(0x290d420)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(time.Location)(nil)}}, Series:(v1.EventSeries)(nil), Action:"", Related:(v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:default:apisix-view-serviceaccount" cannot create resource "events" in API group "" in the namespace "devops"' (will not retry!) 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:43 try to look up upstream {"name": "default_kubernetes_443", "url": "http://10.30.130.125:9080/apisix/admin/upstreams", "cluster": "default"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:59 failed to find upstream in cache, will try to lookup from APISIX {"name": "default_kubernetes_443", "error": "not found"} 2021-05-20T17:08:24+08:00 warn apisix/upstream.go:70 upstream not found {"name": "default_kubernetes_443", "url": "http://10.30.130.125:9080/apisix/admin/upstreams/606b3be0", "cluster": "default"} 2021-05-20T17:08:24+08:00 warn ingress/endpoint.go:135 upstream is not referenced {"cluster": "name=default; base_url=http://10.30.130.125:9080/apisix/admin", "upstream": "default_kubernetes_443"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:43 try to look up upstream {"name": "devops_shorturl-beta-svc_8080", "url": "http://10.30.130.125:9080/apisix/admin/upstreams", "cluster": "default"} 2021-05-20T17:08:24+08:00 debug ingress/endpoint.go:152 upstream binds new nodes {"upstream": {"id":"9c7d358f","name":"devops_shorturl-beta-svc_8080","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","labels":{"managed-by":"apisix-ingress-controller"},"type":"roundrobin","hash_on":"vars","nodes":[{"host":"10.30.143.208","port":8080,"weight":100}],"scheme":"http"}, "cluster": "name=default; base_url=http://10.30.130.125:9080/apisix/admin"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:193 try to update upstream {"id": "9c7d358f", "name": "devops_shorturl-beta-svc_8080", "cluster": "default", "url": "http://10.30.130.125:9080/apisix/admin/upstreams"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:210 updating upstream {"body": "{\"id\":\"9c7d358f\",\"name\":\"devops_shorturl-beta-svc_8080\",\"desc\":\"Created by apisix-ingress-controller, DO NOT modify it manually\",\"labels\":{\"managed-by\":\"apisix-ingress-controller\"},\"type\":\"roundrobin\",\"hash_on\":\"vars\",\"nodes\":[{\"host\":\"10.30.143.208\",\"port\":8080,\"weight\":100}],\"scheme\":\"http\"}", "url": "http://10.30.130.125:9080/apisix/admin/upstreams/9c7d358f"} 2021-05-20T17:08:24+08:00 debug apisix/resource.go:107 got upstream: {"id":"9c7d358f","labels":{"managed-by":"apisix-ingress-controller"},"pass_host":"pass","type":"roundrobin","scheme":"http","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","name":"devops_shorturl-beta-svc_8080","nodes":[{"priority":0,"weight":100,"host":"10.30.143.208","port":8080}],"update_time":1621501704,"hash_on":"vars","create_time":1621499752} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:43 try to look up upstream {"name": "devops_shorturl-dev-svc_8080", "url": "http://10.30.130.125:9080/apisix/admin/upstreams", "cluster": "default"} 2021-05-20T17:08:24+08:00 debug apisix/upstream.go:59 failed to find upstream in cache, will try to lookup from APISIX {"name": "devops_shorturl-dev-svc_8080", "error": "not found"} 2021-05-20T17:08:24+08:00 debug ingress/apisix_route.go:292 ApisixRoute update event arrived {"new object": {}, "old object": {}} 2021-05-20T17:08:24+08:00 warn apisix/upstream.go:70 upstream not found {"name": "devops_shorturl-dev-svc_8080", "url": "http://10.30.130.125:9080/apisix/admin/upstreams/e38947d8", "cluster": "default"} 2021-05-20T17:08:24+08:00 warn ingress/endpoint.go:135 upstream is not referenced {"cluster": "name=default; base_url=http://10.30.130.125:9080/apisix/admin", "upstream": "devops_shorturl-dev-svc_8080"} 2021-05-20T17:08:25+08:00 debug ingress/apisix_route.go:151 translated ApisixRoute {"routes": [{"id":"cb342383","name":"devops_shorturl-beta-ing_shorturl-beta-ing-279","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","labels":{"managed-by":"apisix-ingress-controller"},"hosts":["shorturl-dev.svc.igetcool.com"],"priority":20,"vars":[["http_x_swimlan","==","dev"]],"uris":["/"],"upstream_id":"9c7d358f"}], "upstreams": [{"id":"9c7d358f","name":"devops_shorturl-beta-svc_8080","desc":"Created by apisix-ingress-controller, DO NOT modify it manually","labels":{"managed-by":"apisix-ingress-controller"},"type":"roundrobin","nodes":[{"host":"10.30.143.208","port":8080,"weight":100}],"scheme":"http"}], "apisix_route": {}} E0520 17:08:25.313097 1 event.go:329] Could not construct reference to: '&v2alpha1.ApisixRoute{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"shorturl-beta-ing", GenerateName:"", Namespace:"devops", SelfLink:"/apis/apisix.apache.org/v2alpha1/namespaces/devops/apisixroutes/shorturl-beta-ing", UID:"e83a64f5-af36-4332-ab95-ad7aba8266d8", ResourceVersion:"1710469870", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63757080515, loc:(time.Location)(0x290d420)}}, DeletionTimestamp:(v1.Time)(nil), DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:(v2alpha1.ApisixRouteSpec)(0xc0008feff0), Status:v2alpha1.ApisixStatus{Conditions:([]v1.Condition)(0xc0008c70a0)}}' due to: 'no kind is registered for the type v2alpha1.ApisixRoute in scheme "pkg/runtime/scheme.go:100"'. Will not report event: 'Normal' 'ResourcesSynced' 'ApisixIngress synced successfully'`