search

knative / eventing

Event-driven application platform for Kubernetes
https://knative.dev/docs/eventing
Apache License 2.0
1.41k stars 588 forks source link

No matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1" with kube 1.17 #3559

Closed LiYa-Xu closed 4 years ago

LiYa-Xu commented 4 years ago

Describe the bug Can not apply eventing.yaml

Expected behavior apply eventing succeed

To Reproduce Upgrade kube to 1.17.0

Knative release version 0.16.0

Additional context +kubectl get ns/knative-eventing

+kubectl apply --selector knative.dev/crd-install=true -f /tmp/kneve-files/eventing.yaml

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "ValidatingWebhookConfiguration" in version "admissionregistration.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "MutatingWebhookConfiguration" in version "admissionregistration.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "ValidatingWebhookConfiguration" in version "admissionregistration.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "MutatingWebhookConfiguration" in version "admissionregistration.k8s.io/v1"

unable to recognize "/tmp/kneve-files/eventing.yaml": no matches for kind "CustomResourceDefinition" in version "apiextensions.k8s.io/v1"
vaikas commented 4 years ago

Couple of things, I noticed you used the out of date install instructions from the looks of it: https://knative.dev/docs/install/any-kubernetes-cluster/

so the proper way to install the CRD definitions would be:

kubectl apply --filename https://github.com/knative/eventing/releases/download/v0.16.0/eventing-crds.yaml

However, it seems like your cluster does not have the api-resources which is preventing the creation of the CRDs that we need.

What does this show for you?

vaikas-a01:mink vaikas$ kubectl api-resources --api-group=apiextensions.k8s.io -owide
NAME                        SHORTNAMES   APIGROUP               NAMESPACED   KIND                       VERBS
customresourcedefinitions   crd,crds     apiextensions.k8s.io   false        CustomResourceDefinition   [create delete deletecollection get list patch update watch]

I actually don't know (I tried to play with output but the wide / name are the only options for displaying) how to see which versions are supported of the top of my head.

Same goes for the *WebhookConfiguration resources. I'm puzzled why they wouldn't be on your cluster. Which cluster is this running (gke, aws?).

vaikas commented 4 years ago

Could you also attach output of:

kubectl version
LiYa-Xu commented 4 years ago

@vaikas Thanks for your response ! It's running on IBM cloud . kubectk version : 

Client Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.0", GitCommit:"ddf47ac13c1a9483ea035a79cd7c10005ff21a6d", GitTreeState:"clean", BuildDate:"2018-12-03T21:04:45Z", GoVersion:"go1.11.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.12+IKS", GitCommit:"ab8a13f032bccd858fa0232d64fcdd05671f57e6", GitTreeState:"clean", BuildDate:"2020-05-08T15:08:35Z", GoVersion:"go1.12.17", Compiler:"gc", Platform:"linux/amd64"}

And customresourcedefinitions like below:

kubectl api-resources --api-group=apiextensions.k8s.io -owide
NAME                        SHORTNAMES   APIGROUP               NAMESPACED   KIND                       VERBS
customresourcedefinitions   crd,crds     apiextensions.k8s.io   false        CustomResourceDefinition   [create delete deletecollection get list patch update watch]
vaikas commented 4 years ago

Yeah, so your k8s cluster is still on 1.15, see the server version, that doesn't have the necessary bits. Eventing 0.16 had minimum version of k8s 1.16. if you can't upgrade to 1.16 of k8s, you have to use eventing 0.15. sorry for terseness, on the phone

LiYa-Xu commented 4 years ago

@vaikas Thanks for your help ,will have a try .

LiYa-Xu commented 4 years ago

@vaikas
After I upgraded my kube version to 1.17 and I apply latest release v0.16.2 ,I failed on case 

knative.dev/eventing/pkg/leaderelection [knative.dev/eventing/pkg/leaderelection.test]
pkg/leaderelection/context_test.go:98:3: t.Cleanup undefined (type *"testing".T has no field or method Cleanup)

Could you please help me ?

lionelvillard commented 4 years ago

I believe this was answered in slack: https://knative.slack.com/archives/C9JP909F0/p1594790488460200

@LiYa-Xu can we close this?

LiYa-Xu commented 4 years ago

@lionelvillard Yes , above issue was fixed . But I met other issues :(

Like below : 

###############
=== RUN   TestBrokerChannelFlowTriggerV1BrokerV1
=== PAUSE TestBrokerChannelFlowTriggerV1BrokerV1
=== RUN   TestBrokerChannelFlowV1Beta1BrokerV1
=== PAUSE TestBrokerChannelFlowV1Beta1BrokerV1
=== RUN   TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1
=== PAUSE TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1
=== RUN   TestBrokerChannelFlowTriggerV1BrokerV1Beta1
=== PAUSE TestBrokerChannelFlowTriggerV1BrokerV1Beta1
=== RUN   TestEventTransformationForTriggerV1BrokerV1
=== PAUSE TestEventTransformationForTriggerV1BrokerV1
...
          },
          "status": {
            "address": {}
          }
        }
    TestEventTransformationForTriggerV1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1: tracker.go:136: Waiting for e2e-eventtransformation-broker to be deleted
--- FAIL: TestEventTransformationForTriggerV1BrokerV1 (0.30s)
    --- FAIL: TestEventTransformationForTriggerV1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1 (121.50s)
    TestBrokerChannelFlowV1Beta1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1: operation.go:66: Failed to get {Broker eventing.knative.dev/v1beta1}-e2e-brokerchannel-broker ready: timed out waiting for the condition
        knative.dev/eventing/test/lib.(*Client).WaitForResourceReadyOrFail
            /home/travis/gopath/src/knative.dev/eventing/test/lib/operation.go:66
        knative.dev/eventing/test/e2e/helpers.BrokerChannelFlowWithTransformation.func1
            /home/travis/gopath/src/knative.dev/eventing/test/e2e/helpers/broker_channel_flow_helper.go:95
        knative.dev/eventing/test/lib.(*ComponentsTestRunner).RunTests.func1
            /home/travis/gopath/src/knative.dev/eventing/test/lib/test_runner.go:70
        testing.tRunner
            /home/travis/.gimme/versions/go1.14.linux.amd64/src/testing/testing.go:992
        runtime.goexit
            /home/travis/.gimme/versions/go1.14.linux.amd64/src/runtime/asm_amd64.s:1373
2020/07/15 10:17:49 Env variable ARTIFACTS not set. Using artifacts instead.
    TestBrokerChannelFlowV1Beta1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1: test_runner.go:148: Export logs in "test-broker-channel-flow-v1-beta1-broker-v1-in-memory-chanjwp5d" to "artifacts/pod-logs"
    TestBrokerChannelFlowV1Beta1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1: tracker.go:128: Cleaning resource: "e2e-brokerchannel-broker"
        {
          "apiVersion": "eventing.knative.dev/v1",
          "kind": "Broker",
          "metadata": {
            "annotations": {
              "eventing.knative.dev/broker.class": "MTChannelBasedBroker",
              "eventing.knative.dev/creator": "IAM#zhangtbj@cn.ibm.com",
              "eventing.knative.dev/lastModifier": "IAM#zhangtbj@cn.ibm.com"
            },
            "creationTimestamp": "2020-07-15T10:15:49Z",
            "generation": 1,
            "name": "e2e-brokerchannel-broker",
            "namespace": "test-broker-channel-flow-v1-beta1-broker-v1-in-memory-chanjwp5d",
            "resourceVersion": "29909462",
            "selfLink": "/apis/eventing.knative.dev/v1/namespaces/test-broker-channel-flow-v1-beta1-broker-v1-in-memory-chanjwp5d/brokers/e2e-brokerchannel-broker",
            "uid": "3fda88bb-6218-403b-a73d-6ceba344677e"
          },
          "spec": {
            "config": {
              "apiVersion": "v1",
              "kind": "ConfigMap",
              "name": "e2e-brokerchannel-broker",
              "namespace": "test-broker-channel-flow-v1-beta1-broker-v1-in-memory-chanjwp5d"
            }
          },
          "status": {
            "address": {}
          }
        }
    TestBrokerChannelFlowV1Beta1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1: tracker.go:136: Waiting for e2e-brokerchannel-broker to be deleted
    TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1/InMemoryChannel-messaging.knative.dev/v1beta1: operation.go:66: Failed to get {Broker eventing.knative.dev/v1beta1}-e2e-brokerchannel-broker ready: timed out waiting for the condition
        knative.dev/eventing/test/lib.(*Client).WaitForResourceReadyOrFail
            /home/travis/gopath/src/knative.dev/eventing/test/lib/operation.go:66
        knative.dev/eventing/test/e2e/helpers.BrokerChannelFlowWithTransformation.func1
            /home/travis/gopath/src/knative.dev/eventing/test/e2e/helpers/broker_channel_flow_helper.go:95
        knative.dev/eventing/test/lib.(*ComponentsTestRunner).RunTests.func1
            /home/travis/gopath/src/knative.dev/eventing/test/lib/test_runner.go:70
        testing.tRunner
            /home/travis/.gimme/versions/go1.14.linux.amd64/src/testing/testing.go:992
        runtime.goexit
            /home/travis/.gimme/versions/go1.14.linux.amd64/src/runtime/asm_amd64.s:1373
2020/07/15 10:17:49 Env variable ARTIFACTS not set. Using artifacts instead.
    TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1/InMemoryChannel-messaging.knative.dev/v1beta1: test_runner.go:148: Export logs in "test-broker-channel-flow-trigger-v1-beta1-broker-v1-beta1-v8gbd" to "artifacts/pod-logs"
--- FAIL: TestBrokerChannelFlowV1Beta1BrokerV1 (0.31s)
    --- FAIL: TestBrokerChannelFlowV1Beta1BrokerV1/InMemoryChannel-messaging.knative.dev/v1beta1 (121.27s)
    TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1/InMemoryChannel-messaging.knative.dev/v1beta1: tracker.go:128: Cleaning resource: "e2e-brokerchannel-broker"
        {
          "apiVersion": "eventing.knative.dev/v1beta1",
          "kind": "Broker",
          "metadata": {
            "annotations": {
              "eventing.knative.dev/broker.class": "MTChannelBasedBroker",
              "eventing.knative.dev/creator": "IAM#zhangtbj@cn.ibm.com",
              "eventing.knative.dev/lastModifier": "IAM#zhangtbj@cn.ibm.com"
            },
            "creationTimestamp": "2020-07-15T10:15:49Z",
            "generation": 1,
            "name": "e2e-brokerchannel-broker",
            "namespace": "test-broker-channel-flow-trigger-v1-beta1-broker-v1-beta1-v8gbd",
            "resourceVersion": "29909470",
            "selfLink": "/apis/eventing.knative.dev/v1beta1/namespaces/test-broker-channel-flow-trigger-v1-beta1-broker-v1-beta1-v8gbd/brokers/e2e-brokerchannel-broker",
            "uid": "38821b28-a7e2-45ff-8ae0-1ff489ecb297"
          },
          "spec": {
            "config": {
              "apiVersion": "v1",
              "kind": "ConfigMap",
              "name": "e2e-brokerchannel-broker",
              "namespace": "test-broker-channel-flow-trigger-v1-beta1-broker-v1-beta1-v8gbd"
            }
          }
        }
    TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1/InMemoryChannel-messaging.knative.dev/v1beta1: tracker.go:136: Waiting for e2e-brokerchannel-broker to be deleted
--- FAIL: TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1 (0.30s)
    --- FAIL: TestBrokerChannelFlowTriggerV1Beta1BrokerV1Beta1/InMemoryChannel-messaging.knative.dev/v1beta1 (120.90s)
FAIL
FAIL    knative.dev/eventing/test/e2e   1065.866s
FAIL
 -> --- FAIL: TestDefaultBrokerWithManyTriggers (1.32s)
 ->     --- FAIL: TestDefaultBrokerWithManyTriggers/test_default_broker_with_many_attribute_triggers_using_v1beta1_trigger (120.68s)
 ->     --- FAIL: TestDefaultBrokerWithManyTriggers/test_default_broker_with_many_deprecated_triggers (120.80s)
 ->     --- FAIL: TestDefaultBrokerWithManyTriggers/test_default_broker_with_many_attribute_triggers (120.70s)
 ->     --- FAIL: TestDefaultBrokerWithManyTriggers/test_default_broker_with_many_attribute_and_extension_triggers (120.70s)
 -> --- FAIL: TestApiServerSource (1.22s)
 ->     --- FAIL: TestApiServerSource/event-ref-unmatch-label (135.05s)
 ->     --- FAIL: TestApiServerSource/event-ref (140.16s)
 ->     --- FAIL: TestApiServerSource/event-ref-match-label (140.47s)
 ->     --- FAIL: TestApiServerSource/event-ref-match-label-expr (144.46s)
 -> --- FAIL: TestTriggerDependencyAnnotation (121.66s)
 -> --- FAIL: TestChannelNamespaceDefaulter (136.62s)
 ->     --- FAIL: TestChannelNamespaceDefaulter/InMemoryChannel-messaging.knative.dev/v1beta1 (136.62s)
 -> --- FAIL: TestPingSourceV1Alpha2ResourceScope (141.87s)
 -> --- FAIL: TestChannelClusterDefaulter (143.99s)
 ->     --- FAIL: TestChannelClusterDefaulter/InMemoryChannel-messaging.knative.dev/v1beta1 (143.99s)
 -> --- FAIL: TestPingSourceV1Alpha2EventTypes (120.68s)

My kubectl version : 

Client Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.0", GitCommit:"ddf47ac13c1a9483ea035a79cd7c10005ff21a6d", GitTreeState:"clean", BuildDate:"2018-12-03T21:04:45Z", GoVersion:"go1.11.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.7+IKS", GitCommit:"3305158dfe9ee1f89f596ef260135dcba881848c", GitTreeState:"clean", BuildDate:"2020-06-17T18:32:22Z", GoVersion:"go1.13.9", Compiler:"gc", Platform:"linux/amd64"}

Found the test ns can not be delete ,is under Terminating long time 

test-api-server-source-v1-alpha2-event-types-jp5d2                Terminating   15m
test-broker-channel-flow-trigger-v1-beta1-broker-v1-beta1-psxxh   Terminating   15m
test-broker-channel-flow-trigger-v1-broker-v1-beta1-in-memzrjcq   Terminating   15m
test-broker-channel-flow-trigger-v1-broker-v1-in-memory-chqx5ng   Terminating   15m
test-broker-channel-flow-v1-beta1-broker-v1-in-memory-chanvnmzd   Terminating   15m
test-channel-based-broker-with-many-triggers-in-memory-chajkqdl   Terminating   15m
test-channel-based-broker-with-many-triggers-in-memory-chas5hm9   Terminating   15m
test-channel-based-broker-with-many-triggers-in-memory-chassfcm   Terminating   15m
test-channel-based-broker-with-many-triggers-in-memory-chazp2gc   Terminating   15m
test-channel-chain-in-memory-channel-messaging-knative-devlmhnl   Terminating   15m
test-channel-chain-v1-in-memory-channel-messaging-knative-98dzm   Terminating   15m
test-channel-cluster-defaulter-in-memory-channel-messagingvdflq   Terminating   13m
test-channel-dead-letter-sink-in-memory-channel-messaging-ddmv7   Terminating   13m
test-channel-dead-letter-sink-v1-in-memory-channel-messagilxvnz   Terminating   13m
test-channel-namespace-defaulter-in-memory-channel-messagis9svs   Terminating   13m
test-container-source-j7tcr                                       Terminating   15m
test-default-broker-with-many-triggers-test-default-broker54vlw   Terminating   2m21s
test-default-broker-with-many-triggers-test-default-broker5twcb   Terminating   2m21s
test-default-broker-with-many-triggers-test-default-brokercrkvw   Terminating   2m22s
test-default-broker-with-many-triggers-test-default-brokerq5kv5   Terminating   2m22s
test-event-transformation-for-subscription-in-memory-channkzbtv   Terminating   13m
test-event-transformation-for-subscription-v1-in-memory-chs9srp   Terminating   13m
test-event-transformation-for-trigger-v1-beta1-broker-v1-bzjlh9   Terminating   15m
test-event-transformation-for-trigger-v1-beta1-broker-v1-i56z68   Terminating   15m
test-event-transformation-for-trigger-v1-broker-v1-beta1-i2j6nz   Terminating   15m
test-event-transformation-for-trigger-v1-broker-v1-in-memo4ppls   Terminating   15m
test-parallel-in-memory-channel-messaging-knative-dev-v1beqccff   Terminating   15m
test-parallel-v1-in-memory-channel-messaging-knative-dev-vm6xqn   Terminating   15m
test-ping-source-v1-alpha2-8mcnr                                  Terminating   15m
test-ping-source-v1-alpha2-event-types-n6sh2                      Terminating   15m
test-ping-source-v1-alpha2-resource-scope-jw59v                   Terminating   15m
test-sequence-in-memory-channel-messaging-knative-dev-v1bev89q8   Terminating   15m
test-sequence-v1-in-memory-channel-messaging-knative-dev-vp7vtm   Terminating   15m
test-single-binary-event-for-channel-v1-beta1-in-memory-ch8wx6t   Terminating   13m
test-single-binary-event-for-channel-v1-in-memory-channel-5lb48   Terminating   15m
test-single-structured-event-for-channel-v1-beta1-in-memortk7vn   Terminating   13m
test-single-structured-event-for-channel-v1-in-memory-chanq9tlv   Terminating   15m
test-sink-binding-cron-job-z7whh                                  Terminating   15m
test-sink-binding-v1-alpha2-cron-job-dpchs                        Terminating   15m
test-trigger-dependency-annotation-m4bj8                          Terminating   15m
github-actions[bot] commented 4 years ago

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Reopen the issue with /reopen. Mark the issue as fresh by adding the comment /remove-lifecycle stale.

lberk commented 4 years ago

@LiYa-Xu hi! Thanks for reporting the original issue, it looks like it was fixed. If you're having follow up issues, please feel free to reopen this issue or create a new, more specific one, thanks!