Error running hack/local-up-karmada.sh

[jxiang1995]

What happened: Error running hack/local-up-karmada.sh

How to reproduce it (as minimally and precisely as possible): run hack/local-up-karmada.sh.

Environment:

• Karmada version: 1.2.1
• kubectl-karmada or karmadactl version (the result of kubectl-karmada version or karmadactl version): N/A
• docker engine: 20.10.17
• go: 1.19
• kind: 0.14
• environment: Microsoft Azure VM 128G storage, 64G memory, ubuntu 22.04.

Console Record: azureuser@Karmada:~/downloads/karmada$ hack/local-up-karmada.sh Preparing: 'kind' existence check - passed Preparing: 'kubectl' existence check - passed Preparing kindClusterConfig in path: /tmp/tmp.MItcCAdRWj Creating cluster karmada-host and the log file is in /tmp/karmada/karmada-host.l og Creating cluster member1 and the log file is in /tmp/karmada/member1.log Creating cluster member2 and the log file is in /tmp/karmada/member2.log Creating cluster member3 and the log file is in /tmp/karmada/member3.log make: Entering directory '/home/azureuser/downloads/karmada' set -e;\ target=$(echo karmada-aggregated-apiserver);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:50:11 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-aggregated-apiserver !!! Building karmada-aggregated-apiserver for linux/amd64:

• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:50:11Z' -o _output/bin/linux/amd64/karmada-aggregated-apiserver github.co m/karmada-io/karmada/cmd/aggregated-apiserver
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-aggregated-apiserver:latest
• docker build --build-arg BINARY=karmada-aggregated-apiserver --tag swr.ap-sout heast-1.myhuaweicloud.com/karmada/karmada-aggregated-apiserver:latest --file hac k/../cluster/images/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 72.75MB Step 1/4 : FROM alpine:3.15.1 3.15.1: Pulling from library/alpine 3d2430473443: Pull complete Digest: sha256:d6d0a0eb4d40ef96f2310ead734848b9c819bb97c9d846385c4aca1767186cd4 Status: Downloaded newer image for alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Running in 3e38ed93c4b4 Removing intermediate container 3e38ed93c4b4 ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in f86b7f02db67 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container f86b7f02db67 ---> 3dbbe76af5f2 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> 2d4b458d7cb0 Successfully built 2d4b458d7cb0 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-aggrega ted-apiserver:latest
• set +x set -e;\ target=$(echo karmada-controller-manager);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:51:15 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-controller-manager !!! Building karmada-controller-manager for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:51:15Z' -o _output/bin/linux/amd64/karmada-controller-manager github.com/ karmada-io/karmada/cmd/controller-manager
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-controller-manager:latest
• docker build --build-arg BINARY=karmada-controller-manager --tag swr.ap-southe ast-1.myhuaweicloud.com/karmada/karmada-controller-manager:latest --file hack/.. /cluster/images/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 144.7MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in 6f59c4e8d536 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container 6f59c4e8d536 ---> 1d29aa81153e Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> 6a919e843a5f Successfully built 6a919e843a5f Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-control ler-manager:latest
• set +x set -e;\ target=$(echo karmada-scheduler);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:52:06 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-scheduler !!! Building karmada-scheduler for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:52:06Z' -o _output/bin/linux/amd64/karmada-scheduler github.com/karmada-i o/karmada/cmd/scheduler
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-scheduler:latest
• docker build --build-arg BINARY=karmada-scheduler --tag swr.ap-southeast-1.myh uaweicloud.com/karmada/karmada-scheduler:latest --file hack/../cluster/images/Do ckerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 206.6MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in bcc30ed1579f fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container bcc30ed1579f ---> d62425e6f072 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> a54055a11f05 Successfully built a54055a11f05 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-schedul er:latest
• set +x set -e;\ target=$(echo karmada-descheduler);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:52:20 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-descheduler !!! Building karmada-descheduler for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:52:20Z' -o _output/bin/linux/amd64/karmada-descheduler github.com/karmada -io/karmada/cmd/descheduler
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-descheduler:latest
• docker build --build-arg BINARY=karmada-descheduler --tag swr.ap-southeast-1.m yhuaweicloud.com/karmada/karmada-descheduler:latest --file hack/../cluster/image s/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 268.1MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in 72967fb0ad02 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container 72967fb0ad02 ---> f6e2c0ad22db Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> 4fbb943179b8 Successfully built 4fbb943179b8 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-desched uler:latest
• set +x set -e;\ target=$(echo karmada-webhook);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:52:32 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-webhook !!! Building karmada-webhook for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:52:32Z' -o _output/bin/linux/amd64/karmada-webhook github.com/karmada-io/ karmada/cmd/webhook
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-webhook:latest
• docker build --build-arg BINARY=karmada-webhook --tag swr.ap-southeast-1.myhua weicloud.com/karmada/karmada-webhook:latest --file hack/../cluster/images/Docker file hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 325.6MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in ea8dfdbb5868 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container ea8dfdbb5868 ---> 78420138461b Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> adc7b6fc2507 Successfully built adc7b6fc2507 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-webhook :latest
• set +x set -e;\ target=$(echo karmada-agent);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:52:43 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-agent !!! Building karmada-agent for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:52:43Z' -o _output/bin/linux/amd64/karmada-agent github.com/karmada-io/ka rmada/cmd/agent
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-agent:latest
• docker build --build-arg BINARY=karmada-agent --tag swr.ap-southeast-1.myhuawe icloud.com/karmada/karmada-agent:latest --file hack/../cluster/images/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 396.2MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in d14fafcc4249 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container d14fafcc4249 ---> d9494e428b08 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> 327096b5dea5 Successfully built 327096b5dea5 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-agent:l atest
• set +x set -e;\ target=$(echo karmada-scheduler-estimator);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:52:58 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-scheduler-estimator !!! Building karmada-scheduler-estimator for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:52:58Z' -o _output/bin/linux/amd64/karmada-scheduler-estimator github.com /karmada-io/karmada/cmd/scheduler-estimator
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-scheduler-estimator:latest
• docker build --build-arg BINARY=karmada-scheduler-estimator --tag swr.ap-south east-1.myhuaweicloud.com/karmada/karmada-scheduler-estimator:latest --file hack/ ../cluster/images/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 458.4MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in 114720cb89ee fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container 114720cb89ee ---> 4bc28756f7d5 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> 9f3daa245903 Successfully built 9f3daa245903 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-schedul er-estimator:latest
• set +x set -e;\ target=$(echo karmada-interpreter-webhook-example);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:53:13 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-interpreter-webhook-example !!! Building karmada-interpreter-webhook-example for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:53:13Z' -o _output/bin/linux/amd64/karmada-interpreter-webhook-example gi thub.com/karmada-io/karmada/examples/customresourceinterpreter/webhook
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-interpreter-webhook-example:latest
• docker build --build-arg BINARY=karmada-interpreter-webhook-example --tag swr. ap-southeast-1.myhuaweicloud.com/karmada/karmada-interpreter-webhook-example:lat est --file hack/../cluster/images/Dockerfile hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 515.7MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in 4b5289815ac4 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container 4b5289815ac4 ---> 4c6d393bbf93 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> e92c29329871 Successfully built e92c29329871 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-interpr eter-webhook-example:latest
• set +x set -e;\ target=$(echo karmada-search);\ make $target GOOS=linux;\ VERSION=latest REGISTRY=swr.ap-southeast-1.myhuaweicloud.com/karmada BUILD_PLATF ORMS=linux/amd64 hack/docker.sh $target make[1]: Entering directory '/home/azureuser/downloads/karmada' LDFLAGS='-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1.2.0-549-g79e 7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820dac159bbc9ac 7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.gitTreeState= dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08-22T16:53:27 Z' BUILD_PLATFORMS=linux/amd64 hack/build.sh karmada-search !!! Building karmada-search for linux/amd64:
• CGO_ENABLED=0
• GOOS=linux
• GOARCH=amd64
• go build -ldflags '-X github.com/karmada-io/karmada/pkg/version.gitVersion=v1. 2.0-549-g79e7820d -X github.com/karmada-io/karmada/pkg/version.gitCommit=79e7820 dac159bbc9ac7f52c00122945e37c3951 -X github.com/karmada-io/karmada/pkg/version.g itTreeState=dirty -X github.com/karmada-io/karmada/pkg/version.buildDate=2022-08 -22T16:53:27Z' -o _output/bin/linux/amd64/karmada-search github.com/karmada-io/k armada/cmd/karmada-search
• set +x make[1]: Leaving directory '/home/azureuser/downloads/karmada' Building image for linux/amd64: swr.ap-southeast-1.myhuaweicloud.com/karmada/kar mada-search:latest
• docker build --build-arg BINARY=karmada-search --tag swr.ap-southeast-1.myhuaw eicloud.com/karmada/karmada-search:latest --file hack/../cluster/images/Dockerfi le hack/../_output/bin/linux/amd64 Sending build context to Docker daemon 596.3MB Step 1/4 : FROM alpine:3.15.1 ---> e9adb5357e84 Step 2/4 : ARG BINARY ---> Using cache ---> ac8ad2ae4261 Step 3/4 : RUN apk add --no-cache ca-certificates ---> Running in 724e303e0df8 fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/main/x86_64/APKINDEX.tar.gz fetch https://dl-cdn.alpinelinux.org/alpine/v3.15/community/x86_64/APKINDEX.tar. gz (1/1) Installing ca-certificates (20220614-r0) Executing busybox-1.34.1-r4.trigger Executing ca-certificates-20220614-r0.trigger OK: 6 MiB in 15 packages Removing intermediate container 724e303e0df8 ---> b7c88ec2df27 Step 4/4 : COPY ${BINARY} /bin/${BINARY} ---> d7c8596e70b0 Successfully built d7c8596e70b0 Successfully tagged swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-search: latest
• set +x make: Leaving directory '/home/azureuser/downloads/karmada' Waiting for the host clusters to be ready... Waiting for kubeconfig file /home/azureuser/.kube/karmada.config and clusters ka rmada-host to be ready... Context "kind-karmada-host" renamed to "karmada-host". Cluster "kind-karmada-host" set. Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-controller-manager: latest" with ID "sha256:6a919e843a5f7d00a3fdfbcc431c22733d8434ca31ee5c31d48bfee8 a7ad9a99" not yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-scheduler:latest" w ith ID "sha256:a54055a11f055d81582112f0c4c41c7f59d99ba27deff0f72b9c7cb43449205b" not yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-descheduler:latest" with ID "sha256:4fbb943179b8f4b748cc1279699efe7f3a45d78a133748ba128368bbce818ed 8" not yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-webhook:latest" wit h ID "sha256:adc7b6fc2507343dc3b6a2db72e4b942dc0fddb22f6591871d920f08c15e692c" n ot yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-scheduler-estimator :latest" with ID "sha256:9f3daa2459038659621e1f4c3e447bc69acf3f9d193fb6c5cbd3ce6 2d7ee4cfc" not yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-aggregated-apiserve r:latest" with ID "sha256:2d4b458d7cb0ca52f8f049e5f102b846d4c0f704995fc01b5ed2b1 a0476b0340" not yet present on node "karmada-host-control-plane", loading... Image: "swr.ap-southeast-1.myhuaweicloud.com/karmada/karmada-search:latest" with ID "sha256:d7c8596e70b0c7492d1d587490f0455fb24afb0b38c94d2fc86b2204822e5539" no t yet present on node "karmada-host-control-plane", loading... go install github.com/cloudflare/cfssl/cmd/...@v1.5.0 go: downloading github.com/cloudflare/cfssl v1.5.0 go: downloading github.com/cloudflare/go-metrics v0.0.0-20151117154305-6a9aea36f b41 go: downloading github.com/go-sql-driver/mysql v1.4.0 go: downloading github.com/lib/pq v1.3.0 go: downloading github.com/mattn/go-sqlite3 v1.10.0 go: downloading github.com/zmap/zlint/v2 v2.2.1 go: downloading golang.org/x/crypto v0.0.0-20201012173705-84dcc777aaee go: downloading github.com/jmoiron/sqlx v1.2.0 go: downloading github.com/kisielk/sqlstruct v0.0.0-20150923205031-648daed35d49 go: downloading github.com/google/certificate-transparency-go v1.0.21 go: downloading github.com/zmap/zcrypto v0.0.0-20200911161511-43ff0ea04f21 go: downloading golang.org/x/net v0.0.0-20201010224723-4f7140c49acb go: downloading github.com/cloudflare/redoctober v0.0.0-20171127175943-746a508df 14c go: downloading github.com/GeertJohan/go.rice v1.0.0 go: downloading github.com/golang/protobuf v1.3.1 go: downloading github.com/jmhodges/clock v0.0.0-20160418191101-880ee4c33548 go: downloading golang.org/x/text v0.3.3 go: downloading github.com/weppos/publicsuffix-go v0.13.0 go: downloading github.com/daaku/go.zipexe v1.0.0 go: downloading github.com/getsentry/raven-go v0.0.0-20180121060056-563b81fc02b7 go: downloading github.com/certifi/gocertifi v0.0.0-20180118203423-deb3ae2ef261 go: downloading github.com/pkg/errors v0.8.0

  github.com/mattn/go-sqlite3

  sqlite3-binding.c: In function ‘sqlite3SelectNew’: sqlite3-binding.c:123303:10: warning: function may return address of local varia ble [-Wreturn-local-addr] 123303 | return pNew; | ^~~~ sqlite3-binding.c:123263:10: note: declared here 123263 | Select standin; | ^~~ ........+.+...............++++++++++++++++++++++++++++++++++++++++++++++++++++++ +++++++++++...+.+..++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ +++++..+....+..............+.+...+.....+...+..........+..+.+......+.....+.+.... .....+.....+.........+......+.............+......+...........+...+...+.......... ..+...+....+...+..+...+............+......+...+......+.+..+...+.......+...+...+. .+.........+......+.......+......+..+.......+.....+...+.......+...+........+.+.. .......+.....+.+...........+....+.....+.++++++++++++++++++++++++++++++++++++++++ +++++++++++++++++++++++++ ...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++.++++++++++ +++++++++++++++++++++++++++++++++++++++++++++++++++++++........+.........+..... .....+..+....+..+...+....+......+..+....+.....+......+.......+...+........+....+ ..+.+........+.+......+..+.+......+........+.......+...+......+.........+....... .+....+.....+...+...+..........+..+.......+..............+.+...............+.... .+.+............+......+.....+....+...+..................+...............+.....+ .+.....+.....................+...+....+...+.....+....+...+.................+.+.. +.+......+.........+......+...+...+..+++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++

  ...+.............+......+.........+.....++++++++++++++++++++++++++++++++++++++++ +++++++++++++++++++++++++.+........+...+.+...+............+......+.....+...++++ +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++..+........+....+. .......+......+.......+........+.......+........+....+.....+.................... .....+...+...+..+............+.+......+..................+.....+.+.....+......+. .....+....+...+............+...+...............+.....+.......+.....+.........+.. ..+...+..+......+......+....+......+....................+.+..+...+....+......+.. ...+.........+...+.+...............+..............+...+...+....+...........+.... ......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ....+.+...+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++.....+..+...............+.+..+....+...+.....+.......+.....+....+.....+... .+...+...+..+....+...........+...+.......+.....+...+.+.....+++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++........+....+..+.........+........ .....+............+...+............+........+.+.....+......+...+...+...+....+..+ .+.....+.......+..+...+.+..+............+.+.....+.+....................+....+... ..............+...+.+.....+.............+...............+...+..+................ .....+.+......+.........+...+...........+.+.....+..................+.......+.... .....+.....+.....................+......+...+..........+..+.........+....+.....+ ......+...+...+...+....+........+...+....+......+.....+....+........+.........+. .....+..........+..+.+...........+.........+......+.+..+.+......+......+..+..... .+..........+..+.......+..+.+..............+................+.....+.......+..... +.+.....+......+....+......+...+...........+....+...+........+......+...+....... +........................+..+.......+..+...+.+......+........+..........+..+.... ..+.......+........+...+..........+..+....+.........+............+...+.....+.... +..+...............+.+...+.....+.+......+..+..........+..+....+.........+.....+. +..+....+........+......+.+...............+........+.+.....+......+.+.....+...+. +......+............++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ +++++

  .+..+.......+........+...+.+.....+.+........++++++++++++++++++++++++++++++++++++ +++++++++++++++++++++++++++++.....+......+......+.+++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++...................++++++++++++++++++++++++ +++++++++++++++++++++++++++++++++++++++++ ..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++..+.....+... ...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++..+..+... +...+...+.+.........+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++

  panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x8ba386]

goroutine 1 [running]: debug/elf.(*Section).ReadAt(0xc0000b4320?, {0xc0002fac00?, 0x11f3230?, 0x34?}, 0 x40?)

:1 +0x26 archive/zip.readDirectoryEnd({0xbfa1c0, 0xc0000ff800}, 0x5b0) /usr/local/go/src/archive/zip/reader.go:526 +0xf5 archive/zip.(*Reader).init(0xc0002b7650, {0xbfa1c0?, 0xc0000ff800}, 0x5b0) /usr/local/go/src/archive/zip/reader.go:97 +0x5c archive/zip.NewReader({0xbfa1c0, 0xc0000ff800}, 0x5b0) /usr/local/go/src/archive/zip/reader.go:90 +0x5e github.com/daaku/go%2ezipexe.zipExeReaderElf({0xbfaf40?, 0xc0000140e0}, 0x11f3f3 0) /home/azureuser/go/pkg/mod/github.com/daaku/go.zipexe@v1.0.0/zipexe.go:1 28 +0x8b github.com/daaku/go%2ezipexe.NewReader({0xbfaf40, 0xc0000140e0}, 0x0?) /home/azureuser/go/pkg/mod/github.com/daaku/go.zipexe@v1.0.0/zipexe.go:4 8 +0x98 github.com/daaku/go%2ezipexe.OpenCloser({0xc00003e7e0?, 0xc0001c7be0?}) /home/azureuser/go/pkg/mod/github.com/daaku/go.zipexe@v1.0.0/zipexe.go:3 0 +0x57 github.com/GeertJohan/go%2erice.init.0() /home/azureuser/go/pkg/mod/github.com/!geert!johan/go.rice@v1.0.0/append ed.go:41 +0x65 Failed to parse input: unexpected end of JSON input

[RainbowMango]

I've no clue about this yet but will try with Go1.19 on my side because we are using Go1.18 in our CI.

[fly2F]

I had the same problem.

➜  karmada git:(master) uname -a
Linux k8s-1 5.15.0-1016-gcp #21-Ubuntu SMP Fri Aug 5 12:17:08 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
➜  karmada git:(master) lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 22.04.1 LTS
Release:    22.04
Codename:   jammy
➜  karmada git:(master) go version
go version go1.19 linux/amd64
➜  karmada git:(master)

upgrading cfssl to 1.6.1 can solve the problem of cfssl installation go install github.com/cloudflare/cfssl/cmd/...@v1.6.1

[RainbowMango]

@jxiang1995 can you try to update cfssl version to v1.6.1 and try again? like:

diff --git a/hack/deploy-karmada.sh b/hack/deploy-karmada.sh
index f874d4ca..2026535f 100755
--- a/hack/deploy-karmada.sh
+++ b/hack/deploy-karmada.sh
@@ -16,7 +16,7 @@ KARMADA_APISERVER_SECURE_PORT=${KARMADA_APISERVER_SECURE_PORT:-5443}
 HOST_CLUSTER_NAME=${HOST_CLUSTER_NAME:-"karmada-host"}
 ROOT_CA_FILE=${CERT_DIR}/ca.crt
 ROOT_CA_KEY=${CERT_DIR}/ca.key
-CFSSL_VERSION="v1.5.0"
+CFSSL_VERSION="v1.6.1"
 LOAD_BALANCER=${LOAD_BALANCER:-false} # whether create a 'LoadBalancer' type service for karmada apiserver
 source "${REPO_ROOT}"/hack/util.sh

You might have to delete the old version of cfss:

$ command -v cfssl  # find old cfssl path
$ rm xxxx/xxx/cfssl    # remove it. The script will install a new one.

[fly2F]

@RainbowMango @jxiang1995 Due to the use of go.rice, cfssl segfaults when installed with Go 1.19. Need to install via go install github.com/cloudflare/cfssl/cmd/cfssl@master https://github.com/cloudflare/cfssl/issues/1233 https://github.com/cloudflare/cfssl/pull/1236

[jxiang1995]

@liys87x @RainbowMango yes! It's working! Thank you guys!

Final solution: Go version: 1.19 Install cfssl via go install github.com/cloudflare/cfssl/cmd/cfssl@master cfssl version 1.6.2 - as today 8/23/2022

[jxiang1995]

Note: I'm using Azure and GCP to host Karmada. I found I need to set open file limitation to a higher value to avoid "too many files opened" problem.

what I did: ulimit - n 65535 sudo sysctl fs.inotify.max_user_instances=1024

[RainbowMango]

Thanks @jxiang1995 .

This doc from Kind also addressed this issue: https://kind.sigs.k8s.io/docs/user/known-issues/#pod-errors-due-to-too-many-open-files