airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.15k stars 4.13k forks source link

[abctl] unable to create kind cluster: failed to init node with kubeadm: `docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6` #44914

Open BoostN opened 2 months ago

BoostN commented 2 months ago

What happened?

New CT Container running Debian Bookworm on Proxmox

Installed Docker Desktop as requested following the Linux guide on the docs. (https://docs.airbyte.com/using-airbyte/getting-started/oss-quickstart)

Used the curl command to install the abctl package.

create a airbyte directory under the home directory (ran the install tool).

INFO Using Kubernetes provider: Provider: kind Kubeconfig: /root/.airbyte/abctl/abctl.kubeconfig Context: kind-airbyte-abctl SUCCESS Found Docker installation: version 27.1.2 SUCCESS Port 8000 appears to be available INFO No existing cluster found, cluster 'airbyte-abctl' will be created ERROR Cluster 'airbyte-abctl' could not be created ERROR unable to create kind cluster: failed to init node with kubeadm: command "docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1

What did you expect to happen?

Airbyte to be installed

Abctl Version

```console $ abctl version # (version: v0.13.1) ```

Docker Version

```console $ docker version # paste output here ```

Client: Docker Engine - Community Version: 27.1.2 API version: 1.46 Go version: go1.21.13 Git commit: d01f264 Built: Mon Aug 12 11:50:58 2024 OS/Arch: linux/amd64 Context: default

Server: Docker Engine - Community Engine: Version: 27.1.2 API version: 1.46 (minimum version 1.24) Go version: go1.21.13 Git commit: f9522e5 Built: Mon Aug 12 11:50:58 2024 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.7.20 GitCommit: 8fc6bcff51318944179630522a095cc9dbf9f353 runc: Version: 1.1.13 GitCommit: v1.1.13-0-g58aa920 docker-init: Version: 0.19.0 GitCommit: de40ad0

OS Version

```console # On Linux: $ cat /etc/os-release # paste output here # On Mac: $ uname -a # paste output here # On Windows: C:\> wmic os get Caption, Version, BuildNumber, OSArchitecture # paste output here ```

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"

marcosmarxm commented 2 months ago

Can you share the output of the command: docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6

BoostN commented 2 months ago

Can you share the output of the command: docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6

docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6 Error response from daemon: No such container: airbyte-abctl-control-plane

To add, I've also tried Ubuntu 24.04 standard image as well. Same result. I've rebuilt the container a few times as well to help rule out other things with no luck. Its the same problem consistently.

BoostN commented 2 months ago

More Feedback:

removed the ".airbyte" folder. Install failed

I then installed again and chmod 755 -R .airbyte/abctl

Ran the local install with verbose:


                k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
          runtime.main
                runtime/proc.go:267
          runtime.goexit
                runtime/asm_amd64.s:1650
          error execution phase wait-control-plane
          k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run.func1
                k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:260
          k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).visitAll
                k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:446
          k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow.(*Runner).Run
                k8s.io/kubernetes/cmd/kubeadm/app/cmd/phases/workflow/runner.go:232
          k8s.io/kubernetes/cmd/kubeadm/app/cmd.newCmdInit.func1
                k8s.io/kubernetes/cmd/kubeadm/app/cmd/init.go:124
          github.com/spf13/cobra.(*Command).execute
                github.com/spf13/cobra@v1.7.0/command.go:940
          github.com/spf13/cobra.(*Command).ExecuteC
                github.com/spf13/cobra@v1.7.0/command.go:1068
          github.com/spf13/cobra.(*Command).Execute
                github.com/spf13/cobra@v1.7.0/command.go:992
          k8s.io/kubernetes/cmd/kubeadm/app.Run
                k8s.io/kubernetes/cmd/kubeadm/app/kubeadm.go:50
          main.main
                k8s.io/kubernetes/cmd/kubeadm/kubeadm.go:25
          runtime.main
                runtime/proc.go:267
          runtime.goexit
                runtime/asm_amd64.s:1650
  DEBUG   kind - INFO:  ✗ Starting control-plane 🕹️                                                                                                              
  DEBUG   kind - INFO: Deleted nodes: ["airbyte-abctl-control-plane"]                                                                                           
  ERROR   Cluster 'airbyte-abctl' could not be created                                                                                                          
  ERROR   unable to create kind cluster: failed to init node with kubeadm: command "docker exec --privileged airbyte-abctl-control-plane kubeadm init --skip-phases=preflight --config=/kind/kubeadm.conf --skip-token-print --v=6" failed with error: exit status 1 ```

Still failed with the same error.
diane-capewell-mark43 commented 3 weeks ago

I'm experiencing the same behavior on M3 Mac. Should I add my info here or open a new bug report?

abctl version: v0.19.0 OS version Darwin xxxx-xxxx-macOS 23.6.0 Darwin Kernel Version 23.6.0 Docker version client 27.2.0, server Docker Desktop 4.34.0 engine 27.2.0 (full info is very long but can supply if helpful)