airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.92k stars 3.83k forks source link

[abctl] unable to follow quick start, install locally on mac #40231

Open techieshark opened 3 weeks ago

techieshark commented 3 weeks ago

What happened?

I was reading https://docs.airbyte.com/deploying-airbyte/quickstart#setup--launch-airbyte

I ran

brew tap airbytehq/tap
brew install abctl # and after this failed I tried via `go install github.com/airbytehq/abctl@latest` but same problems
abctl local install

and it failed:

```console INFO Using Kubernetes provider: Provider: kind Kubeconfig: /Users/username/.airbyte/abctl/abctl.kubeconfig Context: kind-airbyte-abctl SUCCESS Found Docker installation: version 25.0.3 SUCCESS Port 8000 appears to be available INFO No existing cluster found, cluster 'airbyte-abctl' will be created SUCCESS Cluster 'airbyte-abctl' created WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 2 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 3 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 2 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 4 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 3 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 5 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 6 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd24d9fe1c39 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": dial tcp 10.244.0.13:8006: connect: connection refused Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 7 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd24d9fe1c39 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": dial tcp 10.244.0.13:8006: connect: connection refused Count: 2 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 8 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd297f96ebc3 Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.13:8006/health": dial tcp 10.244.0.13:8006: connect: connection refused Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd24d9fe1c39 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": dial tcp 10.244.0.13:8006: connect: connection refused Count: 3 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 4 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 9 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd2e2e22f766 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd2e2e4c0da1 Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.13:8006/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 5 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 10 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1dda97ce0b Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 6 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-server-689bbc977c-gqs98.17dbdd1932933fc7 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.11:8001/api/v1/health": dial tcp 10.244.0.11:8001: connect: connection refused Count: 11 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd2e2e22f766 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Count: 2 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd2e2e4c0da1 Reason: Unhealthy Message: Liveness probe failed: Get "http://10.244.0.13:8006/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Count: 2 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd326aafea50 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": read tcp 10.244.0.1:52584->10.244.0.13:8006: read: connection reset by peer Count: 1 WARNING Encountered an issue deploying Airbyte: Pod: airbyte-abctl-airbyte-api-server-b5b8c99f-dbpmf.17dbdd24d9fe1c39 Reason: Unhealthy Message: Readiness probe failed: Get "http://10.244.0.13:8006/health": dial tcp 10.244.0.13:8006: connect: connection refused Count: 4 ERROR Failed to install airbyte/airbyte Helm Chart ERROR Unable to install Airbyte locally ERROR could not install airbyte chart: could not install helm: Get "https://127.0.0.1:56964/api/v1/namespaces/airbyte-abctl/services/airbyte-abctl-airbyte-webapp-svc": http2: client connection lost ```

What did you expect to happen?

I expected it not to fail and to show me some URL to go to to see locally hosted airbyte

Abctl Version

```console $ abctl version version: v0.5.0 ```

Docker Version

```console $ docker version Client: Version: 20.10.21-rd API version: 1.41 Go version: go1.18.7 Git commit: ac29474 Built: Tue Nov 22 22:21:43 2022 OS/Arch: darwin/arm64 Context: desktop-linux Experimental: true Server: Docker Desktop 4.28.0 (139021) Engine: Version: 25.0.3 API version: 1.44 (minimum version 1.24) Go version: go1.21.6 Git commit: f417435 Built: Tue Feb 6 21:14:22 2024 OS/Arch: linux/arm64 Experimental: false containerd: Version: 1.6.28 GitCommit: ae07eda36dd25f8a1b98dfbf587313b99c0190bb runc: Version: 1.1.12 GitCommit: v1.1.12-0-g51d5e94 docker-init: Version: 0.19.0 GitCommit: de40ad0 ```

OS Version

```console # On Mac: $ uname -a Darwin machine.local 23.5.0 Darwin Kernel Version 23.5.0: Wed May 1 20:16:51 PDT 2024; root:xnu-10063.121.3~5/RELEASE_ARM64_T8103 arm64 ```
marcosmarxm commented 2 weeks ago

@techieshark sorry the lack of updates here. Are you still experiencing the issue or found a solution?

whanata commented 6 days ago

@marcosmarxm I'm experiencing this issue, but in an EC2 Box on Amazon Linux 2023.