Closed ahmedhamidibr closed 6 days ago
Is this happening only for Snowflake or other connectors too?
@marcosmarxm source-google-analytics-data-api:2.4.2 as well
I work with the same setup, Airbyte (version 0.60.1) deployed via Docker on an Azure VM and I experienced the same with bing-ads and google-ads. Restarting with ./run-ab-platform.sh -b
fixed the issue for now. Let's see when it comes back.
2024-06-11 15:31:18 platform > Checking if airbyte/source-bing-ads:2.6.2 exists...
2024-06-11 15:31:18 platform > airbyte/source-bing-ads:2.6.2 not found locally. Attempting to pull the image...
2024-06-11 15:31:19 platform > Image does not exist.
2024-06-11 15:31:19 platform > Unexpected error while checking connection:
io.airbyte.workers.exception.WorkerException: Could not find image: airbyte/source-bing-ads:2.6.2
2024-06-11 14:10:49 platform > airbyte/source-google-ads:3.5.0 not found locally. Attempting to pull the image...
2024-06-11 14:10:50 platform > Image does not exist.
2024-06-11 14:10:50 platform > Unexpected error while checking connection:
io.airbyte.workers.exception.WorkerException: Could not find image: airbyte/source-google-ads:3.5.0
I can confirm this issue, we need to inspect and analyze the situation when Airbyte is stuck: --> Try to pull the image with docker "outside" of Airbyte to see whether it's generally not pullable or whether Airbyte can't do it.
It's important to realize: Airbyte does use the same docker mechanism. The var/docker.sock is mounted into Airbyte so basically Airbyte only instructs docker to pull the image for it. It's irrelevant if Airbyte can connect to the web or not, it's the docker daemon running on the VM that performs the pull request.
Could it be a docker hub limiting issue? Would it help if we authorize with docker hub using an account instead of an anonymous pull?
Happening to me as well.
Possible related to: https://github.com/airbytehq/airbyte/issues/39337
Edit: Restarting docker fixed the issue for me.
## tried to pull the image manually from the VM
docker pull airbyte/source-salesforce:2.5.15
2.5.15: Pulling from airbyte/source-salesforce
Digest: sha256:5296acee7fb4eb1f39f9d220cfa7192440af50d52aece7f2b7747a0798fec0c2
Status: Image is up to date for airbyte/source-salesforce:2.5.15
docker.io/airbyte/source-salesforce:2.5.15
## this confirms that the image is actually there and ready for airbyte - no need to pull at all
## now let's go into airby_worker and try to pull the image like airbyte does
x@y:~/services/airbyte$ docker exec -it airbyte-worker bash
[airbyte@5e84c22df9f6 app]$ docker pull airbyte/source-salesforce:2.5.15
error during connect: Post "http://docker-proxy:2375/v1.24/images/create?fromImage=airbyte%2Fsource-salesforce&tag=2.5.15": dial tcp: lookup docker-proxy on 127.0.0.11:53: server misbehaving
## ah, docker-proxy not there?
[airbyte@5e84c22df9f6 app]$ exit
x@y:~/services/airbyte$ docker compose ls
NAME STATUS CONFIG FILES
dbt-salesforce running(1) /home/adminuser/services/dbt-salesforce/docker-compose.yml
airbyte running(9) /home/adminuser/services/airbyte/docker-compose.yaml,/home/adminuser/services/airbyte/docker-compose.override.yaml
dagster_workspace running(5) /home/adminuser/services/dagster_workspace/docker-compose.yml
metabase running(2) /home/adminuser/services/metabase/docker-compose.yml
To fix this issue, add this to a docker-compose.override.yaml or edit the upstream airby docker-compose.yaml file.
docker-proxy:
# i also noticed that the container_name is not set by airbyte like for the other services
container_name: docker-proxy
# this should fix the issue
restart: unless-stopped
I created: https://github.com/airbytehq/airbyte-platform/pull/334
Bonus information: If you have a regular cronjob to cleanup docker that might remove the airbyte images, use this to filter them from being deleted, this way the probability of the pull issue should be reduced:
docker image prune --force --all --filter="label!=io.airbyte.name" --filter until=92h
Hi all, first off, thank you for investigating and proposing solutions to this bug.
Docker compose is going to be deprecated in a month so we aren't going to check in any fixes to the docker set up. I'd encourage you to try out our new abctl tool linked in the same discussion post.
With that in mind, I'm going to close this issue. Sorry for the inconvenience and thank you for your patience!
Connector Name
source-salesforce
Connector Version
2.5.13
What step the error happened?
During the sync
Relevant information
I am encountering an issue with Airbyte (version 0.60.1) deployed via Docker on an Azure VM. Here are the details of my environment:
Issue Description
When running a sync, Airbyte fails to pull the respective source image. This issue occurs not only with the source-salesforce but also with source-google-analytics-data-api. Both sources fail to pull the required images.
Additional Information
-Disk Space: The disk has sufficient space, as shown below:
-Network: The instance has internet access, and there are no firewall rules blocking the network. When pulling the image manually, it succeeds:
-Intermittent soultion: Sometimes restarting airbyte (via docker compose) resolves the issue, but after a while, it happens again. Occasionally, even restarting airbyte does not solve the problem.
Can you please provide guidance on resolving this issue?
Thank you.
Relevant log output
Contribute