search

kedro-org / kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
https://kedro.org
Apache License 2.0
9.53k stars 877 forks source link

kedro-docker plugin #768

Closed agarwalsourabh55 closed 3 years ago

agarwalsourabh55 commented 3 years ago

Description

Whenever I try to initialize kedro docker init then theri is always one error that comes

Context

How has this bug affected you? What were you trying to accomplish?

kedro.framework.cli.utils.KedroCliError: Cannot connect to the Docker daemon. Is the Docker daemon running?

Run with --verbose to see the full exception Error: Cannot connect to the Docker daemon. Is the Docker daemon running?

i am using latest kedro version and have already install kedro docker and daemon is also running

ignacioparicio commented 3 years ago

Hi @agarwalsourabh55, what output do you get when you do docker run hello-world in your terminal?

agarwalsourabh55 commented 3 years ago

Hi @agarwalsourabh55, what output do you get when you do docker run hello-world in your terminal? OUTPUT:-> Unable to find image 'hello-world:latest' locally latest: Pulling from library/hello-world b8dfde127a29: Pull complete Digest: sha256:5122f6204b6a3596e048758cabba3c46b1c937a46b5be6225b835d091b90e46c Status: Downloaded newer image for hello-world:latest

Hello from Docker! This message shows that your installation appears to be working correctly.

To generate this message, Docker took the following steps:

  1. The Docker client contacted the Docker daemon.
  2. The Docker daemon pulled the "hello-world" image from the Docker Hub. (amd64)
  3. The Docker daemon created a new container from that image which runs the executable that produces the output you are currently reading.
  4. The Docker daemon streamed that output to the Docker client, which sent it to your terminal.

To try something more ambitious, you can run an Ubuntu container with: $ docker run -it ubuntu bash

Share images, automate workflows, and more with a free Docker ID: https://hub.docker.com/

For more examples and ideas, visit: https://docs.docker.com/get-started/

agarwalsourabh55 commented 3 years ago

hi @ignacioparicio When I run sudo dockerd It give output: after sudo docker run hello-world command I run sudo dockerd then I got this output : INFO[2021-05-19T17:22:05.467907861+05:30] Starting up
failed to start daemon: pid file found, ensure docker is not running or delete /var/run/docker.pid

So to resolve this I shutdown docker using sudo systemctl stop docker and then I run again sudo dockerd then some logs of output shows: . . .INFO[2021-05-19T17:22:48.840837289+05:30] Loading containers: start.
INFO[2021-05-19T17:22:49.591264859+05:30] Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address INFO[2021-05-19T17:22:49.810992877+05:30] Loading containers: done.
INFO[2021-05-19T17:22:49.876563526+05:30] Docker daemon commit=8728dd2 graphdriver(s)=overlay version=20.10.6 INFO[2021-05-19T17:22:49.901739552+05:30] Daemon has completed initialization
INFO[2021-05-19T17:22:50.057427740+05:30] API listen on /var/run/docker.sock

Now don't know what to do next

ignacioparicio commented 3 years ago

Thank you for the additional details. This seems to be an issue with the docker installation / communication between the docker daemon and API requests, and not really a bug in kedro or kedro-airflow as far as I can tell. I'm on a Windows machine and cannot reproduce the issue (both kedro docker init and kedro docker build work fine for me).

If you haven't already, I would suggest to go over this page. docker info might also provide useful details.

My env:

ignacioparicio commented 3 years ago

@agarwalsourabh55 I will close the issue for now. If you still feel this is a bug on the kedro / kedro-docker side, please let me know and I will re-open it.