search

tensorchord / envd

🏕️ Reproducible development environment
https://envd.tensorchord.ai/
Apache License 2.0
1.94k stars 156 forks source link

bug: error: image envd-quick-start:dev not found #1590

Open hebiao064 opened 1 year ago

hebiao064 commented 1 year ago

Are you use the envd server?

Describe the bug

The following build.envd failed to be built:

def build():
    config.repo(url="https://github.com/tensorchord/envd", description="envd quick start example")
    base(os="ubuntu20.04", language="python3")
    # Configure pip index if needed.
    # config.pip_index(url = "https://pypi.tuna.tsinghua.edu.cn/simple")
    install.python_packages(name = [
        "numpy",
        "torch",
        "tensorflow"
    ])
    shell("zsh")
    config.jupyter()

To Reproduce

pip install envd
envd boostrap
git clone https://github.com/tensorchord/envd-quick-start.git
cd envd-quick-start

modify build.envd to be:

def build():
    config.repo(url="https://github.com/tensorchord/envd", description="envd quick start example")
    base(os="ubuntu20.04", language="python3")
    # Configure pip index if needed.
    # config.pip_index(url = "https://pypi.tuna.tsinghua.edu.cn/simple")
    install.python_packages(name = [
        "numpy",
        "torch",
        "tensorflow"
    ])
    shell("zsh")
    config.jupyter()

Run envd up

Expected behavior

No response

The docker info output

(base) ➜  envd-quick-start git:(master) ✗ docker info
Client:
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc., v0.10.0)
  compose: Docker Compose (Docker Inc., v2.15.1)
  dev: Docker Dev Environments (Docker Inc., v0.0.5)
  extension: Manages Docker extensions (Docker Inc., v0.2.17)
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc., 0.6.0)
  scan: Docker Scan (Docker Inc., v0.23.0)

Server:
 Containers: 1
  Running: 1
  Paused: 0
  Stopped: 0
 Images: 8
 Server Version: 20.10.22
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 9ba4b250366a5ddde94bb7c9d1def331423aa323
 runc version: v1.1.4-0-g5fd4c4d
 init version: de40ad0
 Security Options:
  seccomp
   Profile: default
  cgroupns
 Kernel Version: 5.15.49-linuxkit
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 8
 Total Memory: 7.674GiB
 Name: docker-desktop
 ID: CEJB:TN2Q:FCMX:OJPT:2YFR:DY3D:HIPY:5ZNV:AI4Y:4JU4:LMZP:PTVD
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5000
  127.0.0.0/8
 Live Restore Enabled: false

The envd version output

envd: v0.3.20
  BuildDate: 2023-05-02T09:41:36Z
  GitCommit: 6e055c61fdc1cdba6959c8a54ead5aad6654090e
  GitTreeState: clean
  GitTag: v0.3.20
  GoVersion: go1.19.8
  Compiler: gc
  Platform: darwin/amd64

Additional context

Error Stacktrace:

(base) ➜  envd-quick-start git:(master) ✗ envd up
[+] ⌚ parse build.envd and download/cache dependencies 0.0s ✅ (finished)
 => 💽 (cached) download oh-my-zsh                                                                                                                                  0.0s
[+] build envd environment 2.3s (2/53)
 => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                                                                  2.3s
 => docker-image://docker.io/library/ubuntu:20.04                                                                                                                  2.3s
 => => resolve docker.io/library/ubuntu:20.04                                                                                                                      2.2s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                                                             2.2s
 => => resolve docker.io/tensorchord/horust:v0.2.1                                                                                                                 2.2s
[+] build envd environment 2.4s (2/53)
 => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                                                                  2.4s
 => docker-image://docker.io/library/ubuntu:20.04                                                                                                                  2.4s
 => => resolve docker.io/library/ubuntu:20.04                                                                                                                      2.4s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                                                             2.4s
 => => resolve docker.io/tensorchord/horust:v0.2.1                                                                                                                 2.4s
[+] build envd environment 2.6s (2/53)                                                                                                                               0s
 => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                                                               2.6s.4s
 => docker-image://docker.io/library/ubuntu:20.04                                                                                                               2.6s.4s
 => => resolve docker.io/library/ubuntu:20.04                                                                                                                   2.5s.0s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                                                          2.6s.4s
 => => resolve docker.io/tensorchord/horust:v0.2.1                                                                                                              2.5s.4s
[+] build envd environment 2.7s (2/53)                                                                                                                          0.0s
 => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                                    2.7s                       2.6s
 => docker-image://docker.io/library/ubuntu:20.04                                                                                    2.7s                       2.5s
 => => resolve docker.io/library/ubuntu:20.04                                                                                        2.7s                       0.0s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                               2.7s                       2.6s
 => => resolve docker.io/tensorchord/horust:v0.2.1                                                                                   2.7s                       2.5s
[+] build envd environment 2.9s (2/53)
 => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                                    2.9s
 => docker-image://docker.io/library/ubuntu:20.04                                                                                    2.9s
 => => resolve docker.io/library/ubuntu:20.04                                                                                        2.8s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                               2.9s
 => => resolve docker.io/tensorchord/horust:v0.2.1                                                                                   2.8s
[+] build envd environment 427.4s (54/54) FINISHED                                                                                  => importing cache manifest from docker.io/tensorchord/python-cache:envd-v0.3.20                                             5.3s
 => docker-image://docker.io/library/ubuntu:20.04                                                                             5.5s  => => resolve docker.io/library/ubuntu:20.04                                                                                 5.5s
 => docker-image://docker.io/tensorchord/horust:v0.2.1                                                                        5.5s  => => resolve docker.io/tensorchord/horust:v0.2.1                                                                            5.5s
 => CACHED [internal] setting pip cache mount permissions                                                                     0.0s  => docker-image://docker.io/tensorchord/envd-sshd-from-scratch:v0.3.20                                                       5.4s
 => => resolve docker.io/tensorchord/envd-sshd-from-scratch:v0.3.20                                                           5.4s  => local://cache-dir                                                                                                         1.4s
 => => transferring cache-dir: 7.75MB                                                                                         1.4s  => docker-image://docker.io/tensorchord/starship:v0.0.1                                                                      4.6s
 => => resolve docker.io/tensorchord/starship:v0.0.1                                                                          4.6s
 => CACHED [internal] install built-in packages                                                                               0.0s
 => CACHED [internal] create conda directory                                                                                  0.0s
 => CACHED [internal] install conda                                                                                           0.0s
 => CACHED [internal] install horust                                                                                          0.0s
 => CACHED [internal] mkdir for horust service: /etc/horust/services                                                          0.0s
 => CACHED [internal] mkdir for horust log: /var/log/horust                                                                   0.0s
 => CACHED [internal] change directory permission for logging                                                                 0.0s
 => CACHED [internal] add envd-sshd from tensorchord/envd-sshd-from-scratch:v0.3.20                                           0.0s
 => CACHED [internal] add envd-starship from tensorchord/starship:v0.0.1                                                      0.0s
 => CACHED [internal] create user group envd                                                                                  0.0s
 => CACHED [internal] create user envd                                                                                        0.0s
 => CACHED [internal] add user envd to sudoers                                                                                0.0s
 => CACHED [internal] mkdir config and cache dir                                                                              0.0s
 => CACHED [internal] install system packages                                                                                 0.0s
 => CACHED [internal] initialize conda bash environment                                                                       0.0s
 => CACHED [internal] create conda environment: bash -c "/opt/conda/bin/conda create -n envd python=3.9"                      0.0s
 => CACHED [internal] conda python environment                                                                                0.0s
 => CACHED copy /oh-my-zsh /home/envd/.oh-my-zsh                                                                              0.0s
 => CACHED mkfile /home/envd/install.sh                                                                                       0.0s
 => CACHED [internal] install oh-my-zsh                                                                                       0.0s
 => CACHED mkfile /home/envd/.zshrc                                                                                           0.0s
 => CACHED [internal] configure shell zsh                                                                                     0.0s
 => CACHED pre-python stage                                                                                                   0.0s
 => CACHED [internal] install conda packages                                                                                  0.0s
 => CACHED [internal] create cache dir                                                                                        0.0s
 => [internal] create dir for ssh key                                                                                         0.1s
 => pip install numpy torch tensorflow                                                                                      106.0s
 => [internal] install ssh keys                                                                                               0.0s
 => [internal] install ssh key                                                                                                0.0s
 => pip install jupyter                                                                                                      14.5s
 => [internal] install PyPI packages                                                                                          0.1s
 => [internal] generating the image                                                                                          11.8s
 => => merging                                                                                                               11.8s
 => [internal] update alternative python to envd                                                                              0.2s
 => [internal] update alternative python3 to envd                                                                             0.1s
 => [internal] update alternative pip to envd                                                                                 0.1s
 => [internal] update alternative pip3 to envd                                                                                0.1s
 => [internal] init conda zsh env                                                                                             0.5s
 => [internal] add conda environment to /home/envd/.zshrc                                                                     0.1s
 => [internal] creating config dir                                                                                            0.0s
 => [internal] setting prompt starship config                                                                                 0.0s
 => [internal] setting prompt bash config                                                                                     0.1s
 => [internal] setting prompt zsh config                                                                                      0.1s
 => [internal] configure user permissions for /opt/conda/envs/envd/conda-meta                                                 0.1s
 => [internal] create work dir: /home/envd/envd-quick-start                                                                   0.0s
 => [internal] create file /etc/horust/services/sshd.toml                                                                     0.0s
 => [internal] create file /etc/horust/services/jupyter.toml                                                                  0.0s
 => exporting to oci image format                                                                                           286.6s
 => => exporting layers                                                                                                     228.0s
 => => exporting manifest sha256:75c19703722ef77972e716f4dfd351688e7536835e0f15e9e517291b6f10082f                             0.0s
 => => exporting config sha256:b6ba0a8c4c7bf4a36bb4919d9d781949c51625459184f8037a3d95aef6b0edf4                               0.0s
 => => sending tarball                                                                                                       58.5s
⣾ [1/5] configure the environment  [0s]
error: image envd-quick-start:dev not found
kemingy commented 1 year ago

Similar to https://github.com/tensorchord/envd/issues/1165

Please check the space usage for docker.