search

ApolloAuto / apollo

An open autonomous driving platform
Apache License 2.0
25.01k stars 9.67k forks source link

docker: Error response from daemon: failed to create task for containe #15045

Closed meua closed 1 week ago

meua commented 1 year ago

Describe the bug docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "true": executable file not found in $PATH: unknown.

(base) jarvis@jia:~/coding/ApolloAuto/apollo$ bash docker/scripts/dev_start.sh
[INFO] Determine whether host GPU is available ...
[WARNING] No rocm-smi found.
[INFO] USE_GPU_HOST: 1
[INFO] USE_AMD_GPU: 0
[INFO] USE_NVIDIA_GPU: 1
[INFO] Use default GeoLocation settings
[INFO] Start pulling docker image apolloauto/apollo:dev-x86_64-18.04-20221124_1708 ...
dev-x86_64-18.04-20221124_1708: Pulling from apolloauto/apollo
Digest: sha256:1297e8cbdef666e88567d4d8bfe27a59e0cae8cec2b4738f838f20cc7d6c18af
Status: Image is up to date for apolloauto/apollo:dev-x86_64-18.04-20221124_1708
docker.io/apolloauto/apollo:dev-x86_64-18.04-20221124_1708
[INFO] Remove existing Apollo Development container ...
[INFO] Starting mounting map volumes ...
[INFO] Load map sunnyvale_big_loop from image: apolloauto/apollo:map_volume-sunnyvale_big_loop-latest
[INFO] Create volume apollo_map_volume-sunnyvale_big_loop_jarvis from image: apolloauto/apollo:map_volume-sunnyvale_big_loop-latest
[INFO] Start pulling docker image apolloauto/apollo:map_volume-sunnyvale_big_loop-latest ...
map_volume-sunnyvale_big_loop-latest: Pulling from apolloauto/apollo
Digest: sha256:0a27ea953198d397fd7bf3b0e670951f6a9d645d362a8bdc707589a26cde8861
Status: Image is up to date for apolloauto/apollo:map_volume-sunnyvale_big_loop-latest
docker.io/apolloauto/apollo:map_volume-sunnyvale_big_loop-latest
[INFO] Load map sunnyvale_loop from image: apolloauto/apollo:map_volume-sunnyvale_loop-latest
[INFO] Create volume apollo_map_volume-sunnyvale_loop_jarvis from image: apolloauto/apollo:map_volume-sunnyvale_loop-latest
[INFO] Start pulling docker image apolloauto/apollo:map_volume-sunnyvale_loop-latest ...
map_volume-sunnyvale_loop-latest: Pulling from apolloauto/apollo
Digest: sha256:1337ca5d357f33318e38368b6218d343f6138c63a9bb491175ca7cdd39c1a789
Status: Image is up to date for apolloauto/apollo:map_volume-sunnyvale_loop-latest
docker.io/apolloauto/apollo:map_volume-sunnyvale_loop-latest
[INFO] Load map sunnyvale_with_two_offices from image: apolloauto/apollo:map_volume-sunnyvale_with_two_offices-latest
[INFO] Create volume apollo_map_volume-sunnyvale_with_two_offices_jarvis from image: apolloauto/apollo:map_volume-sunnyvale_with_two_offices-latest
[INFO] Start pulling docker image apolloauto/apollo:map_volume-sunnyvale_with_two_offices-latest ...
map_volume-sunnyvale_with_two_offices-latest: Pulling from apolloauto/apollo
Digest: sha256:5893abb847f7cffb5dd310f9bac307d5c2537797c247eb1c609f36de1943bdf5
Status: Image is up to date for apolloauto/apollo:map_volume-sunnyvale_with_two_offices-latest
docker.io/apolloauto/apollo:map_volume-sunnyvale_with_two_offices-latest
[INFO] Load map san_mateo from image: apolloauto/apollo:map_volume-san_mateo-latest
[INFO] Create volume apollo_map_volume-san_mateo_jarvis from image: apolloauto/apollo:map_volume-san_mateo-latest
[INFO] Start pulling docker image apolloauto/apollo:map_volume-san_mateo-latest ...
map_volume-san_mateo-latest: Pulling from apolloauto/apollo
Digest: sha256:12b04dbfa947f7f06dc5c3b7604be08988c560e850c037a2571998478f0ccf80
Status: Image is up to date for apolloauto/apollo:map_volume-san_mateo-latest
docker.io/apolloauto/apollo:map_volume-san_mateo-latest
[INFO] Load map apollo_virutal_map from image: apolloauto/apollo:map_volume-apollo_virutal_map-latest
[INFO] Create volume apollo_map_volume-apollo_virutal_map_jarvis from image: apolloauto/apollo:map_volume-apollo_virutal_map-latest
[INFO] Start pulling docker image apolloauto/apollo:map_volume-apollo_virutal_map-latest ...
map_volume-apollo_virutal_map-latest: Pulling from apolloauto/apollo
Digest: sha256:f478d6f7791defd3e4cba20a6163a16646c7174e7fa1161404783c5866dd73ab
Status: Image is up to date for apolloauto/apollo:map_volume-apollo_virutal_map-latest
docker.io/apolloauto/apollo:map_volume-apollo_virutal_map-latest
docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "true": executable file not found in $PATH: unknown.
[INFO] Mount other volumes ...
[INFO] Create volume apollo_audio_volume_jarvis from image: apolloauto/apollo:data_volume-audio_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:data_volume-audio_model-x86_64-latest ...
data_volume-audio_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:1491b6de2b71bd6bc6326bf70a945da69360e490724df78849f6d70ff4d00f61
Status: Image is up to date for apolloauto/apollo:data_volume-audio_model-x86_64-latest
docker.io/apolloauto/apollo:data_volume-audio_model-x86_64-latest
[INFO] Create volume apollo_tl_detection_volume_jarvis from image: apolloauto/apollo:traffic_light-detection_caffe_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:traffic_light-detection_caffe_model-x86_64-latest ...
traffic_light-detection_caffe_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:405b4ada33d7de94d62325b28c8dee55e277769ae1d2be21b8f94dcd66ec3ca1
Status: Image is up to date for apolloauto/apollo:traffic_light-detection_caffe_model-x86_64-latest
docker.io/apolloauto/apollo:traffic_light-detection_caffe_model-x86_64-latest
[INFO] Create volume apollo_tl_horizontal_volume_jarvis from image: apolloauto/apollo:traffic_light-horizontal_caffe_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:traffic_light-horizontal_caffe_model-x86_64-latest ...
traffic_light-horizontal_caffe_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:17fc307e75731c5cedb8aa9300c830ba51eb3d7729f6b572530678fbffd4c531
Status: Image is up to date for apolloauto/apollo:traffic_light-horizontal_caffe_model-x86_64-latest
docker.io/apolloauto/apollo:traffic_light-horizontal_caffe_model-x86_64-latest
[INFO] Create volume apollo_tl_quadrate_volume_jarvis from image: apolloauto/apollo:traffic_light-quadrate_caffe_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:traffic_light-quadrate_caffe_model-x86_64-latest ...
traffic_light-quadrate_caffe_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:b1cdfbb8780b771de05723991e09aa9b2eef760a4321338b386759174f4ca9c5
Status: Image is up to date for apolloauto/apollo:traffic_light-quadrate_caffe_model-x86_64-latest
docker.io/apolloauto/apollo:traffic_light-quadrate_caffe_model-x86_64-latest
[INFO] Create volume apollo_tl_recognition_volume_jarvis from image: apolloauto/apollo:traffic_light-recognition_caffe_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:traffic_light-recognition_caffe_model-x86_64-latest ...
traffic_light-recognition_caffe_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:7779dd86ed9a9cf1050ab433904013653211c2ab7889245c9ac8494923af19e9
Status: Image is up to date for apolloauto/apollo:traffic_light-recognition_caffe_model-x86_64-latest
docker.io/apolloauto/apollo:traffic_light-recognition_caffe_model-x86_64-latest
[INFO] Create volume yolo_obstacle_volume_jarvis from image: apolloauto/apollo:yolo_obstacle_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:yolo_obstacle_model-x86_64-latest ...
yolo_obstacle_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:5800e9d217413bd36c22b475813fb9d3a36778629cb040fa36fac0d6a224bf3a
Status: Image is up to date for apolloauto/apollo:yolo_obstacle_model-x86_64-latest
docker.io/apolloauto/apollo:yolo_obstacle_model-x86_64-latest
[INFO] Create volume cnnseg_volume_jarvis from image: apolloauto/apollo:cnnseg_caffe_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:cnnseg_caffe_model-x86_64-latest ...
cnnseg_caffe_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:8b1ae7dc3d34ce6be4e196b77091846a8c53a5cd82553679387f667b8f2023c9
Status: Image is up to date for apolloauto/apollo:cnnseg_caffe_model-x86_64-latest
docker.io/apolloauto/apollo:cnnseg_caffe_model-x86_64-latest
[INFO] Create volume lane_detection_volume_jarvis from image: apolloauto/apollo:lane_detection_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:lane_detection_model-x86_64-latest ...
lane_detection_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:d55346a42c93f53cab1bdfe91b7d0b090a388efaee1b7133eebab1543b6b4942
Status: Image is up to date for apolloauto/apollo:lane_detection_model-x86_64-latest
docker.io/apolloauto/apollo:lane_detection_model-x86_64-latest
[INFO] Create volume apollo_smoke_volume_jarvis from image: apolloauto/apollo:smoke_volume-yolo_obstacle_detection_model-x86_64-latest
[INFO] Start pulling docker image apolloauto/apollo:smoke_volume-yolo_obstacle_detection_model-x86_64-latest ...
smoke_volume-yolo_obstacle_detection_model-x86_64-latest: Pulling from apolloauto/apollo
Digest: sha256:848c0bc03e73898155a079576568d640ad6c6b2ec665d2ac2f1c46838f5c3fc9
Status: Image is up to date for apolloauto/apollo:smoke_volume-yolo_obstacle_detection_model-x86_64-latest
docker.io/apolloauto/apollo:smoke_volume-yolo_obstacle_detection_model-x86_64-latest
[INFO] Starting Docker container "apollo_dev_jarvis" ...
+ docker run --gpus all -itd --privileged --name apollo_dev_jarvis -e DISPLAY=:10.0 -e DOCKER_USER=jarvis -e USER=jarvis -e DOCKER_USER_ID=1000 -e DOCKER_GRP=jarvis -e DOCKER_GRP_ID=1000 -e DOCKER_IMG=apolloauto/apollo:dev-x86_64-18.04-20221124_1708 -e USE_GPU_HOST=1 -e NVIDIA_VISIBLE_DEVICES=all -e NVIDIA_DRIVER_CAPABILITIES=compute,video,graphics,utility --volume apollo_map_volume-sunnyvale_big_loop_jarvis:/apollo/modules/map/data/sunnyvale_big_loop --volume apollo_map_volume-sunnyvale_loop_jarvis:/apollo/modules/map/data/sunnyvale_loop --volume apollo_map_volume-sunnyvale_with_two_offices_jarvis:/apollo/modules/map/data/sunnyvale_with_two_offices --volume apollo_map_volume-san_mateo_jarvis:/apollo/modules/map/data/san_mateo --volume apollo_map_volume-apollo_virutal_map_jarvis:/apollo/modules/map/data/apollo_virutal_map --volume apollo_audio_volume_jarvis:/apollo/modules/audio/data/ --volume apollo_tl_detection_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/traffic_light_detection/tl_detection_caffe --volume apollo_tl_horizontal_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/traffic_light_recognition/horizontal_caffe --volume apollo_tl_quadrate_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/traffic_light_recognition/quadrate_caffe --volume apollo_tl_recognition_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/traffic_light_recognition/vertical_caffe --volume yolo_obstacle_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/yolo_obstacle_detector/3d-r4-half_caffe --volume cnnseg_volume_jarvis:/apollo/modules/perception/production/data/perception/lidar/models/cnnseg/cnnseg128_caffe --volume lane_detection_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/lane_detector/darkSCNN_caffe --volume apollo_smoke_volume_jarvis:/apollo/modules/perception/production/data/perception/camera/models/yolo_obstacle_detector/smoke_libtorch_model -v /home/jarvis/.apollo:/home/jarvis/.apollo -v /home/jarvis/coding/ApolloAuto/apollo:/apollo -v /dev:/dev -v /media:/media -v /tmp/.X11-unix:/tmp/.X11-unix:rw -v /etc/localtime:/etc/localtime:ro -v /usr/src:/usr/src -v /lib/modules:/lib/modules --net host -w /apollo --add-host in-dev-docker:127.0.0.1 --add-host jia:127.0.0.1 --hostname in-dev-docker --shm-size 2G --pid=host -v /dev/null:/dev/raw1394 apolloauto/apollo:dev-x86_64-18.04-20221124_1708 /bin/bash
9bca4c8730cb40457c964907f1230b5b649ef611d38e9e4ba0592c846bd2ab47
+ '[' 0 -ne 0 ']'
+ set +x
Adding group `jarvis' (GID 1000) ...
Done.
Adding user `jarvis' ...
Adding new user `jarvis' (1000) with group `jarvis' ...
adduser: Warning: The home directory `/home/jarvis' does not belong to the user you are currently creating.
The home directory `/home/jarvis' already exists.  Not copying from `/etc/skel'.
cp: -r not specified; omitting directory '/etc/skel/.'
cp: -r not specified; omitting directory '/etc/skel/..'
[ OK ] Congratulations! You have successfully finished setting up Apollo Dev Environment.
[ OK ] To login into the newly created apollo_dev_jarvis container, please run the following command:
[ OK ]   bash docker/scripts/dev_into.sh
[ OK ] Enjoy!
(base) jarvis@jia:~/coding/ApolloAuto/apollo$  bash docker/scripts/dev_into.sh
To run a command as administrator (user "root"), use "sudo <command>".
See "man sudo_root" for details.

[INFO] No rocm-smi found.
[INFO] NVIDIA GPU device found.
[jarvis@in-dev-docker:/apollo]$ bash scripts/bootstrap.sh
nohup: appending output to 'nohup.out'
[ OK ] Launched module monitor.
nohup: appending output to 'nohup.out'
[ OK ] Launched module dreamview.
Failed to start Dreamview. Please check /apollo/nohup.out or /apollo/data/core for more information
[jarvis@in-dev-docker:/apollo]$ nvidia-smi
Fri Jul 14 10:40:28 2023       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.199.02   Driver Version: 470.199.02   CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
| 30%   37C    P8     6W / 350W |      1MiB / 12045MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
[jarvis@in-dev-docker:/apollo]$ 
(base) jarvis@jia:~/coding/ApolloAuto/apollo$ id jarvis
uid=1000(jarvis) gid=1000(jarvis) groups=1000(jarvis),4(adm),24(cdrom),27(sudo),30(dip),46(plugdev),120(lpadmin),132(lxd),133(sambashare),998(docker)
(base) jarvis@jia:~/coding/ApolloAuto/apollo$ sudo docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.6.2-base-ubuntu20.04 nvidia-smi
Fri Jul 14 03:03:34 2023       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.199.02   Driver Version: 470.199.02   CUDA Version: 11.6     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
| 31%   37C    P8     7W / 350W |      1MiB / 12045MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
(base) jarvis@jia:~/coding/ApolloAuto/apollo$

To Reproduce Steps to reproduce the behavior:

  1. Go to 'cd path/to/apollo'
  2. bash docker/scripts/dev_start.sh

Desktop (please complete the following information):

yuanyuan-lalala commented 3 months ago

i have the same question.do you fix it?