linarnan commented 7 years ago

[x] This is a bug report
[ ] This is a feature request
[ ] I searched existing issues before opening this one

Behavior

I'm building vm image for openstack, I wanna pull some docker images during build image process. some how it can't start docker daemon during package installation.

so i just start daemon manually

here is my script:

cgroups-mount

/usr/bin/dockerd --dns 8.8.8.8 -H unix:///var/run/docker.sock --log-level debug &

docker pull docker.example.com/example/sdn-web:dev
docker pull docker.example.com/example/dhcp-server:dev

docker images

kill `cat /var/run/docker.pid`

looks like pull image correctly, but have some problem while register layer

Steps to reproduce the behavior

Output of docker version:

17.06.2~ce-0~ubuntu

Output of docker info:

Setting up docker-ce (17.06.2~ce-0~ubuntu) ...
runlevel:/var/run/utmp: No such file or directory
invoke-rc.d: policy-rc.d denied execution of start.
Setting up cgroup-lite (1.9) ...
invoke-rc.d: unknown initscript, /etc/init.d/cgroup-lite not found.
runlevel:/var/run/utmp: No such file or directory
invoke-rc.d: policy-rc.d denied execution of start.
Processing triggers for libc-bin (2.19-0ubuntu6.13) ...
Processing triggers for ureadahead (0.100.0-16) ...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 59997  100 59997    0     0   930k      0 --:--:-- --:--:-- --:--:--  945k
dib-run-parts Wed Sep  6 11:29:56 UTC 2017 50-install-additional-packages completed
dib-run-parts Wed Sep  6 11:29:56 UTC 2017 Running /tmp/in_target.d/install.d/51-docker-images
DEBU[0000] Listener created for HTTP on unix (/var/run/docker.sock) 
WARN[0000] libcontainerd: makeUpgradeProof could not open /var/run/docker/libcontainerd/containerd 
INFO[0000] libcontainerd: new containerd process, pid: 8514 
WARN[0000] containerd: low RLIMIT_NOFILE changing to max  current=1024 max=4096
DEBU[0000] libcontainerd: containerd health check returned error: rpc error: code = 14 desc = grpc: the connection is unavailable 
DEBU[0001] libcontainerd: containerd health check returned error: rpc error: code = 14 desc = grpc: the connection is unavailable 
WARN[0001] failed to rename /var/lib/docker/tmp for background deletion: rename /var/lib/docker/tmp /var/lib/docker/tmp-old: no such file or directory. Deleting synchronously 
DEBU[0001] Using default logging driver json-file       
DEBU[0001] Golang's threads limit set to 56250          
DEBU[0001] Using graph driver aufs                      
DEBU[0001] Max Concurrent Downloads: 3                  
DEBU[0001] Max Concurrent Uploads: 5                    
INFO[0001] Graph migration to content-addressability took 0.00 seconds 
WARN[0001] Your kernel does not support swap memory limit 
WARN[0001] Your kernel does not support cgroup rt period 
WARN[0001] Your kernel does not support cgroup rt runtime 
INFO[0001] Loading containers: start.                   
DEBU[0001] Option Experimental: false                   
DEBU[0001] Option DefaultDriver: bridge                 
DEBU[0001] Option DefaultNetwork: bridge                
WARN[0001] Running modprobe nf_nat failed with message: `modprobe: ERROR: ../libkmod/libkmod.c:556 kmod_search_moddep() could not open moddep file '/lib/modules/4.4.0-93-generic/modules.dep.bin'`, error: exit status 1 
WARN[0001] Running modprobe xt_conntrack failed with message: `modprobe: ERROR: ../libkmod/libkmod.c:556 kmod_search_moddep() could not open moddep file '/lib/modules/4.4.0-93-generic/modules.dep.bin'`, error: exit status 1 
DEBU[0001] Fail to initialize firewalld: Failed to connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory, using raw iptables instead 
DEBU[0001] /sbin/iptables, [--wait -t nat -D PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL ! --dst 127.0.0.0/8 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D PREROUTING] 
DEBU[0001] /sbin/iptables, [--wait -t nat -D OUTPUT]    
DEBU[0001] /sbin/iptables, [--wait -t nat -F DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t nat -X DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t filter -F DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -X DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t nat -n -L DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -N DOCKER]    
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -A DOCKER-ISOLATION -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
INFO[0001] Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address 
DEBU[0001] Allocating IPv4 pools for network bridge (ad7e70e3da28bdd4b27db9760b605220e5db6ef46ec8411e437605508c835e97) 
DEBU[0001] RequestPool(LocalDefault, 172.17.0.0/16, , map[], false) 
DEBU[0001] RequestAddress(LocalDefault/172.17.0.0/16, 172.17.0.1, map[RequestAddressType:com.docker.network.gateway]) 
DEBU[0001] /sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t nat -I DOCKER -i docker0 -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -i docker0 -o docker0 -j DROP] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -A PREROUTING -m addrtype --dst-type LOCAL -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[0001] /sbin/iptables, [--wait -t nat -A OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION] 
DEBU[0001] /sbin/iptables, [--wait -t filter -n -L DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C DOCKER-USER -j RETURN] 
DEBU[0001] /sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -D FORWARD -j DOCKER-USER] 
DEBU[0001] /sbin/iptables, [--wait -I FORWARD -j DOCKER-USER] 
INFO[0001] Loading containers: done.                    
INFO[0001] Daemon has completed initialization          
INFO[0001] Docker daemon                                 commit=cec0b72 graphdriver=aufs version=17.06.2-ce
DEBU[0001] Registering routers                          
DEBU[0001] Registering GET, /containers/{name:.*}/checkpoints 
DEBU[0001] Registering POST, /containers/{name:.*}/checkpoints 
DEBU[0001] Registering DELETE, /containers/{name}/checkpoints/{checkpoint} 
DEBU[0001] Registering HEAD, /containers/{name:.*}/archive 
DEBU[0001] Registering GET, /containers/json            
DEBU[0001] Registering GET, /containers/{name:.*}/export 
DEBU[0001] Registering GET, /containers/{name:.*}/changes 
DEBU[0001] Registering GET, /containers/{name:.*}/json  
DEBU[0001] Registering GET, /containers/{name:.*}/top   
DEBU[0001] Registering GET, /containers/{name:.*}/logs  
DEBU[0001] Registering GET, /containers/{name:.*}/stats 
DEBU[0001] Registering GET, /containers/{name:.*}/attach/ws 
DEBU[0001] Registering GET, /exec/{id:.*}/json          
DEBU[0001] Registering GET, /containers/{name:.*}/archive 
DEBU[0001] Registering POST, /containers/create         
DEBU[0001] Registering POST, /containers/{name:.*}/kill 
DEBU[0001] Registering POST, /containers/{name:.*}/pause 
DEBU[0001] Registering POST, /containers/{name:.*}/unpause 
DEBU[0001] Registering POST, /containers/{name:.*}/restart 
DEBU[0001] Registering POST, /containers/{name:.*}/start 
DEBU[0001] Registering POST, /containers/{name:.*}/stop 
DEBU[0001] Registering POST, /containers/{name:.*}/wait 
DEBU[0001] Registering POST, /containers/{name:.*}/resize 
DEBU[0001] Registering POST, /containers/{name:.*}/attach 
DEBU[0001] Registering POST, /containers/{name:.*}/copy 
DEBU[0001] Registering POST, /containers/{name:.*}/exec 
DEBU[0001] Registering POST, /exec/{name:.*}/start      
DEBU[0001] Registering POST, /exec/{name:.*}/resize     
DEBU[0001] Registering POST, /containers/{name:.*}/rename 
DEBU[0001] Registering POST, /containers/{name:.*}/update 
DEBU[0001] Registering POST, /containers/prune          
DEBU[0001] Registering PUT, /containers/{name:.*}/archive 
DEBU[0001] Registering DELETE, /containers/{name:.*}    
DEBU[0001] Registering GET, /images/json                
DEBU[0001] Registering GET, /images/search              
DEBU[0001] Registering GET, /images/get                 
DEBU[0001] Registering GET, /images/{name:.*}/get       
DEBU[0001] Registering GET, /images/{name:.*}/history   
DEBU[0001] Registering GET, /images/{name:.*}/json      
DEBU[0001] Registering POST, /commit                    
DEBU[0001] Registering POST, /images/load               
DEBU[0001] Registering POST, /images/create             
DEBU[0001] Registering POST, /images/{name:.*}/push     
DEBU[0001] Registering POST, /images/{name:.*}/tag      
DEBU[0001] Registering POST, /images/prune              
DEBU[0001] Registering DELETE, /images/{name:.*}        
DEBU[0001] Registering OPTIONS, /{anyroute:.*}          
DEBU[0001] Registering GET, /_ping                      
DEBU[0001] Registering GET, /events                     
DEBU[0001] Registering GET, /info                       
DEBU[0001] Registering GET, /version                    
DEBU[0001] Registering GET, /system/df                  
DEBU[0001] Registering POST, /auth                      
DEBU[0001] Registering GET, /volumes                    
DEBU[0001] Registering GET, /volumes/{name:.*}          
DEBU[0001] Registering POST, /volumes/create            
DEBU[0001] Registering POST, /volumes/prune             
DEBU[0001] Registering DELETE, /volumes/{name:.*}       
DEBU[0001] Registering POST, /build                     
DEBU[0001] Registering POST, /swarm/init                
DEBU[0001] Registering POST, /swarm/join                
DEBU[0001] Registering POST, /swarm/leave               
DEBU[0001] Registering GET, /swarm                      
DEBU[0001] Registering GET, /swarm/unlockkey            
DEBU[0001] Registering POST, /swarm/update              
DEBU[0001] Registering POST, /swarm/unlock              
DEBU[0001] Registering GET, /services                   
DEBU[0001] Registering GET, /services/{id}              
DEBU[0001] Registering POST, /services/create           
DEBU[0001] Registering POST, /services/{id}/update      
DEBU[0001] Registering DELETE, /services/{id}           
DEBU[0001] Registering GET, /services/{id}/logs         
DEBU[0001] Registering GET, /nodes                      
DEBU[0001] Registering GET, /nodes/{id}                 
DEBU[0001] Registering DELETE, /nodes/{id}              
DEBU[0001] Registering POST, /nodes/{id}/update         
DEBU[0001] Registering GET, /tasks                      
DEBU[0001] Registering GET, /tasks/{id}                 
DEBU[0001] Registering GET, /tasks/{id}/logs            
DEBU[0001] Registering GET, /secrets                    
DEBU[0001] Registering POST, /secrets/create            
DEBU[0001] Registering DELETE, /secrets/{id}            
DEBU[0001] Registering GET, /secrets/{id}               
DEBU[0001] Registering POST, /secrets/{id}/update       
DEBU[0001] Registering GET, /configs                    
DEBU[0001] Registering POST, /configs/create            
DEBU[0001] Registering DELETE, /configs/{id}            
DEBU[0001] Registering GET, /configs/{id}               
DEBU[0001] Registering POST, /configs/{id}/update       
DEBU[0001] Registering GET, /plugins                    
DEBU[0001] Registering GET, /plugins/{name:.*}/json     
DEBU[0001] Registering GET, /plugins/privileges         
DEBU[0001] Registering DELETE, /plugins/{name:.*}       
DEBU[0001] Registering POST, /plugins/{name:.*}/enable  
DEBU[0001] Registering POST, /plugins/{name:.*}/disable 
DEBU[0001] Registering POST, /plugins/pull              
DEBU[0001] Registering POST, /plugins/{name:.*}/push    
DEBU[0001] Registering POST, /plugins/{name:.*}/upgrade 
DEBU[0001] Registering POST, /plugins/{name:.*}/set     
DEBU[0001] Registering POST, /plugins/create            
DEBU[0001] Registering GET, /distribution/{name:.*}/json 
DEBU[0001] Registering GET, /networks                   
DEBU[0001] Registering GET, /networks/                  
DEBU[0001] Registering GET, /networks/{id:.+}           
DEBU[0001] Registering POST, /networks/create           
DEBU[0001] Registering POST, /networks/{id:.*}/connect  
DEBU[0001] Registering POST, /networks/{id:.*}/disconnect 
DEBU[0001] Registering POST, /networks/prune            
DEBU[0001] Registering DELETE, /networks/{id:.*}        
INFO[0001] API listen on /var/run/docker.sock           
DEBU[0003] Calling GET /_ping                           
DEBU[0003] Calling POST /v1.30/images/create?fromImage=docker.example.com%2Fexample%2Fsdn-web&tag=dev 
DEBU[0003] hostDir: /etc/docker/certs.d/docker.example.com 
DEBU[0003] Trying to pull docker.example.com/example/sdn-web from https://docker.example.com v2 
DEBU[0003] Pulling ref from V2 registry: docker.example.com/example/sdn-web:dev 
DEBU[0003] pulling blob "sha256:9dca49a3b1201458a6f853fb6798684b061437163f0bb96fd021ede26e0dd145" 
DEBU[0003] pulling blob "sha256:88286f41530e93dffd4b964e1db22ce4939fffa4a4c665dab8591fbab03d4926" 
DEBU[0003] pulling blob "sha256:cf196aa71150120c980916e82a912b929a5caa7dcfef909aa67a2f086d35942e" 
dev: Pulling from  #example/sdn-web
88286f41530e: Downloading [>                                                  ]  32.25kB/1.99MB
9dca49a3b120: Pulling fs layer 
cf196aa71150: Pulling fs layer 
9dca49a3b120: Download complete 
88286f41530e: Extracting [==================================================>]   1.99MB/1.99MB
a2b5f806716a: Waiting 
cf196aa71150: Downloading [==========>                                        ]  6.553MB/31.32MB
f3004e331b8c: Downloading [>                                                  ]  48.63kB/4.335MB
cf196aa71150: Downloading [==================>                                ]  11.47MB/31.32MB
f3004e331b8c: Downloading [=======================>                           ]  2.064MB/4.335MB
a638c359d6fc: Downloading [===============>                                   ]  3.932MB/12.41MB
cf196aa71150: Downloading [============================>                      ]  18.02MB/31.32MB
cf196aa71150: Downloading [===============================================>   ]  29.49MB/31.32MB
cf196aa71150: Download complete 
a638c359d6fc: Download complete 
DEBU[0003] Downloaded a638c359d6fc to tempfile /var/lib/docker/tmp/GetImageBlob215982109 
DEBU[0003] Downloaded cf196aa71150 to tempfile /var/lib/docker/tmp/GetImageBlob103352691 
INFO[0003] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument 
failed to register layer: Error processing tar file(exit status 1): invalid argument
DEBU[0003] Calling GET /_ping                           
DEBU[0003] Calling POST /v1.30/images/create?fromImage=docker.example.com%2Fexample%2Fdhcp-server&tag=dev 
DEBU[0003] hostDir: /etc/docker/certs.d/docker.example.com 
DEBU[0003] Trying to pull docker.example.com/example/dhcp-server from https://docker.example.com v2 
DEBU[0003] Pulling ref from V2 registry: docker.example.com/example/dhcp-server:dev 
DEBU[0003] pulling blob "sha256:f25e451100bc39f358a4934ccbc004b987992c426857086f61499ee726f7e845" 
DEBU[0003] pulling blob "sha256:2dbe4abf311d67ec224f926d4b21b9be6f96dfba9be139e6936156a67b75a1ad" 
DEBU[0003] pulling blob "sha256:7ae2bc99836a3d8b74c62d43d8294da509c895b2d7f409c3be0b23a3a1ecb6ec" 
dev: Pulling from example/dhcp-server
f25e451100bc: Pulling fs layer 
2dbe4abf311d: Downloading [==>                                                ]  3.577kB/71.48kB
2dbe4abf311d: Download complete 
2dbe4abf311d: Downloading [==================================================>]  71.48kB/71.48kB
57c2f519b1e5: Waiting 
f25e451100bc: Downloading [>                                                  ]  540.1kB/65.79MB
cd04ee32e601: Waiting 
218f6d046559: Waiting 
a3ed95caeb02: Download complete 
57c2f519b1e5: Downloading [>                                                  ]  540.1kB/118.5MB
DEBU[0003] Downloaded 7ae2bc99836a to tempfile /var/lib/docker/tmp/GetImageBlob653997452 
f25e451100bc: Downloading [===============================================>   ]  62.18MB/65.79MB
f25e451100bc: Extracting [=========>                                         ]  12.26MB/65.79MB
f25e451100bc: Extracting [==================================================>]  65.79MB/65.79MB
DEBU[0003] Downloaded 3c2cd0026e1f to tempfile /var/lib/docker/tmp/GetImageBlob718051173 
57c2f519b1e5: Downloading [===================>                               ]  45.42MB/118.5MB
57c2f519b1e5: Downloading [==============================================>    ]  110.3MB/118.5MB
57c2f519b1e5: Download complete 
218f6d046559: Downloading [==================================================>]     281B/281B
049bc9893912: Download complete 
DEBU[0004] Downloaded f25e451100bc to tempfile /var/lib/docker/tmp/GetImageBlob815346634 
DEBU[0005] Downloaded 57c2f519b1e5 to tempfile /var/lib/docker/tmp/GetImageBlob201051806 
DEBU[0007] Cleaning up layer fb7164d9df1c7cdb94d85cd570b96cb64c3f5aebd93dcf4ede0bfa02b3404ef1: Error processing tar file(exit statcd04ee32e601: Download complete 
INFO[0007] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument 
failed to register layer: Error processing tar file(exit status 1): invalid argument
DEBU[0007] Calling GET /_ping                           
DEBU[0007] Calling GET /v1.30/images/json               
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
INFO[0007] Processing signal 'terminated'               
DEBU[0007] start clean shutdown of all containers with a 15 seconds timeout... 
DEBU[0007] Cleaning up old mountid : start.             
DEBU[0007] Unix socket /run/docker/libnetwork/a1398bd73097fa4fda6f1a99f0b52245dec253ccc580ef7aaba9668fdf225f57.sock doesn't exist. cannot accept client connections 
DEBU[0007] Cleaning up old mountid : done.              
DEBU[0007] Clean shutdown succeeded                     
INFO[0007] stopping containerd after receiving terminated 
DEBU[0008] libcontainerd: containerd health check returned error: rpc error: code = 9 desc = grpc: the client connection is closing

Additional environment details (AWS, VirtualBox, physical, etc.) vm disk image building process (use https://docs.openstack.org/diskimage-builder/latest/index.html)

linarnan commented 7 years ago

same as this issue i'm in uncompatiable Backing filesystem : tmpfs

Containers: 0
 Running: 0
 Paused: 0
 Stopped: 0
Images: 0
Server Version: 17.06.2-ce
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: tmpfs
 Dirs: 0
 Dirperm1 Supported: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins: 
 Volume: local
 Network: bridge host macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 6e23458c129b551d5c9871e5174f6b1b7f6d1170
runc version: 810190ceaa507aa2727d7ae6f4790c76ec150bd2
init version: 949e6fa
Kernel Version: 4.4.0-93-generic
Operating System: Ubuntu 14.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 7.677GiB
Name: linarnan-ubuntu
ID: XLPG:RGIB:UTIS:I44Q:AO4A:4NZJ:4VQL:SXK3:54B2:OQCQ:V62F:URNR
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

just close this.

linarnan commented 7 years ago

after given image-disk-create --no-tmpfs ... able to use backing filesystem with ext4 but still have same problem here

linarnan commented 7 years ago

build cmd: disk-image-create -a amd64 --no-tmpfs --install-type package --image-size 5G -o ubuntu-${DIB_RELEASE}.qcow2 ubuntu bootloader devuser local-config openssh-server cleanup-kernel-initrd cloud-init-datasources

pillarlei commented 6 years ago

I have the same

pillarlei@DESKTOP-V3N3P9H:~$ sudo docker pull redis Using default tag: latest latest: Pulling from library/redis be8881be8156: Extracting [==================================================>] 22.49MB/22.49MB d6f5ea773ca3: Download complete 735cc65c0db4: Download complete ff89c30e4d8c: Download complete 59bf782a86b3: Download complete ce8aaa9fe90a: Download complete failed to register layer: Error processing tar file(exit status 1): invalid argument

pillarlei@DESKTOP-V3N3P9H:~$ docker info Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 0 Server Version: 18.06.0-ce Storage Driver: overlay2 Backing Filesystem: Supports d_type: true Native Overlay Diff: true Logging Driver: json-file Cgroup Driver: cgroupfs Plugins: Volume: local Network: bridge host macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog Swarm: inactive Runtimes: runc Default Runtime: runc Init Binary: docker-init containerd version: d64c661f1d51c48782c9cec8fda7604785f93587 runc version: 69663f0bd4b60df09991c08812a60108003fa340 init version: fec3683 Kernel Version: 4.4.0-17134-Microsoft Operating System: Ubuntu 18.04 LTS OSType: linux Architecture: x86_64 CPUs: 8 Total Memory: 15.89GiB Name: DESKTOP-V3N3P9H ID: 3H42:T2GW:QWLI:AMZW:YKTH:3QCI:H5IL:SWYC:G337:PO2F:SIZQ:4CYI Docker Root Dir: /var/lib/docker Debug Mode (client): false Debug Mode (server): false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

WARNING: No memory limit support WARNING: No swap limit support WARNING: No kernel memory limit support WARNING: No oom kill disable support WARNING: No cpu cfs quota support WARNING: No cpu cfs period support WARNING: No cpu shares support WARNING: No cpuset support

how can I deal with it.

linarnan commented 6 years ago

another same post here: https://github.com/moby/moby/issues/34817 , maybe u can found solution there. (i haven't found solution yet) are you in some chroot/ vm env. ?

hitendra26 commented 5 years ago

I have same issue. However, I am in chroot environment. Wondering if it's possible to make docker work in such environment.

./docker info

DEBU[2019-05-27T14:15:14.212268660Z] Calling GET /_ping DEBU[2019-05-27T14:15:14.213233780Z] Calling GET /v1.39/info WARN[2019-05-27T14:15:14.214784160Z] Could not get operating system name: Error opening /usr/lib/os-release: open /usr/lib/os-release: no such file or directory Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 0 Server Version: 18.09.4 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Native Overlay Diff: true Logging Driver: json-file Cgroup Driver: cgroupfs Plugins: Volume: local Network: bridge host macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc Default Runtime: runc Init Binary: docker-init containerd version: bb71b10fd8f58240ca47fbb579b9d1028eea7c84 runc version: 2b18fe1d885ee5083ef9f0838fee39b62d653e30 init version: fec3683 Kernel Version: 4.1.51-ws-symbol OSType: linux Architecture: aarch64 CPUs: 2 Total Memory: 870.7MiB Name: (none) ID: AWJE:2XHF:F6IX:AFBY:RKSO:ZAD5:QORR:OWBG:RXWM:UHBC:24JT:PT55 Docker Root Dir: /mnt/usb/docker Debug Mode (client): false Debug Mode (server): false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

WARNING: No cpu cfs quota support WARNING: No cpu cfs period support # #

./docker run hello-world

DEBU[2019-05-27T13:59:01.403488020Z] Calling GET /_ping DEBU[2019-05-27T13:59:01.406786120Z] Calling POST /v1.39/containers/create DEBU[2019-05-27T13:59:01.407900660Z] form data: {"AttachStderr":true,"AttachStdin":false,"AttachStdout":true,"Cmd":null,"Domainname":"","Entrypoint":null,"Env":[],"HostConfig":{"AutoRemove":false,"Binds":null,"BlkioDeviceReadBps":null,"BlkioDeviceReadIOps":null,"BlkioDeviceWriteBps":null,"BlkioDeviceWriteIOps":null,"BlkioWeight":0,"BlkioWeightDevice":[],"CapAdd":null,"CapDrop":null,"Cgroup":"","CgroupParent":"","ConsoleSize":[0,0],"ContainerIDFile":"","CpuCount":0,"CpuPercent":0,"CpuPeriod":0,"CpuQuota":0,"CpuRealtimePeriod":0,"CpuRealtimeRuntime":0,"CpuShares":0,"CpusetCpus":"","CpusetMems":"","DeviceCgroupRules":null,"Devices":[],"DiskQuota":0,"Dns":[],"DnsOptions":[],"DnsSearch":[],"ExtraHosts":null,"GroupAdd":null,"IOMaximumBandwidth":0,"IOMaximumIOps":0,"IpcMode":"","Isolation":"","KernelMemory":0,"Links":null,"LogConfig":{"Config":{},"Type":""},"MaskedPaths":null,"Memory":0,"MemoryReservation":0,"MemorySwap":0,"MemorySwappiness":-1,"NanoCpus":0,"NetworkMode":"default","OomKillDisable":false,"OomScoreAdj":0,"PidMode":"","PidsLimit":0,"PortBindings":{},"Privileged":false,"PublishAllPorts":false,"ReadonlyPaths":null,"ReadonlyRootfs":false,"RestartPolicy":{"MaximumRetryCount":0,"Name":"no"},"SecurityOpt":null,"ShmSize":0,"UTSMode":"","Ulimits":null,"UsernsMode":"","VolumeDriver":"","VolumesFrom":null},"Hostname":"","Image":"hello-world","Labels":{},"NetworkingConfig":{"EndpointsConfig":{}},"OnBuild":null,"OpenStdin":false,"StdinOnce":false,"Tty":false,"User":"","Volumes":{},"WorkingDir":""} Unable to find image 'hello-world:latest' locally DEBU[2019-05-27T13:59:01.413317800Z] Calling GET /v1.39/info WARN[2019-05-27T13:59:01.414791760Z] Could not get operating system name: Error opening /usr/lib/os-release: open /usr/lib/os-release: no such file or directory DEBU[2019-05-27T13:59:01.438037600Z] Calling POST /v1.39/images/create?fromImage=hello-world&tag=latest DEBU[2019-05-27T13:59:01.438664080Z] Trying to pull hello-world from https://registry-1.docker.io v2 DEBU[2019-05-27T13:59:02.340561960Z] Pulling ref from V2 registry: hello-world:latest DEBU[2019-05-27T13:59:02.340799640Z] docker.io/library/hello-world:latest resolved to a manifestList object with 9 entries; looking for a unknown/arm match DEBU[2019-05-27T13:59:02.340851620Z] found deprecated partial match for linux/arm/v8 with media type application/vnd.docker.distribution.manifest.v2+json, digest sha256:1e44d8bca6fb0464794555e5ccd3a32e2a4f6e44a20605e4e82605189904f44d DEBU[2019-05-27T13:59:02.340898100Z] found deprecated partial match for linux/arm/v8 with media type application/vnd.docker.distribution.manifest.v2+json, digest sha256:d1fd2e204af0a2bca3ab033b417b29c76d7950ed29a44e427d1c4d07d14f04f9 DEBU[2019-05-27T13:59:02.340938600Z] found multiple matches in manifest list, choosing best match sha256:1e44d8bca6fb0464794555e5ccd3a32e2a4f6e44a20605e4e82605189904f44d latest: Pulling from library/hello-world DEBU[2019-05-27T13:59:02.498004860Z] pulling blob "sha256:590e13f69e4afcc08e9060a320ec5e4622d2771ace9dc26b024dc786fcb5b36e" 590e13f69e4a: Downloading 1.027kB/1.027kB 590e13f69e4a: Extracting 1.027kB/1.027kB 590e13f69e4a: Extracting 1.027kB/1.027kB DEBU[2019-05-27T13:59:03.433254360Z] Cleaning up layer 22e8d4d817b6220a7884a028ba7b1e52b09f83b760a34acc3b9ffaf07f1f4cc4: Error processing tar file(exit status 1): invalid argument INFO[2019-05-27T13:59:03.434607560Z] Attempting next endpoint for pull after error: failed to register layer: Error processing tar file(exit status 1): invalid argument ./docker: failed to register layer: Error processing tar file(exit status 1): invalid argument. See './docker run --help'. #

mike-bioinfo commented 3 years ago

I solved this problem reading this info:

https://docs.docker.com/engine/security/rootless/#docker-pull-errors

I figured it out reading this link:

https://docs.oracle.com/cd/E37670_01/E75728/html/ol-docker-userns-remap.html

And increasing those value contained in those files (/etc/subuid and /etc/subgid) and reboot (not mentioned) as this link recommended:

https://ubuntu.com/blog/custom-user-mappings-in-lxd-containers

The only thing that I noticed is that my path to the storage disk was renamed from "DATA" to "DATA1" and I don't know why this happened. DATA is innaccesible from terminal with the typical "permission denied" message and from GUI file browser it appeared as always "DATA". But hey, I finally was able to pull the image that I wanted and I can continue with my life happily ever after. :D!

UPDATE: I had to change back those values for /etc/subuid and /etc/subgid since my storage disk (ntfs filesystem) was changing names every time I rebooted. It looks like that strange behavior is because ntfs is not supported to do this kind of things, a solution was change back default parameter in /etc/docker/daemon.json file, run docker pull "image", then move all folders from /var/lib/docker/ to the new location (ntfs disk) following these instructions

https://www.guguweb.com/2019/02/07/how-to-move-docker-data-directory-to-another-location-on-ubuntu/

I had to move it to another location because my ssd is very small and those images are quite big to be stored in my ssd.

I hope this could help you guys.

kexul commented 1 year ago

@mike-bioinfo try this one, https://pdiway.com/articles/how-to-move-docker-data-directory/, it solved my issue with ntfs.

docker / for-linux

docker pull fail with failed to register layer: Error processing tar file(exit status 1): invalid argument #97

Behavior

Steps to reproduce the behavior

./docker info

./docker run hello-world