remind101 / conveyor

A fast build system for Docker images.
http://engineering.remind.com/introducing-conveyor/
BSD 2-Clause "Simplified" License
221 stars 24 forks source link

Install latest version of docker. #18

Closed ejholmes closed 8 years ago

ejholmes commented 8 years ago

Old method started failing, this uses the new installation instructions from https://docs.docker.com/installation/ubuntulinux/

benguillet commented 8 years ago

:+1:

ejholmes commented 8 years ago

Upgrading to docker 1.8.3 seems to break builds:

# github.com SSH-2.0-libssh-0.7.0
Starting Docker...
ln: failed to create symbolic link '/sys/fs/cgroup/systemd/name=systemd': Operation not permitted
Stopping Docker...
phobologic commented 8 years ago

Note: You can specify a specific docker version with the new mirror as of a week or so ago.

Here's all the versions they support:

https://apt.dockerproject.org/repo/dists/ubuntu-trusty/main/binary-amd64/Packages

Here's an example of locking to a specific package version in ansible:

https://github.com/remind101/empire_ami/blob/master/ansible/roles/docker/tasks/main.yml#L41

ejholmes commented 8 years ago

Sweet. Added a commit that locks docker to 1.7.1. I'll test again and make sure there's no issues.

ejholmes commented 8 years ago

Seems like switching to the new docker build may have slowed down docker in docker.

ejholmes commented 8 years ago

Bunch of docker start timeouts after deploying this /cry.

ejholmes commented 8 years ago

Looks like this was probably caused because it switched from using aufs to devicemapper:

Before

$ docker info
Containers: 3
Images: 42
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 48
 Dirperm1 Supported: false
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.13.0-61-generic
Operating System: Ubuntu 14.04.2 LTS
CPUs: 4
Total Memory: 7.305 GiB
Name: ip-10-0-0-121
ID: 7HCU:7ECK:LZA5:JSML:7UV7:MN7N:2OES:LHS5:ZRCR:7NAV:564V:CU67
Username: conveyor
Registry: https://index.docker.io/v1/
WARNING: No swap limit support

After

$ docker info
Containers: 3
Images: 42
Storage Driver: devicemapper
 Pool Name: docker-202:112-6029313-pool
 Pool Blocksize: 65.54 kB
 Backing Filesystem: extfs
 Data file: /dev/loop0
 Metadata file: /dev/loop1
 Data Space Used: 1.587 GB
 Data Space Total: 107.4 GB
 Data Space Available: 103.9 GB
 Metadata Space Used: 2.568 MB
 Metadata Space Total: 2.147 GB
 Metadata Space Available: 2.145 GB
 Udev Sync Supported: true
 Deferred Removal Enabled: false
 Data loop file: /var/lib/docker/devicemapper/devicemapper/data
 Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata
 Library Version: 1.02.77 (2012-10-15)
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.13.0-49-generic
Operating System: Ubuntu 14.04.2 LTS
CPUs: 4
Total Memory: 7.305 GiB
Name: ip-10-0-0-152
ID: 5G5U:MJH3:JFKT:ZIZU:ZBE4:E7JI:TWLS:GA6R:REF5:7C3B:WHDC:4N3K
Username: conveyor
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
cordoval commented 8 years ago

i think we should lock to version 1.7.0 tbh cc @ejholmes for now before moving into the .dockercfg -> .docker/config.json, i am having a nightmare