search

jhorey / ferry

Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker
http://ferry.opencore.io
Apache License 2.0
252 stars 25 forks source link

ferry-dust install errors (running behind a proxy) #26

Open josephwinston opened 9 years ago

josephwinston commented 9 years ago

Vagrant version:

~/work/VAGRANT/Proxy/Ferry vagrant --version
Vagrant 1.6.5

Virtual box version:

~/work/VAGRANT/Proxy/Ferry vboxmanage --version
4.3.16r95972

OS version:

vagrant@vagrant-ubuntu-trusty-64:~$ lsb_release  -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 14.04.1 LTS
Release:        14.04
Codename:       trusty

docker version:

vagrant@vagrant-ubuntu-trusty-64:~$ docker --version
Docker version 1.0.1, build 990021a

python version:

vagrant@vagrant-ubuntu-trusty-64:~$ python --version
Python 2.7.6

An aside for others installing through a proxy: If you see pip errors after running $ sudo pip install -U ferry, see https://github.com/pypa/pip/issues/1805. One workaround is to:

$ git clone https://github.com/ctxis/pip.git
$ cd pip
$ sudo python setup.py install

running:

vagrant@vagrant-ubuntu-trusty-64:~$ ferry-dust install
Error: No such image or container: ferry/ferry-server
pulling the ferry image
Pulling repository ferry/ferry-server
4498499b4e65: Pulling dependent layers
4498499b4e65: Download complete
249a44f2f965: Download complete
511136ea3c5a: Download complete
5e66087f3ffe: Download complete
4d26dd3ebc1c: Download complete
d4010efcfd86: Download complete
99ec81b80c55: Download complete
3bfcd6184e6c: Download complete
fcadef5d73c3: Download complete
4ebaec4748e1: Download complete
077fd1caf696: Download complete
c45967030e32: Download complete
888f62d73c9d: Download complete
d63d7f192762: Download complete
1e7811cc4fca: Download complete
22ff4d9f52c1: Download complete
b18d0a2076a1: Download complete
1c7f181e78b9: Download complete
9f676bd305a4: Download complete
67b66f26d423: Download complete
6030677eb5d2: Download complete
25c4824a5268: Download complete
90177ae68092: Download complete
8b1c48305638: Download complete
3f2d795e3309: Download complete
c900195dcbf3: Download complete
6b4e8a7373fe: Download complete
f8a57046c3fc: Download complete
20af62704915: Download complete
db4fe0f2d561: Download complete
c2c0da7cede7: Download complete
4ca1aa06d7c7: Download complete
07740b15b3fd: Download complete
1a1d7ef08dcc: Download complete
6753e3778944: Download complete
cc400379cb68: Download complete
67a2a12aa03f: Download complete
af09a11cf5d4: Download complete
798a83a04a19: Download complete
943a7afc77c7: Download complete
de95eeb92afc: Download complete
ab04cc56c1b2: Download complete
25098d3c6c7a: Download complete
7533a39e7d69: Download complete
24494120dbe9: Download complete
67e689edc7a6: Download complete
9d8ebd110cd4: Download complete
1f7dd8a6fafc: Download complete
e482b718265f: Download complete
5cba33de10c6: Download complete
64e27cc09237: Download complete
starting ferry, using /opt/ferry to save state
2014/10/14 12:21:53 Error response from daemon: No such id: ferry/ferry-base:0.3.3.3
2014/10/14 12:24:01 Error response from daemon: No such id: ferry/cassandra:0.3.3.3
2014/10/14 12:26:08 Error response from daemon: No such id: ferry/titan:0.3.3.3
2014/10/14 12:28:16 Error response from daemon: No such id: ferry/cassandra-client:0.3.3.3
2014/10/14 12:30:23 Error response from daemon: No such id: ferry/gluster:0.3.3.3
2014/10/14 12:32:31 Error response from daemon: No such id: ferry/openmpi:0.3.3.3
2014/10/14 12:34:38 Error response from daemon: No such id: ferry/openmpi-client:0.3.3.3
2014/10/14 12:36:46 Error response from daemon: No such id: ferry/hadoop-base:0.3.3.3
2014/10/14 12:38:53 Error response from daemon: No such id: ferry/hadoop-client:0.3.3.3
2014/10/14 12:41:00 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3
2014/10/14 12:41:00 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3
2014/10/14 12:41:01 Error response from daemon: No such id: ferry/hive-metastore:latest
2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:0.3.3.3
2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:0.3.3.3
2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:latest
2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:0.3.3.3
2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:0.3.3.3
2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:latest
2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:0.3.3.3
2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:0.3.3.3
2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:latest
[10/14/2014 12:17:34] [WARNING] all prerequisites met...
[10/14/2014 12:17:34] [WARNING] Creating Ferry bridge 172.18.42.1/16
[10/14/2014 12:17:34] [WARNING] checking for btrfs
[10/14/2014 12:17:34] [WARNING] using devmapper backend
[10/14/2014 12:17:34] [WARNING] using public dns
[10/14/2014 12:17:34] [WARNING] nohup docker -d -H=unix:////var/run/ferry.sock -g=/var/lib/ferry -p=/var/run/ferry.pid -b ferry0 --dns 8.8.8.8 --dns 8.8.4.4 -e lxc -s devicemapper --icc=true 1>/var/lib/ferry/docker.log  2>&1 &
[10/14/2014 12:17:38] [WARNING] performing select rebuild (['cassandra-client', 'openmpi', 'ferry-base', 'openmpi-client', 'hadoop-client', 'hive-metastore', 'hive', 'mongodb', 'mongodb-client', 'titan', 'cassandra', 'spark', 'spark-client', 'hadoop', 'yarn', 'hadoop-base', 'gluster'])
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] transforming dockerfile
[10/14/2014 12:17:38] [WARNING] building image cassandra-client
[10/14/2014 12:17:38] [WARNING] docker -H=unix:////var/run/ferry.sock pull ubuntu:14.04
Pulling repository ubuntu
[10/14/2014 12:19:46] [WARNING] 2014/10/14 12:19:46 Get https://index.docker.io/v1/repositories/ubuntu/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:19:46] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/ferry-base:0.3.3.3
Pulling repository ferry/ferry-base
[10/14/2014 12:21:53] [WARNING] 2014/10/14 12:21:53 Get https://index.docker.io/v1/repositories/ferry/ferry-base/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:21:53] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/ferry-base:0.3.3.3 ferry/ferry-base:latest
[10/14/2014 12:21:53] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra:0.3.3.3
Pulling repository ferry/cassandra
[10/14/2014 12:24:00] [WARNING] 2014/10/14 12:24:00 Get https://index.docker.io/v1/repositories/ferry/cassandra/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:24:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra:0.3.3.3 ferry/cassandra:latest
[10/14/2014 12:24:00] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/titan:0.3.3.3
Pulling repository ferry/titan
[10/14/2014 12:26:08] [WARNING] 2014/10/14 12:26:08 Get https://index.docker.io/v1/repositories/ferry/titan/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:26:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/titan:0.3.3.3 ferry/titan:latest
[10/14/2014 12:26:08] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra-client:0.3.3.3
Pulling repository ferry/cassandra-client
[10/14/2014 12:28:15] [WARNING] 2014/10/14 12:28:15 Get https://index.docker.io/v1/repositories/ferry/cassandra-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:28:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra-client:0.3.3.3 ferry/cassandra-client:latest
[10/14/2014 12:28:15] [WARNING] building image openmpi
[10/14/2014 12:28:15] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/gluster:0.3.3.3
Pulling repository ferry/gluster
[10/14/2014 12:30:23] [WARNING] 2014/10/14 12:30:23 Get https://index.docker.io/v1/repositories/ferry/gluster/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:30:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/gluster:0.3.3.3 ferry/gluster:latest
[10/14/2014 12:30:23] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi:0.3.3.3
Pulling repository ferry/openmpi
[10/14/2014 12:32:30] [WARNING] 2014/10/14 12:32:30 Get https://index.docker.io/v1/repositories/ferry/openmpi/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:32:30] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi:0.3.3.3 ferry/openmpi:latest
[10/14/2014 12:32:30] [WARNING] building image ferry-base
[10/14/2014 12:32:30] [WARNING] building image openmpi-client
[10/14/2014 12:32:30] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi-client:0.3.3.3
Pulling repository ferry/openmpi-client
[10/14/2014 12:34:38] [WARNING] 2014/10/14 12:34:38 Get https://index.docker.io/v1/repositories/ferry/openmpi-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:34:38] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi-client:0.3.3.3 ferry/openmpi-client:latest
[10/14/2014 12:34:38] [WARNING] building image hadoop-client
[10/14/2014 12:34:38] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-base:0.3.3.3
Pulling repository ferry/hadoop-base
[10/14/2014 12:36:45] [WARNING] 2014/10/14 12:36:45 Get https://index.docker.io/v1/repositories/ferry/hadoop-base/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:36:45] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-base:0.3.3.3 ferry/hadoop-base:latest
[10/14/2014 12:36:45] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-client:0.3.3.3
Pulling repository ferry/hadoop-client
[10/14/2014 12:38:53] [WARNING] 2014/10/14 12:38:53 Get https://index.docker.io/v1/repositories/ferry/hadoop-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:38:53] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-client:0.3.3.3 ferry/hadoop-client:latest
[10/14/2014 12:38:53] [WARNING] building image hive-metastore
[10/14/2014 12:38:53] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hive-metastore:0.3.3.3
Pulling repository ferry/hive-metastore
[10/14/2014 12:41:00] [WARNING] 2014/10/14 12:41:00 Get https://index.docker.io/v1/repositories/ferry/hive-metastore/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive-metastore:latest
[10/14/2014 12:41:00] [WARNING] tagging images hive-metastore
[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive:0.3.3.3
[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:latest ferry/hive:latest
[10/14/2014 12:41:00] [WARNING] building image mongodb
[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/mongodb:0.3.3.3
Pulling repository ferry/mongodb
[10/14/2014 12:43:08] [WARNING] 2014/10/14 12:43:08 Get https://index.docker.io/v1/repositories/ferry/mongodb/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb:latest
[10/14/2014 12:43:08] [WARNING] tagging images mongodb
[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb-client:0.3.3.3
[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:latest ferry/mongodb-client:latest
[10/14/2014 12:43:08] [WARNING] building image titan
[10/14/2014 12:43:08] [WARNING] building image cassandra
[10/14/2014 12:43:08] [WARNING] building image spark
[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/spark:0.3.3.3
Pulling repository ferry/spark
[10/14/2014 12:45:15] [WARNING] 2014/10/14 12:45:15 Get https://index.docker.io/v1/repositories/ferry/spark/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark:latest
[10/14/2014 12:45:15] [WARNING] tagging images spark
[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark-client:0.3.3.3
[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:latest ferry/spark-client:latest
[10/14/2014 12:45:15] [WARNING] building image hadoop
[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop:0.3.3.3
Pulling repository ferry/hadoop
[10/14/2014 12:47:23] [WARNING] 2014/10/14 12:47:23 Get https://index.docker.io/v1/repositories/ferry/hadoop/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/hadoop:latest
[10/14/2014 12:47:23] [WARNING] tagging images hadoop
[10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/yarn:0.3.3.3
[10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:latest ferry/yarn:latest
[10/14/2014 12:47:23] [WARNING] building image hadoop-base
[10/14/2014 12:47:23] [WARNING] building image gluster
[10/14/2014 12:47:23] [ERROR] images not built: ['mongodb', 'ferry-base', 'hadoop-base', 'hadoop', 'hadoop-client', 'hive-metastore', 'gluster', 'openmpi', 'openmpi-client', 'cassandra', 'cassandra-client', 'titan', 'spark']
[10/14/2014 12:47:23] [WARNING] stopping docker daemon
Some images were not installed. Please type 'ferry install' again.
jhorey commented 9 years ago

It looks like the Docker registry was not available during that time. Could you do the following for me?

  1. Install Docker version >= 1.2.0
  2. Retry ferry-dust install

Thanks! --James

On Tue, Oct 14, 2014 at 8:49 AM, Joseph Winston notifications@github.com wrote:

Vagrant version:

~/work/VAGRANT/Proxy/Ferry vagrant --version Vagrant 1.6.5

Virtual box version:

~/work/VAGRANT/Proxy/Ferry vboxmanage --version 4.3.16r95972

OS version:

vagrant@vagrant-ubuntu-trusty-64:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 14.04.1 LTS Release: 14.04 Codename: trusty

docker version:

vagrant@vagrant-ubuntu-trusty-64:~$ docker --version Docker version 1.0.1, build 990021a

python version:

vagrant@vagrant-ubuntu-trusty-64:~$ python --version Python 2.7.6

An aside for others installing through a proxy: If you see pip errors after running $ sudo pip install -U ferry, see pypa/pip#1805 https://github.com/pypa/pip/issues/1805. One workaround is to:

$ git clone https://github.com/ctxis/pip.git$ cd pip$ sudo python setup.py install

running:

vagrant@vagrant-ubuntu-trusty-64:~$ ferry-dust install Error: No such image or container: ferry/ferry-server pulling the ferry image Pulling repository ferry/ferry-server 4498499b4e65: Pulling dependent layers 4498499b4e65: Download complete 249a44f2f965: Download complete 511136ea3c5a: Download complete 5e66087f3ffe: Download complete 4d26dd3ebc1c: Download complete d4010efcfd86: Download complete 99ec81b80c55: Download complete 3bfcd6184e6c: Download complete fcadef5d73c3: Download complete 4ebaec4748e1: Download complete 077fd1caf696: Download complete c45967030e32: Download complete 888f62d73c9d: Download complete d63d7f192762: Download complete 1e7811cc4fca: Download complete 22ff4d9f52c1: Download complete b18d0a2076a1: Download complete 1c7f181e78b9: Download complete 9f676bd305a4: Download complete 67b66f26d423: Download complete 6030677eb5d2: Download complete 25c4824a5268: Download complete 90177ae68092: Download complete 8b1c48305638: Download complete 3f2d795e3309: Download complete c900195dcbf3: Download complete 6b4e8a7373fe: Download complete f8a57046c3fc: Download complete 20af62704915: Download complete db4fe0f2d561: Download complete c2c0da7cede7: Download complete 4ca1aa06d7c7: Download complete 07740b15b3fd: Download complete 1a1d7ef08dcc: Download complete 6753e3778944: Download complete cc400379cb68: Download complete 67a2a12aa03f: Download complete af09a11cf5d4: Download complete 798a83a04a19: Download complete 943a7afc77c7: Download complete de95eeb92afc: Download complete ab04cc56c1b2: Download complete 25098d3c6c7a: Download complete 7533a39e7d69: Download complete 24494120dbe9: Download complete 67e689edc7a6: Download complete 9d8ebd110cd4: Download complete 1f7dd8a6fafc: Download complete e482b718265f: Download complete 5cba33de10c6: Download complete 64e27cc09237: Download complete starting ferry, using /opt/ferry to save state 2014/10/14 12:21:53 Error response from daemon: No such id: ferry/ferry-base:0.3.3.3 2014/10/14 12:24:01 Error response from daemon: No such id: ferry/cassandra:0.3.3.3 2014/10/14 12:26:08 Error response from daemon: No such id: ferry/titan:0.3.3.3 2014/10/14 12:28:16 Error response from daemon: No such id: ferry/cassandra-client:0.3.3.3 2014/10/14 12:30:23 Error response from daemon: No such id: ferry/gluster:0.3.3.3 2014/10/14 12:32:31 Error response from daemon: No such id: ferry/openmpi:0.3.3.3 2014/10/14 12:34:38 Error response from daemon: No such id: ferry/openmpi-client:0.3.3.3 2014/10/14 12:36:46 Error response from daemon: No such id: ferry/hadoop-base:0.3.3.3 2014/10/14 12:38:53 Error response from daemon: No such id: ferry/hadoop-client:0.3.3.3 2014/10/14 12:41:00 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3 2014/10/14 12:41:00 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3 2014/10/14 12:41:01 Error response from daemon: No such id: ferry/hive-metastore:latest 2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:0.3.3.3 2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:0.3.3.3 2014/10/14 12:43:08 Error response from daemon: No such id: ferry/mongodb:latest 2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:0.3.3.3 2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:0.3.3.3 2014/10/14 12:45:15 Error response from daemon: No such id: ferry/spark:latest 2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:0.3.3.3 2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:0.3.3.3 2014/10/14 12:47:23 Error response from daemon: No such id: ferry/hadoop:latest[10/14/2014 12:17:34] [WARNING] all prerequisites met...[10/14/2014 12:17:34] [WARNING] Creating Ferry bridge 172.18.42.1/16[10/14/2014 12:17:34] [WARNING] checking for btrfs[10/14/2014 12:17:34] [WARNING] using devmapper backend[10/14/2014 12:17:34] [WARNING] using public dns[10/14/2014 12:17:34] [WARNING] nohup docker -d -H=unix:////var/run/ferry.sock -g=/var/lib/ferry -p=/var/run/ferry.pid -b ferry0 --dns 8.8.8.8 --dns 8.8.4.4 -e lxc -s devicemapper --icc=true 1>/var/lib/ferry/docker.log 2>&1 &[10/14/2014 12:17:38] [WARNING] performing select rebuild (['cassandra-client', 'openmpi', 'ferry-base', 'openmpi-client', 'hadoop-client', 'hive-metastore', 'hive', 'mongodb', 'mongodb-client', 'titan', 'cassandra', 'spark', 'spark-client', 'hadoop', 'yarn', 'hadoop-base', 'gluster'])[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] transforming dockerfile[10/14/2014 12:17:38] [WARNING] building image cassandra-client[10/14/2014 12:17:38] [WARNING] docker -H=unix:////var/run/ferry.sock pull ubuntu:14.04 Pulling repository ubuntu[10/14/2014 12:19:46] [WARNING] 2014/10/14 12:19:46 Get https://index.docker.io/v1/repositories/ubuntu/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:19:46] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/ferry-base:0.3.3.3 Pulling repository ferry/ferry-base[10/14/2014 12:21:53] [WARNING] 2014/10/14 12:21:53 Get https://index.docker.io/v1/repositories/ferry/ferry-base/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:21:53] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/ferry-base:0.3.3.3 ferry/ferry-base:latest[10/14/2014 12:21:53] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra:0.3.3.3 Pulling repository ferry/cassandra[10/14/2014 12:24:00] [WARNING] 2014/10/14 12:24:00 Get https://index.docker.io/v1/repositories/ferry/cassandra/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:24:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra:0.3.3.3 ferry/cassandra:latest[10/14/2014 12:24:00] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/titan:0.3.3.3 Pulling repository ferry/titan[10/14/2014 12:26:08] [WARNING] 2014/10/14 12:26:08 Get https://index.docker.io/v1/repositories/ferry/titan/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:26:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/titan:0.3.3.3 ferry/titan:latest[10/14/2014 12:26:08] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra-client:0.3.3.3 Pulling repository ferry/cassandra-client[10/14/2014 12:28:15] [WARNING] 2014/10/14 12:28:15 Get https://index.docker.io/v1/repositories/ferry/cassandra-client/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:28:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra-client:0.3.3.3 ferry/cassandra-client:latest[10/14/2014 12:28:15] [WARNING] building image openmpi[10/14/2014 12:28:15] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/gluster:0.3.3.3 Pulling repository ferry/gluster[10/14/2014 12:30:23] [WARNING] 2014/10/14 12:30:23 Get https://index.docker.io/v1/repositories/ferry/gluster/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:30:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/gluster:0.3.3.3 ferry/gluster:latest[10/14/2014 12:30:23] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi:0.3.3.3 Pulling repository ferry/openmpi[10/14/2014 12:32:30] [WARNING] 2014/10/14 12:32:30 Get https://index.docker.io/v1/repositories/ferry/openmpi/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:32:30] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi:0.3.3.3 ferry/openmpi:latest[10/14/2014 12:32:30] [WARNING] building image ferry-base[10/14/2014 12:32:30] [WARNING] building image openmpi-client[10/14/2014 12:32:30] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi-client:0.3.3.3 Pulling repository ferry/openmpi-client[10/14/2014 12:34:38] [WARNING] 2014/10/14 12:34:38 Get https://index.docker.io/v1/repositories/ferry/openmpi-client/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:34:38] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi-client:0.3.3.3 ferry/openmpi-client:latest[10/14/2014 12:34:38] [WARNING] building image hadoop-client[10/14/2014 12:34:38] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-base:0.3.3.3 Pulling repository ferry/hadoop-base[10/14/2014 12:36:45] [WARNING] 2014/10/14 12:36:45 Get https://index.docker.io/v1/repositories/ferry/hadoop-base/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:36:45] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-base:0.3.3.3 ferry/hadoop-base:latest[10/14/2014 12:36:45] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-client:0.3.3.3 Pulling repository ferry/hadoop-client[10/14/2014 12:38:53] [WARNING] 2014/10/14 12:38:53 Get https://index.docker.io/v1/repositories/ferry/hadoop-client/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:38:53] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-client:0.3.3.3 ferry/hadoop-client:latest[10/14/2014 12:38:53] [WARNING] building image hive-metastore[10/14/2014 12:38:53] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hive-metastore:0.3.3.3 Pulling repository ferry/hive-metastore[10/14/2014 12:41:00] [WARNING] 2014/10/14 12:41:00 Get https://index.docker.io/v1/repositories/ferry/hive-metastore/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive-metastore:latest[10/14/2014 12:41:00] [WARNING] tagging images hive-metastore[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive:0.3.3.3[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:latest ferry/hive:latest[10/14/2014 12:41:00] [WARNING] building image mongodb[10/14/2014 12:41:00] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/mongodb:0.3.3.3 Pulling repository ferry/mongodb[10/14/2014 12:43:08] [WARNING] 2014/10/14 12:43:08 Get https://index.docker.io/v1/repositories/ferry/mongodb/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb:latest[10/14/2014 12:43:08] [WARNING] tagging images mongodb[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb-client:0.3.3.3[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:latest ferry/mongodb-client:latest[10/14/2014 12:43:08] [WARNING] building image titan[10/14/2014 12:43:08] [WARNING] building image cassandra[10/14/2014 12:43:08] [WARNING] building image spark[10/14/2014 12:43:08] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/spark:0.3.3.3 Pulling repository ferry/spark[10/14/2014 12:45:15] [WARNING] 2014/10/14 12:45:15 Get https://index.docker.io/v1/repositories/ferry/spark/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark:latest[10/14/2014 12:45:15] [WARNING] tagging images spark[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark-client:0.3.3.3[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:latest ferry/spark-client:latest[10/14/2014 12:45:15] [WARNING] building image hadoop[10/14/2014 12:45:15] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop:0.3.3.3 Pulling repository ferry/hadoop[10/14/2014 12:47:23] [WARNING] 2014/10/14 12:47:23 Get https://index.docker.io/v1/repositories/ferry/hadoop/images: dial tcp 162.242.195.84:443: connection timed out [10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/hadoop:latest[10/14/2014 12:47:23] [WARNING] tagging images hadoop[10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/yarn:0.3.3.3[10/14/2014 12:47:23] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:latest ferry/yarn:latest[10/14/2014 12:47:23] [WARNING] building image hadoop-base[10/14/2014 12:47:23] [WARNING] building image gluster[10/14/2014 12:47:23] [ERROR] images not built: ['mongodb', 'ferry-base', 'hadoop-base', 'hadoop', 'hadoop-client', 'hive-metastore', 'gluster', 'openmpi', 'openmpi-client', 'cassandra', 'cassandra-client', 'titan', 'spark'][10/14/2014 12:47:23] [WARNING] stopping docker daemon Some images were not installed. Please type 'ferry install' again.

— Reply to this email directly or view it on GitHub https://github.com/opencore/ferry/issues/26.

josephwinston commented 9 years ago

Updated docker:

vagrant@vagrant-ubuntu-trusty-64:~$ docker --version
Docker version 1.2.0, build fa7b24f

removed all traces from previous try:

$ sudo rm -rf $FERRY_DIR/*
$ docker rm  -f  `docker ps -a -q`
$ docker rmi -f  `docker images -a -q`
vagrant@vagrant-ubuntu-trusty-64:~$ ferry-dust install
Error: No such image or container: ferry/ferry-server
pulling the ferry image
Pulling repository ferry/ferry-server
97363f6e9079: Pulling dependent layers
97363f6e9079: Download complete
249a44f2f965: Download complete
511136ea3c5a: Download complete
b18d0a2076a1: Download complete
67b66f26d423: Download complete
25c4824a5268: Download complete
8b1c48305638: Download complete
c900195dcbf3: Download complete
6b4e8a7373fe: Download complete
f8a57046c3fc: Download complete
c2c0da7cede7: Download complete
4ca1aa06d7c7: Download complete
1a1d7ef08dcc: Download complete
cc400379cb68: Download complete
798a83a04a19: Download complete
943a7afc77c7: Download complete
de95eeb92afc: Download complete
ab04cc56c1b2: Download complete
25098d3c6c7a: Download complete
7533a39e7d69: Download complete
24494120dbe9: Download complete
67e689edc7a6: Download complete
9d8ebd110cd4: Download complete
1f7dd8a6fafc: Download complete
e482b718265f: Download complete
5cba33de10c6: Download complete
64e27cc09237: Download complete
5e66087f3ffe: Download complete
1c7f181e78b9: Download complete
9f676bd305a4: Download complete
4d26dd3ebc1c: Download complete
6030677eb5d2: Download complete
90177ae68092: Download complete
d4010efcfd86: Download complete
3f2d795e3309: Download complete
99ec81b80c55: Download complete
3bfcd6184e6c: Download complete
20af62704915: Download complete
fcadef5d73c3: Download complete
db4fe0f2d561: Download complete
4ebaec4748e1: Download complete
07740b15b3fd: Download complete
6753e3778944: Download complete
077fd1caf696: Download complete
c45967030e32: Download complete
67a2a12aa03f: Download complete
888f62d73c9d: Download complete
d63d7f192762: Download complete
af09a11cf5d4: Download complete
1e7811cc4fca: Download complete
22ff4d9f52c1: Download complete
starting ferry, using /opt/ferry to save state
2014/10/14 16:44:54 Error response from daemon: No such id: ferry/ferry-base:0.3.3.3
2014/10/14 16:47:01 Error response from daemon: No such id: ferry/cassandra:0.3.3.3
2014/10/14 16:49:09 Error response from daemon: No such id: ferry/titan:0.3.3.3
2014/10/14 16:51:16 Error response from daemon: No such id: ferry/cassandra-client:0.3.3.3
2014/10/14 16:53:24 Error response from daemon: No such id: ferry/gluster:0.3.3.3
2014/10/14 16:55:31 Error response from daemon: No such id: ferry/openmpi:0.3.3.3
2014/10/14 16:57:39 Error response from daemon: No such id: ferry/openmpi-client:0.3.3.3
2014/10/14 16:59:46 Error response from daemon: No such id: ferry/hadoop-base:0.3.3.3
2014/10/14 17:01:54 Error response from daemon: No such id: ferry/hadoop-client:0.3.3.3
2014/10/14 17:04:02 Error response from daemon: No such id: ferry/hive-metastore:latest
2014/10/14 17:04:02 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3
2014/10/14 17:04:02 Error response from daemon: No such id: ferry/hive-metastore:0.3.3.3
2014/10/14 17:06:09 Error response from daemon: No such id: ferry/mongodb:0.3.3.3
2014/10/14 17:06:09 Error response from daemon: No such id: ferry/mongodb:0.3.3.3
2014/10/14 17:06:09 Error response from daemon: No such id: ferry/mongodb:latest
2014/10/14 17:08:17 Error response from daemon: No such id: ferry/spark:0.3.3.3
2014/10/14 17:08:17 Error response from daemon: No such id: ferry/spark:0.3.3.3
2014/10/14 17:08:17 Error response from daemon: No such id: ferry/spark:latest
2014/10/14 17:10:24 Error response from daemon: No such id: ferry/hadoop:0.3.3.3
2014/10/14 17:10:24 Error response from daemon: No such id: ferry/hadoop:latest
2014/10/14 17:10:24 Error response from daemon: No such id: ferry/hadoop:0.3.3.3
[10/14/2014 04:40:35] [WARNING] all prerequisites met...
[10/14/2014 04:40:35] [WARNING] Creating Ferry bridge 172.18.42.1/16
[10/14/2014 04:40:35] [WARNING] checking for btrfs
[10/14/2014 04:40:35] [WARNING] using devmapper backend
[10/14/2014 04:40:35] [WARNING] using public dns
[10/14/2014 04:40:35] [WARNING] nohup docker -d -H=unix:////var/run/ferry.sock -g=/var/lib/ferry -p=/var/run/ferry.pid -b ferry0 --dns 8.8.8.8 --dns 8.8.4.4 -e lxc -s devicemapper --icc=true 1>/var/lib/ferry/docker.log  2>&1 &
[10/14/2014 04:40:39] [WARNING] performing select rebuild (['cassandra-client', 'openmpi', 'ferry-base', 'openmpi-client', 'hadoop-client', 'hive-metastore', 'hive', 'mongodb', 'mongodb-client', 'titan', 'cassandra', 'spark', 'spark-client', 'hadoop', 'yarn', 'hadoop-base', 'gluster'])
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] transforming dockerfile
[10/14/2014 04:40:39] [WARNING] building image cassandra-client
[10/14/2014 04:40:39] [WARNING] docker -H=unix:////var/run/ferry.sock pull ubuntu:14.04
Pulling repository ubuntu
[10/14/2014 04:42:46] [WARNING] 2014/10/14 16:42:46 Get https://index.docker.io/v1/repositories/ubuntu/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:42:46] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/ferry-base:0.3.3.3
Pulling repository ferry/ferry-base
[10/14/2014 04:44:54] [WARNING] 2014/10/14 16:44:54 Get https://index.docker.io/v1/repositories/ferry/ferry-base/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:44:54] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/ferry-base:0.3.3.3 ferry/ferry-base:latest
[10/14/2014 04:44:54] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra:0.3.3.3
Pulling repository ferry/cassandra
[10/14/2014 04:47:01] [WARNING] 2014/10/14 16:47:01 Get https://index.docker.io/v1/repositories/ferry/cassandra/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:47:01] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra:0.3.3.3 ferry/cassandra:latest
[10/14/2014 04:47:01] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/titan:0.3.3.3
Pulling repository ferry/titan
[10/14/2014 04:49:09] [WARNING] 2014/10/14 16:49:09 Get https://index.docker.io/v1/repositories/ferry/titan/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:49:09] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/titan:0.3.3.3 ferry/titan:latest
[10/14/2014 04:49:09] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/cassandra-client:0.3.3.3
Pulling repository ferry/cassandra-client
[10/14/2014 04:51:16] [WARNING] 2014/10/14 16:51:16 Get https://index.docker.io/v1/repositories/ferry/cassandra-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:51:16] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/cassandra-client:0.3.3.3 ferry/cassandra-client:latest
[10/14/2014 04:51:16] [WARNING] building image openmpi
[10/14/2014 04:51:16] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/gluster:0.3.3.3
Pulling repository ferry/gluster
[10/14/2014 04:53:24] [WARNING] 2014/10/14 16:53:24 Get https://index.docker.io/v1/repositories/ferry/gluster/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:53:24] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/gluster:0.3.3.3 ferry/gluster:latest
[10/14/2014 04:53:24] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi:0.3.3.3
Pulling repository ferry/openmpi
[10/14/2014 04:55:31] [WARNING] 2014/10/14 16:55:31 Get https://index.docker.io/v1/repositories/ferry/openmpi/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:55:31] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi:0.3.3.3 ferry/openmpi:latest
[10/14/2014 04:55:31] [WARNING] building image ferry-base
[10/14/2014 04:55:31] [WARNING] building image openmpi-client
[10/14/2014 04:55:31] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/openmpi-client:0.3.3.3
Pulling repository ferry/openmpi-client
[10/14/2014 04:57:39] [WARNING] 2014/10/14 16:57:39 Get https://index.docker.io/v1/repositories/ferry/openmpi-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:57:39] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/openmpi-client:0.3.3.3 ferry/openmpi-client:latest
[10/14/2014 04:57:39] [WARNING] building image hadoop-client
[10/14/2014 04:57:39] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-base:0.3.3.3
Pulling repository ferry/hadoop-base
[10/14/2014 04:59:46] [WARNING] 2014/10/14 16:59:46 Get https://index.docker.io/v1/repositories/ferry/hadoop-base/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 04:59:46] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-base:0.3.3.3 ferry/hadoop-base:latest
[10/14/2014 04:59:46] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop-client:0.3.3.3
Pulling repository ferry/hadoop-client
[10/14/2014 05:01:54] [WARNING] 2014/10/14 17:01:54 Get https://index.docker.io/v1/repositories/ferry/hadoop-client/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 05:01:54] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop-client:0.3.3.3 ferry/hadoop-client:latest
[10/14/2014 05:01:54] [WARNING] building image hive-metastore
[10/14/2014 05:01:54] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hive-metastore:0.3.3.3
Pulling repository ferry/hive-metastore
[10/14/2014 05:04:02] [WARNING] 2014/10/14 17:04:01 Get https://index.docker.io/v1/repositories/ferry/hive-metastore/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 05:04:02] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive-metastore:latest
[10/14/2014 05:04:02] [WARNING] tagging images hive-metastore
[10/14/2014 05:04:02] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:0.3.3.3 ferry/hive:0.3.3.3
[10/14/2014 05:04:02] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hive-metastore:latest ferry/hive:latest
[10/14/2014 05:04:02] [WARNING] building image mongodb
[10/14/2014 05:04:02] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/mongodb:0.3.3.3
Pulling repository ferry/mongodb
[10/14/2014 05:06:09] [WARNING] 2014/10/14 17:06:09 Get https://index.docker.io/v1/repositories/ferry/mongodb/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 05:06:09] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb:latest
[10/14/2014 05:06:09] [WARNING] tagging images mongodb
[10/14/2014 05:06:09] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:0.3.3.3 ferry/mongodb-client:0.3.3.3
[10/14/2014 05:06:09] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/mongodb:latest ferry/mongodb-client:latest
[10/14/2014 05:06:09] [WARNING] building image titan
[10/14/2014 05:06:09] [WARNING] building image cassandra
[10/14/2014 05:06:09] [WARNING] building image spark
[10/14/2014 05:06:09] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/spark:0.3.3.3
Pulling repository ferry/spark
[10/14/2014 05:08:17] [WARNING] 2014/10/14 17:08:17 Get https://index.docker.io/v1/repositories/ferry/spark/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 05:08:17] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark:latest
[10/14/2014 05:08:17] [WARNING] tagging images spark
[10/14/2014 05:08:17] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:0.3.3.3 ferry/spark-client:0.3.3.3
[10/14/2014 05:08:17] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/spark:latest ferry/spark-client:latest
[10/14/2014 05:08:17] [WARNING] building image hadoop
[10/14/2014 05:08:17] [WARNING] docker -H=unix:////var/run/ferry.sock pull ferry/hadoop:0.3.3.3
Pulling repository ferry/hadoop
[10/14/2014 05:10:24] [WARNING] 2014/10/14 17:10:24 Get https://index.docker.io/v1/repositories/ferry/hadoop/images: dial tcp 162.242.195.84:443: connection timed out

[10/14/2014 05:10:24] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/hadoop:latest
[10/14/2014 05:10:24] [WARNING] tagging images hadoop
[10/14/2014 05:10:24] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:0.3.3.3 ferry/yarn:0.3.3.3
[10/14/2014 05:10:24] [WARNING] docker -H=unix:////var/run/ferry.sock tag ferry/hadoop:latest ferry/yarn:latest
[10/14/2014 05:10:24] [WARNING] building image hadoop-base
[10/14/2014 05:10:24] [WARNING] building image gluster
[10/14/2014 05:10:25] [ERROR] images not built: ['mongodb', 'ferry-base', 'hadoop-base', 'hadoop', 'hadoop-client', 'hive-metastore', 'gluster', 'openmpi', 'openmpi-client', 'cassandra', 'cassandra-client', 'titan', 'spark']
[10/14/2014 05:10:25] [WARNING] stopping docker daemon
Some images were not installed. Please type 'ferry install' again.

Question: Does ferry-dust honor and pass on proxy settings?

josephwinston commented 9 years ago

It doesn't look like a proxy issue on my side:

$ vagrant@vagrant-ubuntu-trusty-64:~$ curl https://index.docker.io/v1/repositories/ferry/gluster/images
[{"checksum": "", "id": "91b849d6f3999652e24d48fa9315cb39a86ec3b201d1ef86375a4ded5b143538"},  ... lots ommitted
josephwinston commented 9 years ago

Something like this appears to help proxy users:

vagrant@vagrant-ubuntu-trusty-64:~$ diff  /usr/local/lib/python2.7/dist-packages/ferry/install.py /usr/local/lib/python2.7/dist-pacages/ferry/install.py.ORG
888,899d887
<                 ###
<                 ### JBW START
<                 ###
<
<                 proxy = None
<                 if 'http_proxy' in os.environ:
<                     proxy = os.environ['http_proxy']
<
<                 ###
<                 ### JBW END
<                 ###
<
902,914c890
<
<                 ###
<                 ### JBW START
<                 ###
<
<                 if proxy:
<                     cmd = 'nohup ' + 'http_proxy=' + proxy + '; ' + DOCKER_CMD + ' -d' + ' -H=' + DOCKER_SOCK + ' -g=' + DOCKER_DR + ' -p=' + DOCKER_PID + nflag + dflag + lflag + bflag + icc + ' 1>%s  2>&1 &' % DEFAULT_DOCKER_LOG
<                 else:
<                     cmd = 'nohup ' + DOCKER_CMD + ' -d' + ' -H=' + DOCKER_SOCK + ' -g=' + DOCKER_DIR + ' -p=' + DOCKER_PID + nfla + dflag + lflag + bflag + icc + ' 1>%s  2>&1 &' % DEFAULT_DOCKER_LOG
<
<                 ###
<                 ### JBW END
<                 ###
---
>                 cmd = 'nohup ' + DOCKER_CMD + ' -d' + ' -H=' + DOCKER_SOCK + ' -g=' + DOCKER_DIR + ' -p=' + DOCKER_PID + nflag + flag + lflag + bflag + icc + ' 1>%s  2>&1 &' % DEFAULT_DOCKER_LOG
jhorey commented 9 years ago

Instead of an environment variable, what do you think about using a new flag? Maybe a "-h"? The entire options parsing is less organized than I'd like it to be, but you should be able to add the flag at the top of cli.py, and then check for the flag in install.py.

Related to this, could you try to manually pull the Docker images via:

ferry pull image://ferry/ferry-base ferry pull image://ferry/glusterfs etc

Thanks! James

josephwinston commented 9 years ago

I'd rather have a configuration file for ferry that contains the http_proxy and https_proxy settings and pass them as the env argument to Popen.

jhorey commented 9 years ago

Just to be clear, you want to be able to specify proxy settings via both the configuration file and environment variables? Presumably so that you can override the proxy settings on occasion?