plugins-demo-2015 / demo

A demo of Weave and Flocker as official Docker plugins using compose and swarm
13 stars 4 forks source link

Issue running the demo(volume plugin issue) #23

Open smakam opened 9 years ago

smakam commented 9 years ago

hi I followed the steps mentioned and I am getting an error when I create application using docker-compose while creating redis container. Following is the error log on:

vagrant@master:/vagrant/app$ docker-compose up -dStarting new HTTP connection (1): localhost Creating app_web_1... Creating app_redis_1... 500 Internal Server Error: Error looking up volume plugin flocker: Post http:///usr/share/docker/plugins/flocker.sock/Plugin.Activate: dial unix /usr/share/docker/plugins/flocker.sock: connection refused

Any ideas?

Thanks Sreenivas

binocarlos commented 9 years ago

@smakam thanks for the feedback. Could you run the following command on one of the VM's and paste me the output. It seems that the Unix Socket that Docker is using to communicate with the Plugin is not allowing the communication (for some reason):

$ ls -la /usr/share/docker/plugins

We are looking for a flocker.sock Unix Socket in that directory. Also - can you paste the output of

$ ps -aux

(to make sure everything that should be, is running)

Thanks!

smakam commented 9 years ago

@binocarlos Thanks for getting back. Following are the details that you wanted.

Master: vagrant@master:/vagrant/app$ ls -la /usr/share/docker/plugins total 8 drwxr-xr-x 2 root root 4096 Jul 9 11:11 . drwxr-xr-x 3 root root 4096 Jul 8 08:48 .. srw-rw-rw- 1 root root 0 Jul 8 08:48 flocker.sock srwxr-xr-x 1 root root 0 Jul 9 11:11 weave.sock vagrant@master:/vagrant/app$ ps -aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 7.4 0.2 33768 3096 ? Ss 11:08 1:26 /sbin/init root 2 0.0 0.0 0 0 ? S 11:08 0:00 [kthreadd] root 3 4.3 0.0 0 0 ? S 11:08 0:50 [ksoftirqd/0] root 5 0.0 0.0 0 0 ? S< 11:08 0:00 [kworker/0:0H] root 7 1.9 0.0 0 0 ? S 11:08 0:23 [rcu_sched] root 8 3.0 0.0 0 0 ? S 11:08 0:35 [rcuos/0] root 9 0.0 0.0 0 0 ? S 11:08 0:00 [rcu_bh] root 10 0.0 0.0 0 0 ? S 11:08 0:00 [rcuob/0] root 11 0.0 0.0 0 0 ? S 11:08 0:00 [migration/0] root 12 0.1 0.0 0 0 ? S 11:08 0:01 [watchdog/0] root 13 0.0 0.0 0 0 ? S< 11:08 0:00 [khelper] root 14 0.0 0.0 0 0 ? S 11:08 0:00 [kdevtmpfs] root 15 0.0 0.0 0 0 ? S< 11:08 0:00 [netns] root 16 0.0 0.0 0 0 ? S< 11:08 0:00 [writeback] root 17 0.0 0.0 0 0 ? S< 11:08 0:00 [kintegrityd] root 18 0.0 0.0 0 0 ? S< 11:08 0:00 [bioset] root 19 0.0 0.0 0 0 ? S< 11:08 0:00 [kworker/u3:0] root 20 0.0 0.0 0 0 ? S< 11:08 0:00 [kblockd] root 21 0.0 0.0 0 0 ? S< 11:08 0:00 [ata_sff] root 22 0.0 0.0 0 0 ? S 11:08 0:00 [khubd] root 23 0.0 0.0 0 0 ? S< 11:08 0:00 [md] root 24 0.0 0.0 0 0 ? S< 11:08 0:00 [devfreq_wq] root 25 1.3 0.0 0 0 ? S 11:08 0:15 [kworker/0:1] root 26 0.0 0.0 0 0 ? S 11:08 0:00 [khungtaskd] root 27 0.0 0.0 0 0 ? S 11:08 0:00 [kswapd0] root 28 0.0 0.0 0 0 ? SN 11:08 0:00 [ksmd] root 29 0.1 0.0 0 0 ? SN 11:08 0:01 [khugepaged] root 30 0.0 0.0 0 0 ? S 11:08 0:00 [fsnotify_mark] root 31 0.0 0.0 0 0 ? S 11:08 0:00 [ecryptfs-kthre root 32 0.0 0.0 0 0 ? S< 11:08 0:00 [crypto] root 44 0.0 0.0 0 0 ? S< 11:08 0:00 [kthrotld] root 45 0.0 0.0 0 0 ? S 11:08 0:00 [kworker/u2:1] root 64 0.0 0.0 0 0 ? S< 11:08 0:00 [deferwq] root 65 0.0 0.0 0 0 ? S< 11:08 0:00 [charger_manage root 106 0.0 0.0 0 0 ? S< 11:08 0:00 [kpsmoused] root 107 0.0 0.0 0 0 ? S 11:08 0:00 [scsi_eh_0] root 108 0.2 0.0 0 0 ? S 11:08 0:03 [kworker/u2:2] root 153 0.0 0.0 0 0 ? S< 11:08 0:00 [kworker/u3:1] root 154 0.2 0.0 0 0 ? S 11:08 0:02 [jbd2/sda1-8] root 155 0.0 0.0 0 0 ? S< 11:08 0:00 [ext4-rsv-conve root 458 0.7 0.0 19604 928 ? S 11:08 0:08 upstart-udev-br root 464 0.0 0.1 51428 1720 ? Ss 11:08 0:00 /lib/systemd/sy root 501 0.0 0.0 0 0 ? S< 11:08 0:00 [iprt] root 601 0.0 0.1 10224 2412 ? Ss 11:08 0:00 dhclient -1 -v root 683 0.0 0.0 23420 1100 ? Ss 11:08 0:00 rpcbind statd 784 0.0 0.0 21544 1376 ? Ss 11:08 0:00 rpc.statd -L root 801 0.6 0.0 15392 716 ? S 11:08 0:06 upstart-socket- root 869 0.0 0.0 0 0 ? S< 11:09 0:00 [rpciod] root 886 0.0 0.0 0 0 ? S< 11:09 0:00 [nfsiod] message+ 892 0.7 0.0 39220 1224 ? Ss 11:09 0:09 dbus-daemon --s root 900 7.0 1.5 690288 21440 ? Ssl 11:09 1:19 /usr/bin/docker root 905 0.0 0.0 23480 420 ? Ss 11:09 0:00 rpc.idmapd syslog 920 0.2 0.5 255844 7516 ? Ssl 11:09 0:02 rsyslogd root 939 0.0 0.1 43452 1828 ? Ss 11:09 0:00 /lib/systemd/sy root 1056 0.5 0.0 15536 912 ? S 11:09 0:06 upstart-file-br root 1088 0.0 0.0 14540 936 tty4 Ss+ 11:09 0:00 /sbin/getty -8 root 1091 0.0 0.0 14540 952 tty5 Ss+ 11:09 0:00 /sbin/getty -8 root 1097 0.0 0.0 14540 952 tty2 Ss+ 11:09 0:00 /sbin/getty -8 root 1098 0.0 0.0 14540 948 tty3 Ss+ 11:09 0:00 /sbin/getty -8 root 1100 0.0 0.0 14540 940 tty6 Ss+ 11:09 0:00 /sbin/getty -8 root 1171 0.0 0.0 4368 656 ? Ss 11:09 0:00 acpid -c /etc/a root 1177 0.0 0.0 23656 892 ? Ss 11:09 0:00 cron daemon 1178 0.0 0.0 19140 164 ? Ss 11:09 0:00 atd root 1207 0.0 0.0 0 0 ? S 11:09 0:00 [kauditd] root 1411 1.4 0.0 216612 1080 ? Sl 11:09 0:16 /usr/sbin/VBoxS root 1524 0.0 0.0 0 0 ? SN 11:09 0:00 [spl_kmem_cache root 1525 0.0 0.0 0 0 ? S< 11:09 0:00 [spl_system_tas root 1560 0.0 0.0 0 0 ? S< 11:09 0:00 [arc_adapt] root 1561 0.0 0.0 0 0 ? S< 11:09 0:00 [vdev_file_task root 1562 0.0 0.0 0 0 ? S< 11:09 0:00 [l2arc_feed] root 1563 0.0 0.0 0 0 ? SN 11:09 0:00 [z_unmount/0] root 1564 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/0] root 1565 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/1] root 1566 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/2] root 1567 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/3] root 1570 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/4] root 1571 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/5] root 1572 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/6] root 1573 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/7] root 1574 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/8] root 1576 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/9] root 1577 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/10] root 1578 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/11] root 1579 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/12] root 1580 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/13] root 1581 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/14] root 1582 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/15] root 1583 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/16] root 1584 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/17] root 1585 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/18] root 1586 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/19] root 1590 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/20] root 1591 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/21] root 1593 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/22] root 1594 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/23] root 1595 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/24] root 1596 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/25] root 1597 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/26] root 1598 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/27] root 1599 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/28] root 1600 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/29] root 1601 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/30] root 1602 0.0 0.0 0 0 ? SN 11:09 0:00 [zvol/31] root 1723 0.0 0.2 61368 3084 ? Ss 11:09 0:00 /usr/sbin/sshd root 1824 0.0 2.4 182500 34436 ? Ssl 11:09 0:00 /usr/bin/ruby / root 1972 0.0 2.4 112700 34520 ? Sl 11:10 0:00 ruby /usr/bin/c root 2020 0.0 0.0 14540 944 tty1 Ss+ 11:10 0:00 /sbin/getty -8 root 2099 7.8 4.5 198484 64476 ? Ssl 11:10 1:24 /opt/flocker/bi root 2150 8.4 5.1 292052 72808 ? Ssl 11:10 1:31 /opt/flocker/bi root 2163 4.0 5.0 218324 71152 ? Ssl 11:10 0:43 /opt/flocker/bi root 2681 0.0 0.6 110260 9116 ? Sl 11:10 0:00 docker-proxy -p root 2697 0.0 0.6 110260 9352 ? Sl 11:10 0:00 docker-proxy -p root 2714 6.4 3.8 255560 53580 ? Ssl 11:10 1:07 /home/weave/wea root 3009 0.0 0.6 110260 9352 ? Sl 11:10 0:00 docker-proxy -p root 3033 6.9 0.3 12240 5424 ? Ssl 11:10 1:11 /home/weave/wea root 3191 0.0 0.0 0 0 ? SN 11:10 0:00 [z_null_iss/0] root 3194 0.1 0.0 0 0 ? SN 11:10 0:01 [z_null_int/0] root 3195 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/0] root 3196 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/1] root 3197 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/2] root 3198 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/3] root 3199 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/4] root 3200 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/5] root 3201 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/6] root 3202 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_iss/7] root 3203 0.0 0.0 0 0 ? SN 11:10 0:00 [z_rd_int/0] root 3204 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss/0] root 3205 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss_h/0] root 3206 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss_h/1] root 3207 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss_h/2] root 3208 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss_h/3] root 3209 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_iss_h/4] root 3210 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/0] root 3211 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/1] root 3212 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/2] root 3213 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/3] root 3214 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/4] root 3215 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/5] root 3216 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/6] root 3217 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/7] root 3218 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/8] root 3219 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/9] root 3220 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/10] root 3221 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/11] root 3222 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/12] root 3223 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/13] root 3224 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/14] root 3225 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int/15] root 3226 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int_h/0] root 3229 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int_h/1] root 3231 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int_h/2] root 3232 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int_h/3] root 3233 0.0 0.0 0 0 ? SN 11:10 0:00 [z_wr_int_h/4] root 3234 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_0/0] root 3235 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_0/1] root 3236 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_0/2] root 3237 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_0/3] root 3238 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_1/0] root 3239 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_1/1] root 3240 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_1/2] root 3241 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_1/3] root 3242 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_2/0] root 3243 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_2/1] root 3244 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_2/2] root 3245 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_2/3] root 3246 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_3/0] root 3247 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_3/1] root 3248 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_3/2] root 3249 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_3/3] root 3250 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_4/0] root 3251 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_4/1] root 3252 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_4/2] root 3253 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_4/3] root 3254 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_5/0] root 3255 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_5/1] root 3256 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_5/2] root 3257 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_5/3] root 3258 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_6/0] root 3259 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_6/1] root 3260 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_6/2] root 3261 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_6/3] root 3262 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_7/0] root 3263 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_7/1] root 3265 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_7/2] root 3266 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_iss_7/3] root 3267 0.0 0.0 0 0 ? SN 11:10 0:00 [z_fr_int/0] root 3268 0.0 0.0 0 0 ? SN 11:10 0:00 [z_cl_iss/0] root 3269 0.0 0.0 0 0 ? SN 11:10 0:00 [z_cl_int/0] root 3270 0.0 0.0 0 0 ? SN 11:10 0:00 [z_ioctl_iss/0] root 3271 0.0 0.0 0 0 ? SN 11:10 0:00 [z_ioctl_int/0] root 3272 0.0 0.0 0 0 ? S< 11:10 0:00 [metaslab_group root 3334 0.0 0.2 8848 3420 ? Ssl 11:11 0:00 /home/weave/plu root 4013 0.0 0.0 0 0 ? S< 11:14 0:00 [zfs_iput_taskq root 4039 0.0 0.0 0 0 ? S< 11:14 0:00 [txg_quiesce] root 4040 0.1 0.0 0 0 ? S< 11:14 0:01 [txg_sync] root 5910 0.0 0.3 107696 4268 ? Ss 11:22 0:00 sshd: vagrant [ root 5912 1.6 0.0 0 0 ? S 11:22 0:05 [kworker/0:0] vagrant 5961 0.2 0.1 107696 2176 ? R 11:22 0:00 sshd: vagrant@p vagrant 5962 0.1 0.3 21872 4308 pts/6 Ss 11:22 0:00 -bash root 6387 0.0 0.3 107696 4260 ? Ss 11:24 0:00 sshd: vagrant [ vagrant 6437 0.0 0.1 107696 2176 ? S 11:24 0:00 sshd: vagrant@p vagrant 6438 0.9 0.7 268132 10080 pts/7 Ssl+ 11:24 0:01 /usr/bin/swarm root 7255 0.0 1.3 73540 18980 ? Rs 11:28 0:00 /usr/bin/python vagrant 7257 0.0 0.0 17168 1288 pts/6 R+ 11:28 0:00 ps -aux

Runner: agrant@runner:~$ ls -la /usr/share/docker/plugins total 8 drwxr-xr-x 2 root root 4096 Jul 9 11:18 . drwxr-xr-x 3 root root 4096 Jul 8 08:56 .. srw-rw-rw- 1 root root 0 Jul 8 08:56 flocker.sock srwxr-xr-x 1 root root 0 Jul 9 11:18 weave.sock vagrant@runner:~$ ps -aux USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 6.7 0.2 33876 3176 ? Ss 11:11 1:06 /sbin/init root 2 0.0 0.0 0 0 ? S 11:11 0:00 [kthreadd] root 3 4.2 0.0 0 0 ? R 11:11 0:41 [ksoftirqd/0] root 5 0.0 0.0 0 0 ? S< 11:11 0:00 [kworker/0:0H] root 7 2.3 0.0 0 0 ? S 11:11 0:22 [rcu_sched] root 8 3.0 0.0 0 0 ? S 11:11 0:30 [rcuos/0] root 9 0.0 0.0 0 0 ? S 11:11 0:00 [rcu_bh] root 10 0.0 0.0 0 0 ? S 11:11 0:00 [rcuob/0] root 11 0.0 0.0 0 0 ? S 11:11 0:00 [migration/0] root 12 1.2 0.0 0 0 ? S 11:11 0:11 [watchdog/0] root 13 0.0 0.0 0 0 ? S< 11:11 0:00 [khelper] root 14 0.0 0.0 0 0 ? S 11:11 0:00 [kdevtmpfs] root 15 0.0 0.0 0 0 ? S< 11:11 0:00 [netns] root 16 0.0 0.0 0 0 ? S< 11:11 0:00 [writeback] root 17 0.0 0.0 0 0 ? S< 11:11 0:00 [kintegrityd] root 18 0.0 0.0 0 0 ? S< 11:11 0:00 [bioset] root 19 0.0 0.0 0 0 ? S< 11:11 0:00 [kworker/u3:0] root 20 0.0 0.0 0 0 ? S< 11:11 0:00 [kblockd] root 21 0.0 0.0 0 0 ? S< 11:11 0:00 [ata_sff] root 22 0.0 0.0 0 0 ? S 11:11 0:00 [khubd] root 23 0.0 0.0 0 0 ? S< 11:11 0:00 [md] root 24 0.0 0.0 0 0 ? S< 11:11 0:00 [devfreq_wq] root 25 0.8 0.0 0 0 ? S 11:11 0:08 [kworker/0:1] root 26 0.0 0.0 0 0 ? S 11:11 0:00 [khungtaskd] root 27 0.0 0.0 0 0 ? S 11:11 0:00 [kswapd0] root 28 0.0 0.0 0 0 ? SN 11:11 0:00 [ksmd] root 29 0.0 0.0 0 0 ? SN 11:11 0:00 [khugepaged] root 30 0.0 0.0 0 0 ? S 11:11 0:00 [fsnotify_mark] root 31 0.0 0.0 0 0 ? S 11:11 0:00 [ecryptfs-kthre root 32 0.0 0.0 0 0 ? S< 11:11 0:00 [crypto] root 44 0.0 0.0 0 0 ? S< 11:11 0:00 [kthrotld] root 45 0.0 0.0 0 0 ? S 11:11 0:00 [kworker/u2:1] root 64 0.0 0.0 0 0 ? S< 11:11 0:00 [deferwq] root 65 0.0 0.0 0 0 ? S< 11:11 0:00 [charger_manage root 103 0.0 0.0 0 0 ? S< 11:11 0:00 [kpsmoused] root 104 0.0 0.0 0 0 ? S 11:11 0:00 [scsi_eh_0] root 106 0.5 0.0 0 0 ? S 11:12 0:04 [kworker/u2:2] root 160 0.0 0.0 0 0 ? S< 11:12 0:00 [kworker/u3:1] root 161 0.3 0.0 0 0 ? S 11:12 0:03 [jbd2/sda1-8] root 162 0.0 0.0 0 0 ? S< 11:12 0:00 [ext4-rsv-conve root 472 0.8 0.0 19476 656 ? S 11:12 0:07 upstart-udev-br root 477 0.3 0.1 51408 1624 ? Ss 11:12 0:02 /lib/systemd/sy root 576 0.0 0.0 0 0 ? S< 11:13 0:00 [iprt] root 614 0.0 0.1 10224 2408 ? Ss 11:13 0:00 dhclient -1 -v root 733 0.0 0.0 23420 1100 ? Ss 11:13 0:00 rpcbind statd 781 0.0 0.0 21544 1372 ? Ss 11:13 0:00 rpc.statd -L root 811 0.7 0.0 15428 928 ? S 11:13 0:06 upstart-socket- root 927 0.0 0.0 0 0 ? S< 11:14 0:00 [rpciod] root 931 6.1 1.6 723072 23536 ? Ssl 11:14 0:52 /usr/bin/docker root 971 0.0 0.0 0 0 ? S< 11:14 0:00 [nfsiod] syslog 981 0.4 0.0 255844 1112 ? Ssl 11:14 0:03 rsyslogd message+ 1024 0.9 0.0 39216 1220 ? Ss 11:14 0:08 dbus-daemon --s root 1054 0.0 0.0 23480 416 ? Ss 11:14 0:00 rpc.idmapd root 1080 0.0 0.1 43452 1832 ? Ss 11:14 0:00 /lib/systemd/sy root 1083 0.7 0.0 15408 648 ? S 11:14 0:06 upstart-file-br root 1105 0.0 0.0 14540 952 tty4 Ss+ 11:14 0:00 /sbin/getty -8 root 1108 0.0 0.0 14540 940 tty5 Ss+ 11:14 0:00 /sbin/getty -8 root 1114 0.0 0.0 14540 936 tty2 Ss+ 11:14 0:00 /sbin/getty -8 root 1115 0.0 0.0 14540 948 tty3 Ss+ 11:14 0:00 /sbin/getty -8 root 1117 0.0 0.0 14540 944 tty6 Ss+ 11:14 0:00 /sbin/getty -8 root 1184 0.0 0.0 4368 664 ? Ss 11:14 0:00 acpid -c /etc/a daemon 1191 0.0 0.0 19140 164 ? Ss 11:14 0:00 atd root 1201 0.0 0.0 23656 896 ? Ss 11:14 0:00 cron root 1219 0.0 0.0 0 0 ? S 11:14 0:00 [kauditd] root 1368 1.6 0.0 216612 1084 ? Sl 11:15 0:12 /usr/sbin/VBoxS root 1646 0.0 0.2 61368 3084 ? Ss 11:15 0:00 /usr/sbin/sshd root 1685 0.0 0.0 0 0 ? SN 11:15 0:00 [spl_kmem_cache root 1686 0.0 0.0 0 0 ? S< 11:15 0:00 [spl_system_tas root 1697 0.2 0.0 0 0 ? S< 11:15 0:01 [arc_adapt] root 1698 0.0 0.0 0 0 ? S< 11:15 0:00 [vdev_file_task root 1699 0.0 0.0 0 0 ? S< 11:15 0:00 [l2arc_feed] root 1700 0.0 0.0 0 0 ? SN 11:15 0:00 [z_unmount/0] root 1701 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/0] root 1702 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/1] root 1703 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/2] root 1704 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/3] root 1705 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/4] root 1706 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/5] root 1707 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/6] root 1708 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/7] root 1709 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/8] root 1710 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/9] root 1711 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/10] root 1712 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/11] root 1713 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/12] root 1714 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/13] root 1715 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/14] root 1716 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/15] root 1717 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/16] root 1718 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/17] root 1719 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/18] root 1720 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/19] root 1721 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/20] root 1722 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/21] root 1723 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/22] root 1724 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/23] root 1725 0.0 0.0 0 0 ? SN 11:15 0:00 [zvol/24] root 1726 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/25] root 1727 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/26] root 1728 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/27] root 1730 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/28] root 1731 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/29] root 1732 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/30] root 1733 0.0 0.0 0 0 ? SN 11:16 0:00 [zvol/31] root 1859 0.0 2.4 182532 34436 ? Ssl 11:16 0:00 /usr/bin/ruby / root 2008 0.0 2.4 112700 34512 ? Sl 11:16 0:00 ruby /usr/bin/c root 2050 0.0 0.0 14540 948 tty1 Ss+ 11:16 0:00 /sbin/getty -8 root 2107 8.5 5.1 292056 72852 ? Ssl 11:16 0:58 /opt/flocker/bi root 2120 2.0 5.0 218320 71156 ? Ssl 11:16 0:14 /opt/flocker/bi root 2499 1.0 0.0 0 0 ? S 11:17 0:06 [kworker/0:0] root 2660 0.0 0.5 110260 8368 ? Sl 11:17 0:00 docker-proxy -p root 2675 0.0 0.6 110260 9360 ? Sl 11:17 0:00 docker-proxy -p root 2692 7.4 3.8 329292 54504 ? Ssl 11:17 0:47 /home/weave/wea root 3025 0.0 0.6 110260 9384 ? Sl 11:17 0:00 docker-proxy -p root 3049 7.6 0.3 12240 4980 ? Ssl 11:17 0:47 /home/weave/wea root 3278 1.2 0.2 8848 3848 ? Ssl 11:18 0:07 /home/weave/plu root 3731 0.0 0.0 0 0 ? SN 11:19 0:00 [z_null_iss/0] root 3732 0.2 0.0 0 0 ? SN 11:19 0:01 [z_null_int/0] root 3733 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/0] root 3734 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/1] root 3735 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/2] root 3736 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/3] root 3737 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/4] root 3738 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/5] root 3739 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/6] root 3740 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_iss/7] root 3741 0.0 0.0 0 0 ? SN 11:19 0:00 [z_rd_int/0] root 3742 0.1 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss/0] root 3743 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss_h/0] root 3744 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss_h/1] root 3745 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss_h/2] root 3746 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss_h/3] root 3747 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_iss_h/4] root 3748 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/0] root 3749 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/1] root 3750 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/2] root 3751 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/3] root 3752 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/4] root 3753 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/5] root 3754 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/6] root 3755 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/7] root 3756 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/8] root 3757 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/9] root 3758 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/10] root 3759 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/11] root 3760 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/12] root 3761 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/13] root 3762 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/14] root 3763 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int/15] root 3764 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int_h/0] root 3765 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int_h/1] root 3766 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int_h/2] root 3767 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int_h/3] root 3768 0.0 0.0 0 0 ? SN 11:19 0:00 [z_wr_int_h/4] root 3769 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_0/0] root 3770 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_0/1] root 3771 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_0/2] root 3772 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_0/3] root 3773 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_1/0] root 3774 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_1/1] root 3775 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_1/2] root 3776 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_1/3] root 3777 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_2/0] root 3778 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_2/1] root 3779 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_2/2] root 3780 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_2/3] root 3782 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_3/0] root 3783 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_3/1] root 3784 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_3/2] root 3785 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_3/3] root 3786 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_4/0] root 3787 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_4/1] root 3788 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_4/2] root 3789 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_4/3] root 3790 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_5/0] root 3791 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_5/1] root 3792 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_5/2] root 3793 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_5/3] root 3794 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_6/0] root 3795 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_6/1] root 3796 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_6/2] root 3797 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_6/3] root 3798 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_7/0] root 3799 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_7/1] root 3800 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_7/2] root 3802 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_iss_7/3] root 3803 0.0 0.0 0 0 ? SN 11:19 0:00 [z_fr_int/0] root 3804 0.0 0.0 0 0 ? SN 11:19 0:00 [z_cl_iss/0] root 3805 0.0 0.0 0 0 ? SN 11:19 0:00 [z_cl_int/0] root 3806 0.0 0.0 0 0 ? SN 11:19 0:00 [z_ioctl_iss/0] root 3807 0.0 0.0 0 0 ? SN 11:19 0:00 [z_ioctl_int/0] root 3808 0.0 0.0 0 0 ? S< 11:19 0:00 [metaslab_group root 4613 0.0 0.0 0 0 ? S< 11:22 0:00 [zfs_iput_taskq root 4622 0.0 0.3 107696 4260 ? Ss 11:22 0:00 sshd: vagrant [ vagrant 4667 0.1 0.1 107696 2172 ? R 11:22 0:00 sshd: vagrant@p vagrant 4668 0.1 0.3 21872 4308 pts/5 Ss 11:22 0:00 -bash root 4713 0.0 0.0 0 0 ? S< 11:22 0:00 [txg_quiesce] root 4714 0.1 0.0 0 0 ? S< 11:22 0:00 [txg_sync] root 4932 1.5 0.0 0 0 ? S 11:24 0:03 [kworker/0:2] root 5199 1.2 1.8 935120 26424 ? Ssl 11:25 0:01 node index.js root 5809 0.0 1.0 60456 14056 ? Rs 11:28 0:00 /usr/bin/python vagrant 5811 0.0 0.0 17168 1292 pts/5 R+ 11:28 0:00 ps -aux vagrant@runner:~$

binocarlos commented 9 years ago

@smakam Hey - sorry to have taken a while to get to you - I'm currently digging through this trying to replicate. Basically the error is originating from this line where Docker is saying it cannot find the Unix Socket representing the Plugin.

The question is why when ls -la /usr/share/docker/plugins clearly shows a flocker.sock for you...

Will report back presently...

binocarlos commented 9 years ago

@smakam Hey - I have just discovered what the problem is here (finally)....

Basically - the issue is when you do a vagrant halt followed by a vagrant up

Can you do this following for me please:

$ cd vagrantrunner
$ vagrant destroy -f
$ vagrant up

And then follow the instructions in the demo...

This is to confirm that it works - in the meantime I will look into a way that we can make it work even after a vagrant halt.

Thanks!

smakam commented 9 years ago

@binocarlos Not clear when the vagrant halt is executed. Are you suggesting doing these steps after make step before create_network? $ cd vagrantrunner $ vagrant destroy -f $ vagrant up

The steps in github: $ git clone git@github.com/plugins-demo-2015/demo $ cd demo $ make -C vagrantrunner

$ cd vagrantrunner $ bash create_network.sh $ bash launch_scope.sh $ bash swarm_manage.sh

Thanks Sreenivas

binocarlos commented 9 years ago

@smakam Hey - sorry I wasn't so clear...

The only way I could reproduce your exact problem (i.e. where the flocker.sock was present but Docker refused to POST to it) was when I did a vagrant halt followed by a vagrant up.

Therefore, I had assumed that you might have done a vagrant halt manually.

Also - I confused the issue by saying vagrant up - here is the specific list of commands:

$ cd vagrantrunner
$ vagrant destroy -f
$ cd ..
$ make -C vagrantrunner
$ cd vagrantrunner
$ bash create_network.sh
$ bash launch_scope.sh
$ bash swarm_manage.sh

And then open the other shell - vagrant ssh master -> docker-compose up -d etc

smakam commented 9 years ago

hi @binocarlos Its possible that I might have done a vagrant halt. I tried a clean install this time and I am getting this error now: vagrant@master:/vagrant/app$ docker-compose up -d Starting new HTTP connection (1): localhost Creating app_web_1... Creating app_redis_1... Traceback (most recent call last): File "/usr/local/bin/docker-compose", line 9, in load_entry_point('docker-compose==1.4.0dev', 'console_scripts', 'docker-compose')() File "build/bdist.linux-x86_64/egg/compose/cli/main.py", line 33, in main File "build/bdist.linux-x86_64/egg/compose/cli/docopt_command.py", line 21, in sys_dispatch File "build/bdist.linux-x86_64/egg/compose/cli/command.py", line 34, in dispatch File "build/bdist.linux-x86_64/egg/compose/cli/docopt_command.py", line 24, in dispatch File "build/bdist.linux-x86_64/egg/compose/cli/command.py", line 66, in perform_command File "build/bdist.linux-x86_64/egg/compose/cli/main.py", line 465, in up File "build/bdist.linux-x86_64/egg/compose/project.py", line 242, in up File "build/bdist.linux-x86_64/egg/compose/service.py", line 304, in execute_convergence_plan File "build/bdist.linux-x86_64/egg/compose/service.py", line 378, in start_container File "build/bdist.linux-x86_64/egg/compose/container.py", line 136, in start File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 19, in wrapped return f(self, resource_id, _args, _kwargs) File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 1083, in start res = self._post_json(url, data=start_config) File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 144, in _post_json return self._post(url, data=json.dumps(data2), _kwargs) File "/usr/local/lib/python2.7/dist-packages/docker/client.py", line 101, in _post return self.post(url, _self._set_request_timeout(kwargs)) File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 497, in post return self.request('POST', url, data=data, _kwargs) File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 455, in request resp = self.send(prep, *_send_kwargs) File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 558, in send r = adapter.send(request, **kwargs) File "/usr/lib/python2.7/dist-packages/requests/adapters.py", line 387, in send raise Timeout(e) requests.exceptions.Timeout: HTTPConnectionPool(host='localhost', port=2378): Read timed out. (read timeout=60) vagrant@master:/vagrant/app$

thanks Sreenivas

binocarlos commented 9 years ago

@smakam OK - some progress sideways :-)

So to check - are you running swarm in the first window? The command bash swarm_manage.sh will result in swarm listening on port 2378 on the master - you should be looking at the following output:

$ bash swarm_manage.sh
INFO[0000] Listening for HTTP                            addr=0.0.0.0:2378 proto=tcp
INFO[0000] Registered Engine master at 172.16.70.250:2375
INFO[0000] Registered Engine runner at 172.16.70.251:2375

Then - in the other shell window try this:

$ cd vagrantrunner
$ vagrant ssh master
vagrant@master:~$ export DOCKER_HOST=localhost:2378
vagrant@master:~$ docker info
Containers: 10
Images: 26
Role: primary
Strategy: spread
Filters: affinity, health, constraint, port, dependency
Nodes: 2
 master: 172.16.70.250:2375
  └ Containers: 5
  └ Reserved CPUs: 0 / 1
  └ Reserved Memory: 0 B / 1.405 GiB
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-45-generic, operatingsystem=Ubuntu 14.04.1 LTS, storagedriver=aufs
 runner: 172.16.70.251:2375
  └ Containers: 5
  └ Reserved CPUs: 0 / 1
  └ Reserved Memory: 0 B / 1.405 GiB
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-45-generic, operatingsystem=Ubuntu 14.04.1 LTS, storagedriver=aufs
CPUs: 2
Total Memory: 2.81 GiB

The error from your logs above are indicating that port 2378 is not reachable on localhost - another way to check this would be:

vagrant@master:~$ telnet localhost 2378
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.

Let's see what happens when you do the above before digging deeper - thanks for your patience debugging this :-)

smakam commented 9 years ago

hi @binocarlos I see that swarm process is running fine: this is is log when I started swarm_manage: $ bash swarm_manage.sh INFO[0002] Listening for HTTP addr=0.0.0.0:2378 proto=tcp INFO[0003] Registered Engine runner at 172.16.70.251:2375 INFO[0004] Registered Engine master at 172.16.70.250:2375

this is what i see in master node: vagrant@master:/vagrant/app$ docker info Containers: 13 Images: 26 Role: primary Strategy: spread Filters: affinity, health, constraint, port, dependency Nodes: 2 master: 172.16.70.250:2375 └ Containers: 6 └ Reserved CPUs: 0 / 1 └ Reserved Memory: 0 B / 1.405 GiB └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-45-generic, operatingsystem=Ubuntu 14.04.1 LTS, storagedriver=aufs runner: 172.16.70.251:2375 └ Containers: 7 └ Reserved CPUs: 0 / 1 └ Reserved Memory: 0 B / 1.405 GiB └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-45-generic, operatingsystem=Ubuntu 14.04.1 LTS, storagedriver=aufs CPUs: 2 Total Memory: 2.81 GiB vagrant@master:/vagrant/app$ docker ps | grep swarm vagrant@master:/vagrant/app$ ps -eaf|grep swarm vagrant 5895 5893 0 09:54 pts/7 00:00:29 /usr/bin/swarm manage --host 0.0.0.0:2378 172.16.70.250:2375,172.16.70.251:2375 vagrant 15458 5771 0 11:33 pts/1 00:00:00 grep --color=auto swarm

also, i see that port 2378 is open: vagrant@master:/vagrant/app$ netstat -l | grep 2378 tcp6 0 0 [::]:2378 [::]:* LISTEN

Not sure if there is any permission issue here.

Thanks Sreenivas

binocarlos commented 9 years ago

@smakam hmmm OK - everything looks in order yes

So the next theory to test is that the Flocker driver is not returning - Docker is blocking and compose is timing out after 60 seconds.

Can you run this command on the master and see what happens - it will check that we are able to run a docker container using Flocker as the volume driver:

$ export DOCKER_HOST=localhost:2375
$ docker run -v testapples:/data --volume-driver flocker busybox sh -c "echo hello > /data/file.txt"

There should be no output but the command should take maximum 20 seconds and return - if it just hangs then that explains why compose was timing out - thanks!

smakam commented 9 years ago

@binocarlos The command hangs and does not return...

Thanks Sreenivas

binocarlos commented 9 years ago

@smakam Hey - sorry for the delay in replying have been off...

So - it seems we are having a problem with Flocker itself - can you get the system into the same state as it was (i.e. hanging) and then copy the output of the following commands (on the master box):

$ sudo tail -n 1000 /var/log/upstart/flocker-docker-plugin.log
$ sudo cat /var/log/upstart/flocker-control.log | grep 'error": true'
$ sudo cat /var/log/upstart/flocker-dataset-agent.log | grep 'error": true'

The plugin blocking like you are seeing is normally because Flocker itself has not returned the path to the volume.

Thanks!