ScatterHQ / flocker

Container data volume manager for your Dockerized application
Apache License 2.0
69 stars 9 forks source link

docker: Error response from daemon: Timed out waiting for dataset to mount.. #6

Closed jmuhbagir closed 7 years ago

jmuhbagir commented 7 years ago

I had issue : docker: Error response from daemon: Timed out waiting for dataset to mount..

while tracing logs from all 3 services (dataset,container & plugin) i found this kind of error on flocker-container-agent log

{"timestamp": 1486108668.512604, "task_uuid": "e7ee36f7-b5fb-4843-afc4-662058f9be85", "message_type": "flocker:failure-retry:retrying", "task_level": [2]} {"exception": "requests.exceptions.ConnectionError", "timestamp": 1486108668.516428, "task_uuid": "e7ee36f7-b5fb-4843-afc4-662058f9be85", "action_status": "failed", "reason": "('Connection aborted.', error(2, 'No such file or directory'))", "action_type": "flocker:failure-retry", "errno": null, "task_level": [3]} {"exception": "requests.exceptions.ConnectionError", "timestamp": 1486108668.517358, "task_uuid": "80407d07-c631-4e52-acae-f154f13e520f", "action_status": "failed", "reason": "('Connection aborted.', error(2, 'No such file or directory'))", "action_type": "flocker:agent:discovery", "errno": null, "task_level": [2, 2, 2]} {"exception": "requests.exceptions.ConnectionError", "errno": null, "traceback": "Traceback: <class 'requests.exceptions.ConnectionError'>: ('Connection aborted.', error(2, 'No such file or directory'))\n/usr/lib64/python2.7/threading.py:811:__bootstrap_inner\n/usr/lib64/python2.7/threading.py:764:run\n/opt/flocker/lib/python2.7/site-packages/twisted/_threads/_threadworker.py:46:work\n/opt/flocker/lib/python2.7/site-packages/twisted/_threads/_team.py:190:doWork\n--- <exception caught here> ---\n/opt/flocker/lib/python2.7/site-packages/twisted/python/threadpool.py:246:inContext\n/opt/flocker/lib/python2.7/site-packages/twisted/python/threadpool.py:262:<lambda>\n/opt/flocker/lib/python2.7/site-packages/twisted/python/context.py:118:callWithContext\n/opt/flocker/lib/python2.7/site-packages/twisted/python/context.py:81:callWithContext\n/opt/flocker/lib/python2.7/site-packages/flocker/node/_docker.py:909:_list\n/opt/flocker/lib/python2.7/site-packages/flocker/common/_retry.py:503:method_with_retry\n/opt/flocker/lib/python2.7/site-packages/flocker/common/_retry.py:462:_poll_until_success_returning_result\n/opt/flocker/lib/python2.7/site-packages/flocker/common/_retry.py:293:poll_until\n/opt/flocker/lib/python2.7/site-packages/flocker/common/_retry.py:446:pollable\n/opt/flocker/lib/python2.7/site-packages/flocker/common/_retry.py:443:pollable\n/opt/flocker/lib/python2.7/site-packages/docker/api/container.py:70:containers\n/opt/flocker/lib/python2.7/site-packages/docker/utils/decorators.py:47:inner\n/opt/flocker/lib/python2.7/site-packages/docker/client.py:120:_get\n/opt/flocker/lib/python2.7/site-packages/requests/sessions.py:487:get\n/opt/flocker/lib/python2.7/site-packages/requests/sessions.py:475:request\n/opt/flocker/lib/python2.7/site-packages/requests/sessions.py:585:send\n/opt/flocker/lib/python2.7/site-packages/requests/adapters.py:453:send\n", "task_uuid": "80407d07-c631-4e52-acae-f154f13e520f", "reason": "('Connection aborted.', error(2, 'No such file or directory'))", "timestamp": 1486108668.518431, "message_type": "eliot:traceback", "task_level": [2, 3]}

Im using flocker ceph rbd plug in, these are the current state :

[root@vm2 ~]# docker volume create -d flocker --name=devops-vol-db -o size=2G -o profile=bronze devops-vol-db

[root@vm2 ~]# docker volume ls DRIVER VOLUME NAME local 9ff52939de1e5a7a5e3d27d5d391fc3cfce06eccd35b9a2e26a467ce550c943a flocker devops-vol-db local f4a1067493964c67b0880f242d6de555c65e7c82422a50393e8860a9a02c4256 [root@vm2 ~]# docker run -it --rm -v devops-vol-db:/opt --entrypoint /bin/sh busybox docker: Error response from daemon: Timed out waiting for dataset to mount..

[root@vm1 ~]# flockerctl --control-service=192.168.10.101 --certs-path=/etc/flocker --user=admin list DATASET SIZE METADATA STATUS SERVER 953997e5-70a3-4e2d-91c1-f1a013c65e0c 2.00G maximum_size=2147483648,name=devops-vol- pending âissing> db,clusterhq:flocker:profile=bronze

There are no issue while connecting ceph rbd with flocker, because i am able to create rbd image from flocker, but failed while to try mounting it from docker.

  1. Docker version 1.12
  2. OS Centos 7 Latest Kernel
  3. flocker flocker-volumes.py prototype version 0.0.1
  4. ceph version 10.2.3 (using loopback device)
jmuhbagir commented 7 years ago

Turn out i forgot to mount docker.sock file, sorry 🙏