search

dask / dask-ec2

Start a cluster in EC2 for dask.distributed
106 stars 37 forks source link

Failed states on dask-ec2 up #22

Closed mrocklin closed 8 years ago

mrocklin commented 8 years ago

@danielfrg 

mrocklin@notebook:~$ dask-ec2 up --keyname mrocklin --keypair ~/.ssh/anaconda-cluster.pem --name dask --type m4.2xlarge --count 10 --no-dask --anaconda
Launching nodes
DEBUG: Checking that keyname 'mrocklin' exists on EC2
DEBUG: Checking that security group 'dask-ec2-default' exists on EC2
DEBUG: Creating 10 instances on EC2
DEBUG: Tagging instance 'i-e6383860'
DEBUG: Tagging instance 'i-e7383861'
DEBUG: Tagging instance 'i-e4383862'
DEBUG: Tagging instance 'i-e5383863'
DEBUG: Tagging instance 'i-e0383866'
DEBUG: Tagging instance 'i-ef383869'
DEBUG: Tagging instance 'i-ea38386c'
DEBUG: Tagging instance 'i-eb38386d'
DEBUG: Tagging instance 'i-e838386e'
DEBUG: Tagging instance 'i-e938386f'
Checking SSH connection to nodes
DEBUG: Checking ssh connection for 54.198.166.234
DEBUG: Attempt 1/10 of function 'check_ssh' failed
DEBUG: Checking ssh connection for 54.198.166.234
DEBUG: Running command bash -c 'ls' on '54.198.166.234'
DEBUG: Checking ssh connection for 54.174.132.155
DEBUG: Running command bash -c 'ls' on '54.174.132.155'
DEBUG: Checking ssh connection for 54.237.196.140
DEBUG: Running command bash -c 'ls' on '54.237.196.140'
DEBUG: Checking ssh connection for 54.237.202.33
DEBUG: Running command bash -c 'ls' on '54.237.202.33'
DEBUG: Checking ssh connection for 54.198.219.79
DEBUG: Running command bash -c 'ls' on '54.198.219.79'
DEBUG: Checking ssh connection for 54.237.196.167
DEBUG: Running command bash -c 'ls' on '54.237.196.167'
DEBUG: Checking ssh connection for 54.235.231.162
DEBUG: Running command bash -c 'ls' on '54.235.231.162'
DEBUG: Checking ssh connection for 54.224.65.71
DEBUG: Running command bash -c 'ls' on '54.224.65.71'
DEBUG: Checking ssh connection for 54.237.196.172
DEBUG: Running command bash -c 'ls' on '54.237.196.172'
DEBUG: Checking ssh connection for 54.237.200.199
DEBUG: Running command bash -c 'ls' on '54.237.200.199'
+-------------------+-----------+
| Node IP           | SSH check |
+===================+===========+
| 54.237.196.167:22 | True      |
| 54.237.202.33:22  | True      |
| 54.237.200.199:22 | True      |
| 54.237.196.140:22 | True      |
| 54.237.196.172:22 | True      |
| 54.198.219.79:22  | True      |
| 54.224.65.71:22   | True      |
| 54.198.166.234:22 | True      |
| 54.235.231.162:22 | True      |
| 54.174.132.155:22 | True      |
+-------------------+-----------+
Bootstraping salt master
DEBUG: Running command sudo -S bash -c 'curl -sS -L https://bootstrap.saltstack.com | sh -s -- -d -X -M -N stable' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -M -N -P -L -p salt-api stable' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/auto_accept.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/auto_accept.conf' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'pip install cherrypy' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'pip install PyOpenSSL' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'salt-call --local tls.create_self_signed_cert' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/rest_cherrypy.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/rest_cherrypy.conf' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/external_auth.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/external_auth.conf' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'id -u saltdev &>/dev/null || useradd -p $(openssl passwd -1 saltdev) saltdev' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'service salt-master restart' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'service salt-api restart' on '54.198.166.234'
Bootstraping salt minions
DEBUG: Installing salt-minion on all the nodes
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-3 stable' on '54.237.202.33'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-4 stable' on '54.198.219.79'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-2 stable' on '54.237.196.140'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-1 stable' on '54.174.132.155'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-0 stable' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-7 stable' on '54.224.65.71'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-9 stable' on '54.237.200.199'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-5 stable' on '54.237.196.167'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-8 stable' on '54.237.196.172'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.198.166.234 -i node-6 stable' on '54.235.231.162'
DEBUG: Configuring salt-mine on the salt minions
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.196.167'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.196.172'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.224.65.71'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.174.132.155'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.202.33'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.198.219.79'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.196.140'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.200.199'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.235.231.162'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.196.167'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.196.172'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.224.65.71'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.174.132.155'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.219.79'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.202.33'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.196.140'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.200.199'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.235.231.162'
DEBUG: Restarting the salt-minion service
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.198.219.79'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.200.199'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.196.167'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.202.33'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.174.132.155'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.196.140'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.224.65.71'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.235.231.162'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.196.172'
Uploading salt formulas
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt to /srv/salt
DEBUG: Running command sudo -S bash -c 'mkdir -p /srv/salt' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy mode=511
DEBUG: Creating directory /tmp/.__tmp_copy/supervisor mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/supervisor to /tmp/.__tmp_copy/supervisor
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/supervisor' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/supervisor/settings.sls to /tmp/.__tmp_copy/supervisor/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/supervisor/init.sls to /tmp/.__tmp_copy/supervisor/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/system mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/system to /tmp/.__tmp_copy/system
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/system' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/system/templates mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/system/templates to /tmp/.__tmp_copy/system/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/system/templates' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/system/templates/limits.conf to /tmp/.__tmp_copy/system/templates/limits.conf
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/system/macros.sls to /tmp/.__tmp_copy/system/macros.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/system/base.sls to /tmp/.__tmp_copy/system/base.sls
DEBUG: Creating directory /tmp/.__tmp_copy/java mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java to /tmp/.__tmp_copy/java
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/java/openjdk mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk to /tmp/.__tmp_copy/java/openjdk
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java/openjdk' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk/env.sls to /tmp/.__tmp_copy/java/openjdk/env.sls
DEBUG: Creating directory /tmp/.__tmp_copy/java/openjdk/templates mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk/templates to /tmp/.__tmp_copy/java/openjdk/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java/openjdk/templates' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk/templates/java.sh to /tmp/.__tmp_copy/java/openjdk/templates/java.sh
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk/settings.sls to /tmp/.__tmp_copy/java/openjdk/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/openjdk/init.sls to /tmp/.__tmp_copy/java/openjdk/init.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/settings.sls to /tmp/.__tmp_copy/java/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/debug.sls to /tmp/.__tmp_copy/java/debug.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/java/init.sls to /tmp/.__tmp_copy/java/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter to /tmp/.__tmp_copy/jupyter
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter/templates mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/templates to /tmp/.__tmp_copy/jupyter/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter/templates' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/templates/jupyter-notebook.conf to /tmp/.__tmp_copy/jupyter/templates/jupyter-notebook.conf
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/settings.sls to /tmp/.__tmp_copy/jupyter/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/init.sls to /tmp/.__tmp_copy/jupyter/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter/notebook mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/notebook to /tmp/.__tmp_copy/jupyter/notebook
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter/notebook' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/jupyter/notebook/init.sls to /tmp/.__tmp_copy/jupyter/notebook/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/conda mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda to /tmp/.__tmp_copy/conda
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/conda' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/conda/templates mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda/templates to /tmp/.__tmp_copy/conda/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/conda/templates' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda/templates/conda.sh to /tmp/.__tmp_copy/conda/templates/conda.sh
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda/settings.sls to /tmp/.__tmp_copy/conda/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda/debug.sls to /tmp/.__tmp_copy/conda/debug.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/conda/init.sls to /tmp/.__tmp_copy/conda/init.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/top.sls to /tmp/.__tmp_copy/top.sls
DEBUG: Creating directory /tmp/.__tmp_copy/dask mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask to /tmp/.__tmp_copy/dask
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed to /tmp/.__tmp_copy/dask/distributed
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/worker mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/worker to /tmp/.__tmp_copy/dask/distributed/worker
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/worker' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/worker/init.sls to /tmp/.__tmp_copy/dask/distributed/worker/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/templates mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/templates to /tmp/.__tmp_copy/dask/distributed/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/templates' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/templates/dworker.conf to /tmp/.__tmp_copy/dask/distributed/templates/dworker.conf
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/templates/dscheduler.conf to /tmp/.__tmp_copy/dask/distributed/templates/dscheduler.conf
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/scheduler mode=511
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/scheduler to /tmp/.__tmp_copy/dask/distributed/scheduler
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/scheduler' on '54.198.166.234'
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/scheduler/init.sls to /tmp/.__tmp_copy/dask/distributed/scheduler/init.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/settings.sls to /tmp/.__tmp_copy/dask/distributed/settings.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/debug.sls to /tmp/.__tmp_copy/dask/distributed/debug.sls
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/salt/dask/distributed/init.sls to /tmp/.__tmp_copy/dask/distributed/init.sls
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy/* /srv/salt' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
DEBUG: Uploading directory /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/pillar to /srv/pillar
DEBUG: Running command sudo -S bash -c 'mkdir -p /srv/pillar' on '54.198.166.234'
DEBUG: Creating directory /tmp/.__tmp_copy mode=511
DEBUG: Uploading file /home/mrocklin/Software/anaconda/lib/python3.5/site-packages/dask_ec2-0.2.0+6.g85c14de-py3.5.egg/dask_ec2/formulas/pillar/top.sls to /tmp/.__tmp_copy/top.sls
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy/* /srv/pillar' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
Uploading conda settings
DEBUG: Uploading file /tmp/tmpn7x_nwn_ to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /srv/pillar/conda.sls' on '54.198.166.234'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.198.166.234'
+------------------------------+----------------------+-----------------+
| Node ID                      | # Successful actions | # Failed action |
+==============================+======================+=================+
| node-8                       | 1                    | 5               |
| node-6                       | 1                    | 5               |
| node-2                       | 1                    | 5               |
| node-4                       | 1                    | 5               |
| node-7                       | 1                    | 5               |
| node-0                       | 1                    | 5               |
| ip-172-31-3-211.ec2.internal | 1                    | 5               |
| ip-172-31-3-205.ec2.internal | 1                    | 5               |
| node-1                       | 1                    | 5               |
| node-5                       | 1                    | 5               |
+------------------------------+----------------------+-----------------+
Failed states for 'node-8'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-6'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-2'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-4'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-7'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-0'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'ip-172-31-3-211.ec2.internal'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'ip-172-31-3-205.ec2.internal'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-1'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Failed states for 'node-5'
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
Installing Jupyter notebook on the head node
+------------------------------+----------------------+-----------------+
| Node ID                      | # Successful actions | # Failed action |
+==============================+======================+=================+
| node-8                       | 5                    | 8               |
| node-6                       | 5                    | 8               |
| node-2                       | 5                    | 8               |
| node-4                       | 5                    | 8               |
| node-7                       | 5                    | 8               |
| node-0                       | 5                    | 8               |
| ip-172-31-3-211.ec2.internal | 5                    | 8               |
| ip-172-31-3-205.ec2.internal | 5                    | 8               |
| node-1                       | 5                    | 8               |
| node-5                       | 5                    | 8               |
+------------------------------+----------------------+-----------------+
Failed states for 'node-8'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-6'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-2'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-4'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-7'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-0'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'ip-172-31-3-211.ec2.internal'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'ip-172-31-3-205.ec2.internal'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-1'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Failed states for 'node-5'
  supervisord | notebook-running | jupyter-notebook | running: jupyter-notebook: ERROR (no such file)
  cmd | jupyter-install | /opt/anaconda//bin/conda install jupyter -y -q | run: One or more requisite failed: conda.remove-anconda, conda./etc/profile.d/conda.sh, conda.miniconda-install, conda.miniconda-pip, conda.miniconda-download
  cmd | miniconda-download | curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh | run: Command "curl https://repo.continuum.io/archive/Anaconda3-2.5.0-Linux-x86_64.sh > /tmp/miniconda.sh" run
  cmd | miniconda-pip | /opt/anaconda//bin/conda install pip -y -q | run: One or more requisite failed: conda.miniconda-install
  cmd | miniconda-install | bash /tmp/miniconda.sh -b -p /opt/anaconda/ | run: One or more requisite failed: conda.miniconda-download
  file | /etc/profile.d/conda.sh | /etc/profile.d/conda.sh | managed: One or more requisite failed: conda.miniconda-install
  cmd | remove-anconda | /opt/anaconda//bin/conda remove anaconda || true | run: One or more requisite failed: conda.miniconda-install
  cmd | notebook-restart-if-change | /usr/bin/supervisorctl -c /etc/supervisor/supervisord.conf restart jupyter-notebook | wait: One or more requisite failed: jupyter.jupyter-install
Jupyter notebook available at http://54.198.166.234:8888/
mrocklin@notebook:~$
danielfrg commented 8 years ago

I looks like it could not download anaconda from repo.continuum.io Maybe it was down for a minute? Is this a recurring issue?

mrocklin commented 8 years ago

I haven't been able to get it to work the last few times I tried

danielfrg commented 8 years ago

ok, taking a look now

danielfrg commented 8 years ago

Can you try master now, this should be fixed.

mrocklin commented 8 years ago

Confirmed fixed

mrocklin commented 8 years ago

Thank you @danielfrg !