search

dask / dask-ec2

Start a cluster in EC2 for dask.distributed
106 stars 37 forks source link

Feature/tag ec2 #76

Closed quasiben closed 7 years ago

quasiben commented 7 years ago

Add tagging options to CLI:

dask-ec2 up --keyname bzaitlen --keypair ~/.ssh/bzaitlen.key --count 2 --tags K:V,K2:V2,billingProject:dask,owner:BenjaminZaitlen --type m4.xlarge

coveralls commented 7 years ago

Coverage Status

Coverage increased (+0.2%) to 74.747% when pulling f1319342cf6497d7b459a68295d19c50a457d516 on feature/tag_ec2 into 660bbac77a0c3dae62adef623eca5bf7ae77551e on master.

coveralls commented 7 years ago

Coverage Status

Coverage increased (+0.2%) to 74.747% when pulling 8eacb372dd1e442dd53f3f916b53f41b05e69d1b on feature/tag_ec2 into 660bbac77a0c3dae62adef623eca5bf7ae77551e on master.

coveralls commented 7 years ago

Coverage Status

Coverage increased (+0.2%) to 74.747% when pulling 28764982fa032bbeb0482ad4c4c1ae86d2a71a56 on feature/tag_ec2 into 660bbac77a0c3dae62adef623eca5bf7ae77551e on master.

quasiben commented 7 years ago

@mrocklin have you had a chance to test?

mrocklin commented 7 years ago

Started a few minutes ago

On Mon, Mar 27, 2017 at 10:20 AM, Benjamin Zaitlen <notifications@github.com

wrote:

@mrocklin https://github.com/mrocklin have you had a chance to test?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/dask/dask-ec2/pull/76#issuecomment-289468202, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszN8qiev2dU8QzLQJesBPSFbCigOFks5rp8W6gaJpZM4MplEi .

mrocklin commented 7 years ago

With a fresh install from this branch it looks like everything is up and running except for the dask-scheculer. SSH-ing in shows that the workers are up but that the scheduler is not running on the head node.

Logs

mrocklin@carbon:~/workspace/dask-ec2$ dask-ec2 up --keyname dask-dev --keypair ~/.ssh/dask-dev.pem --name dask --count 4 --type m4.2xlarge --tags billingProject:dask,owner:mrocklin
DEBUG: Searching for default VPC
DEBUG: Default VPC found - Using VPC ID: vpc-050da361
DEBUG: Searching for default subnet in VPC vpc-050da361
DEBUG: Default subnet found - Using Subnet ID: subnet-32f62d0f
Launching nodes
DEBUG: Checking that keyname 'dask-dev' exists on EC2
DEBUG: Checking that security group 'dask-ec2-default' exists on EC2
DEBUG: Getting all security groups and filtering by VPC ID vpc-050da361 and name dask-ec2-default
DEBUG: Found Security groups: [ec2.SecurityGroup(id='sg-33f6a948')]
DEBUG: Getting all security groups and filtering by VPC ID vpc-050da361 and name dask-ec2-default
DEBUG: Found Security groups: [ec2.SecurityGroup(id='sg-33f6a948')]
DEBUG: Creating 4 instances on EC2
DEBUG: Tagging instance 'i-0f728e8763cd9be4e'
DEBUG: Tagging instance 'i-00e15e34d8a4fe1eb'
DEBUG: Tagging instance 'i-0605123d7fec5faf8'
DEBUG: Tagging instance 'i-0beaa35a15e4d8b42'
Checking SSH connection to nodes
DEBUG: Checking ssh connection for 54.152.154.67
DEBUG: Attempt 1/10 of function 'check_ssh' failed
DEBUG: Checking ssh connection for 54.152.154.67
DEBUG: Attempt 2/10 of function 'check_ssh' failed
DEBUG: Checking ssh connection for 54.152.154.67
DEBUG: Attempt 3/10 of function 'check_ssh' failed
DEBUG: Checking ssh connection for 54.152.154.67
DEBUG: Running command bash -c 'ls' on '54.152.154.67'
DEBUG: Checking ssh connection for 54.209.86.117
DEBUG: Running command bash -c 'ls' on '54.209.86.117'
DEBUG: Checking ssh connection for 54.237.218.174
DEBUG: Running command bash -c 'ls' on '54.237.218.174'
DEBUG: Checking ssh connection for 54.210.174.233
DEBUG: Running command bash -c 'ls' on '54.210.174.233'
+-------------------+-----------+
| Node IP           | SSH check |
+===================+===========+
| 54.152.154.67:22  | True      |
| 54.209.86.117:22  | True      |
| 54.237.218.174:22 | True      |
| 54.210.174.233:22 | True      |
+-------------------+-----------+
Bootstraping salt master
DEBUG: Running command sudo -S bash -c 'curl -sS -L https://bootstrap.saltstack.com | sh -s -- -d -X -M -N stable' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -M -N -P -L -p salt-api stable' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/auto_accept.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/auto_accept.conf' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'apt-get install -y python-pip libssl-dev libffi-dev python-dev' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'pip install --upgrade pip packaging appdirs six' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'pip install cherrypy' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'pip install PyOpenSSL==16.2.0' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'salt-call --local tls.create_self_signed_cert' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/rest_cherrypy.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/rest_cherrypy.conf' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/external_auth.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/master.d/external_auth.conf' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'id -u saltdev &>/dev/null || useradd -p $(openssl passwd -1 saltdev) saltdev' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'service salt-master restart' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'service salt-api restart' on '54.152.154.67'
Bootstraping salt minions
DEBUG: Installing salt-minion on all the nodes
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.152.154.67 -i node-1 stable' on '54.209.86.117'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.152.154.67 -i node-3 stable' on '54.210.174.233'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.152.154.67 -i node-2 stable' on '54.237.218.174'
DEBUG: Running command sudo -S bash -c 'curl -L https://bootstrap.saltstack.com | sh -s -- -d -X -P -L -A 54.152.154.67 -i node-0 stable' on '54.152.154.67'
DEBUG: Configuring salt-mine on the salt minions
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/templates/mine_functions.conf to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.209.86.117'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.237.218.174'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.210.174.233'
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /etc/salt/minion.d/mine.conf' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.209.86.117'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.237.218.174'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.210.174.233'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Restarting the salt-minion service
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.237.218.174'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.210.174.233'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.209.86.117'
DEBUG: Running command sudo -S bash -c 'service salt-minion restart' on '54.152.154.67'
Uploading salt formulas
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt to /srv/salt
DEBUG: Running command sudo -S bash -c 'mkdir -p /srv/salt' on '54.152.154.67'
DEBUG: Creating directory /tmp/.__tmp_copy mode=511
DEBUG: Creating directory /tmp/.__tmp_copy/supervisor mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/supervisor to /tmp/.__tmp_copy/supervisor
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/supervisor' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/supervisor/settings.sls to /tmp/.__tmp_copy/supervisor/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/supervisor/init.sls to /tmp/.__tmp_copy/supervisor/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/java mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java to /tmp/.__tmp_copy/java
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/debug.sls to /tmp/.__tmp_copy/java/debug.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/settings.sls to /tmp/.__tmp_copy/java/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/init.sls to /tmp/.__tmp_copy/java/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/java/openjdk mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk to /tmp/.__tmp_copy/java/openjdk
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java/openjdk' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk/settings.sls to /tmp/.__tmp_copy/java/openjdk/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk/init.sls to /tmp/.__tmp_copy/java/openjdk/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/java/openjdk/templates mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk/templates to /tmp/.__tmp_copy/java/openjdk/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/java/openjdk/templates' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk/templates/java.sh to /tmp/.__tmp_copy/java/openjdk/templates/java.sh
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/java/openjdk/env.sls to /tmp/.__tmp_copy/java/openjdk/env.sls
DEBUG: Creating directory /tmp/.__tmp_copy/dask mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask to /tmp/.__tmp_copy/dask
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask' on '54.152.154.67'
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed to /tmp/.__tmp_copy/dask/distributed
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/debug.sls to /tmp/.__tmp_copy/dask/distributed/debug.sls
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/scheduler mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/scheduler to /tmp/.__tmp_copy/dask/distributed/scheduler
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/scheduler' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/scheduler/init.sls to /tmp/.__tmp_copy/dask/distributed/scheduler/init.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/settings.sls to /tmp/.__tmp_copy/dask/distributed/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/init.sls to /tmp/.__tmp_copy/dask/distributed/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/templates mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/templates to /tmp/.__tmp_copy/dask/distributed/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/templates' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/templates/dask-scheduler.conf to /tmp/.__tmp_copy/dask/distributed/templates/dask-scheduler.conf
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/templates/dask-worker.conf to /tmp/.__tmp_copy/dask/distributed/templates/dask-worker.conf
DEBUG: Creating directory /tmp/.__tmp_copy/dask/distributed/worker mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/worker to /tmp/.__tmp_copy/dask/distributed/worker
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/dask/distributed/worker' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/dask/distributed/worker/init.sls to /tmp/.__tmp_copy/dask/distributed/worker/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter to /tmp/.__tmp_copy/jupyter
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/settings.sls to /tmp/.__tmp_copy/jupyter/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/init.sls to /tmp/.__tmp_copy/jupyter/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter/templates mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/templates to /tmp/.__tmp_copy/jupyter/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter/templates' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/templates/jupyter-notebook.conf to /tmp/.__tmp_copy/jupyter/templates/jupyter-notebook.conf
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/templates/jupyter_notebook_config_py to /tmp/.__tmp_copy/jupyter/templates/jupyter_notebook_config_py
DEBUG: Creating directory /tmp/.__tmp_copy/jupyter/notebook mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/notebook to /tmp/.__tmp_copy/jupyter/notebook
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/jupyter/notebook' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/notebook/settings.sls to /tmp/.__tmp_copy/jupyter/notebook/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/jupyter/notebook/init.sls to /tmp/.__tmp_copy/jupyter/notebook/init.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/top.sls to /tmp/.__tmp_copy/top.sls
DEBUG: Creating directory /tmp/.__tmp_copy/system mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/system to /tmp/.__tmp_copy/system
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/system' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/system/base.sls to /tmp/.__tmp_copy/system/base.sls
DEBUG: Creating directory /tmp/.__tmp_copy/system/templates mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/system/templates to /tmp/.__tmp_copy/system/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/system/templates' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/system/templates/limits.conf to /tmp/.__tmp_copy/system/templates/limits.conf
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/system/macros.sls to /tmp/.__tmp_copy/system/macros.sls
DEBUG: Creating directory /tmp/.__tmp_copy/conda mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda to /tmp/.__tmp_copy/conda
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/conda' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda/debug.sls to /tmp/.__tmp_copy/conda/debug.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda/settings.sls to /tmp/.__tmp_copy/conda/settings.sls
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda/init.sls to /tmp/.__tmp_copy/conda/init.sls
DEBUG: Creating directory /tmp/.__tmp_copy/conda/templates mode=511
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda/templates to /tmp/.__tmp_copy/conda/templates
DEBUG: Running command sudo -S bash -c 'mkdir -p /tmp/.__tmp_copy/conda/templates' on '54.152.154.67'
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/salt/conda/templates/conda.sh to /tmp/.__tmp_copy/conda/templates/conda.sh
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy/* /srv/salt' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Uploading directory /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/pillar to /srv/pillar
DEBUG: Running command sudo -S bash -c 'mkdir -p /srv/pillar' on '54.152.154.67'
DEBUG: Creating directory /tmp/.__tmp_copy mode=511
DEBUG: Uploading file /home/mrocklin/workspace/dask-ec2/dask_ec2/formulas/pillar/top.sls to /tmp/.__tmp_copy/top.sls
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy/* /srv/pillar' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
Uploading conda and cluster settings
DEBUG: Uploading file /tmp/tmprdik79h9 to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /srv/pillar/conda.sls' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
DEBUG: Uploading file /tmp/tmpzmqundri to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /srv/pillar/cluster.sls' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
+---------+----------------------+-----------------+
| Node ID | # Successful actions | # Failed action |
+=========+======================+=================+
| node-1  | 6                    | 0               |
+---------+----------------------+-----------------+
DEBUG: Uploading file /tmp/tmp4_on1h87 to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /srv/pillar/dask.sls' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
Installing scheduler
2+---------+----------------------+-----------------+
| Node ID | # Successful actions | # Failed action |
+=========+======================+=================+
| node-0  | 20                   | 0               |
+---------+----------------------+-----------------+
Installing workers
+---------+----------------------+-----------------+
| Node ID | # Successful actions | # Failed action |
+=========+======================+=================+
| node-1  | 20                   | 0               |
+---------+----------------------+-----------------+
Dask.Distributed Installation succeeded

Addresses
---------
Web Interface:    http://54.152.154.67:8787/status
TCP Interface:           54.152.154.67:8786

To connect from the cluster
---------------------------

dask-ec2 ssh  # ssh into head node
ipython  # start ipython shell

from dask.distributed import Client, progress
c = Client(127.0.0.1:8786')  # Connect to scheduler running on the head node

To connect locally
------------------

Note: this requires you to have identical environments on your local machine and cluster.

ipython  # start ipython shell

from dask.distributed import Client, progress
e = Client('54.152.154.67:8786')  # Connect to scheduler running on the head node

To destroy
----------

dask-ec2 destroy
Installing Jupyter notebook on the head node
DEBUG: Uploading file /tmp/tmpzpsmso6x to /tmp/.__tmp_copy
DEBUG: Running command sudo -S bash -c 'cp -rf /tmp/.__tmp_copy /srv/pillar/jupyter.sls' on '54.152.154.67'
DEBUG: Running command sudo -S bash -c 'rm -rf /tmp/.__tmp_copy' on '54.152.154.67'
+---------+----------------------+-----------------+
| Node ID | # Successful actions | # Failed action |
+=========+======================+=================+
| node-0  | 17                   | 0               |
+---------+----------------------+-----------------+
Jupyter notebook available at http://54.152.154.67:8888/
quasiben commented 7 years ago

Hmm, I'll debug a bit and get back

quasiben commented 7 years ago

@mrocklin the issue should be fixed. Can you try again ?

coveralls commented 7 years ago

Coverage Status

Coverage increased (+0.2%) to 74.747% when pulling 39af11a2c2e35c50da8bc2e100e8fa65e4a5cd27 on feature/tag_ec2 into 660bbac77a0c3dae62adef623eca5bf7ae77551e on master.