coiled / feedback

A place to provide Coiled feedback
14 stars 3 forks source link

trouble running coiled on the cloud #265

Open taupirho opened 6 months ago

taupirho commented 6 months ago

Hi, I signed up to Coiled and went through the process to connect to my AWS account etc ... The CloudFormation stack seemed to create OK and all looked good. However, when I tried the "echo hello world" example I received the following error. I'm running on Windows 11 Desktop.

(base) C:\Users\thoma>coiled run echo "Hello, world" C:\Users\thoma\anaconda3\Lib\site-packages\paramiko\transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated "class": algorithms.Blowfish, ╭──────────────────────── Running echo 'Hello, world' ─────────────────────────╮ │ │ │ Details: .. │ │ │ │ Scanning Environment ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ │ │ │ │ Region: .. Uptime: 0 │ │ VM Type: .. Approx cloud cost: $0.00/hr │ │ Total cost: $0.00 │ │ │ ╰──────────────────────────────────────────────────────────────────────────────╯ Traceback (most recent call last): File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 980, in _wrap_create_connection return await self._loop.create_connection(*args, **kwargs) # type: ignore[return-value] # noqa ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\asyncio\base_events.py", line 1085, in create_connection raise exceptions[0] File "C:\Users\thoma\anaconda3\Lib\asyncio\base_events.py", line 1069, in create_connection sock = await self._connect_sock( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\asyncio\base_events.py", line 973, in _connect_sock await self.sock_connect(sock, address) File "C:\Users\thoma\anaconda3\Lib\asyncio\selector_events.py", line 634, in sock_connect return await fut ^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\asyncio\selector_events.py", line 674, in _sock_connect_cb raise OSError(err, f'Connect call failed {address}') TimeoutError: [Errno 10060] Connect call failed ('18.164.68.57', 443)

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "C:\Users\thoma\anaconda3\Scripts\coiled.exe__main.py", line 7, in File "C:\Users\thoma\anaconda3\Lib\site-packages\click\core.py", line 1128, in call return self.main(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\click\core.py", line 1053, in main rv = self.invoke(ctx) ^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\click\core.py", line 1659, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\click\core.py", line 1395, in invoke return ctx.invoke(self.callback, ctx.params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\click\core.py", line 754, in invoke return callback(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\cli\run.py", line 274, in run start_run( File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\cli\run.py", line 419, in start_run coiled.add_interaction( File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\core.py", line 2927, in add_interaction with Cloud() as cloud: ^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\core.py", line 314, in init self._sync(self._start) File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\core.py", line 537, in _sync return cast(_T, sync(self.loop, func, *args, *kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\distributed\utils.py", line 418, in sync raise exc.with_traceback(tb) File "C:\Users\thoma\anaconda3\Lib\site-packages\distributed\utils.py", line 391, in f result = yield future ^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\tornado\gen.py", line 767, in run value = future.result() ^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\context.py", line 112, in async_wrapper return await func(args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\core.py", line 417, in _start self.user, self.token, self.server, memberships = await handle_credentials( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\utils.py", line 395, in handle_credentials user_dict = await _fetch_data( ^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\backoff_async.py", line 151, in retry ret = await target(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\coiled\utils.py", line 299, in _fetch_data response = await session.request("GET", f"{server}{endpoint}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\client.py", line 536, in _request conn = await self._connector.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 540, in connect proto = await self._create_connection(req, traces, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 901, in _createconnection , proto = await self._create_direct_connection(req, traces, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 1209, in _create_direct_connection raise last_exc File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 1178, in _create_direct_connection transp, proto = await self._wrap_create_connection( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\thoma\anaconda3\Lib\site-packages\aiohttp\connector.py", line 988, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host cloud.coiled.io:443 ssl:default [Connect call failed ('18.164.68.57', 443)]

taupirho commented 6 months ago

I decided to create a brand new Python environment using conda and tried again. This is the list of packages that were installed

(py312) PS C:\Users\thoma> conda list

packages in environment at C:\Users\thoma\anaconda3\envs\py312:

#

Name Version Build Channel

bzip2 1.0.8 he774522_0 ca-certificates 2023.08.22 haa95532_0 expat 2.5.0 hd77b12b_0 libffi 3.4.4 hd77b12b_0 openssl 3.0.12 h2bbff1b_0 pip 23.3.1 py312haa95532_0 python 3.12.0 h1d929f7_0 setuptools 68.2.2 py312haa95532_0 sqlite 3.41.2 h2bbff1b_0 tk 8.6.12 h2bbff1b_0 tzdata 2023c h04d1e81_0 vc 14.2 h21ff451_1 vs2015_runtime 14.27.29016 h5e58377_2 wheel 0.41.2 py312haa95532_0 xz 5.4.5 h8cc25b3_0 zlib 1.2.13 h8cc25b3_0

Unfortunately, I received the same error messages using this new environment as before

phofl commented 6 months ago

Hi,

Thanks for trying out Coiled!

Could you give me your coiled account so that I can look into what went wrong exactly?

The second environment looks a bit strange, coiled is missing in there for example. Did you activate this environment before booting the new cluster?

taupirho commented 6 months ago

I created the second env and just ran the colied.exe that was created in the first env. What should I have done?

I'm actually having some trouble logging in to coil. Each time I've tried this morning I get

This site can’t be reached cloud.coiled.io took too long to respond. Try:

Checking the connection Checking the proxy and the firewall [Running Windows Network Diagnostics](javascript:diagnoseErrors()) ERR_CONNECTION_TIMED_OUT

When I created my account initially I used Google to log in. My email is thomas.reid@gmail.com

taupirho commented 6 months ago

Ok, I created a new environment like this

(py312) PS C:\Users\thoma> conda create -n coiled-dataframe -c conda-forge python=3.10 coiled dask s3fs Collecting package metadata (current_repodata.json): done Solving environment: unsuccessful attempt using repodata from current_repodata.json, retrying with next repodata source. Collecting package metadata (repodata.json): done Solving environment: done

==> WARNING: A newer version of conda exists. <== current version: 23.7.4 latest version: 23.11.0

Please update conda by running

$ conda update -n base -c defaults conda

Or to minimize the number of packages updated during conda update use

 conda install conda=23.11.0

Package Plan

environment location: C:\Users\thoma\anaconda3\envs\coiled-dataframe

added / updated specs:

The following packages will be downloaded:

package                    |            build
---------------------------|-----------------
aiobotocore-2.9.0          |     pyhd8ed1ab_0          64 KB  conda-forge
aiohttp-3.9.1              |  py310h8d17308_0         630 KB  conda-forge
aioitertools-0.11.0        |     pyhd8ed1ab_0          22 KB  conda-forge
aiosignal-1.3.1            |     pyhd8ed1ab_0          12 KB  conda-forge
anyio-4.1.0                |     pyhd8ed1ab_0          98 KB  conda-forge
asttokens-2.4.1            |     pyhd8ed1ab_0          28 KB  conda-forge
async-timeout-4.0.3        |     pyhd8ed1ab_0          11 KB  conda-forge
attrs-23.1.0               |     pyh71513ae_1          54 KB  conda-forge
aws-c-auth-0.7.8           |       hfc12bfc_2          97 KB  conda-forge
aws-c-cal-0.6.9            |       h7f0e5be_2          54 KB  conda-forge
aws-c-common-0.9.10        |       hcfcfb64_0         216 KB  conda-forge
aws-c-compression-0.2.17   |       h7f0e5be_7          22 KB  conda-forge
aws-c-event-stream-0.3.2   |       h51e6447_8          53 KB  conda-forge
aws-c-http-0.7.14          |       h80119a0_3         176 KB  conda-forge
aws-c-io-0.13.36           |       ha737126_2         155 KB  conda-forge
aws-c-mqtt-0.10.0          |       hd6138de_0         154 KB  conda-forge
aws-c-s3-0.4.5             |       h885c6ba_0          97 KB  conda-forge
aws-c-sdkutils-0.1.13      |       h7f0e5be_0          50 KB  conda-forge
aws-checksums-0.1.17       |       h7f0e5be_6          51 KB  conda-forge
aws-crt-cpp-0.25.0         |       h55010f6_2         236 KB  conda-forge
aws-sdk-cpp-1.11.210       |       h0441c79_5         3.1 MB  conda-forge
backoff-2.2.1              |     pyhd8ed1ab_0          17 KB  conda-forge
bcrypt-4.1.2               |  py310h87d50f1_0         148 KB  conda-forge
bokeh-3.3.2                |     pyhd8ed1ab_0         4.4 MB  conda-forge
boto3-1.33.13              |     pyhd8ed1ab_0          79 KB  conda-forge
botocore-1.33.13           |     pyhd8ed1ab_0         6.5 MB  conda-forge
brotli-python-1.1.0        |  py310h00ffb61_1         314 KB  conda-forge
bzip2-1.0.8                |       hcfcfb64_5         122 KB  conda-forge
c-ares-1.24.0              |       hcfcfb64_0         145 KB  conda-forge
ca-certificates-2023.11.17 |       h56e8100_0         151 KB  conda-forge
certifi-2023.11.17         |     pyhd8ed1ab_0         155 KB  conda-forge
cffi-1.16.0                |  py310h8d17308_0         232 KB  conda-forge
click-8.1.7                | win_pyh7428d3b_0          83 KB  conda-forge
cloudpickle-3.0.0          |     pyhd8ed1ab_0          24 KB  conda-forge
coiled-1.2.0               |     pyhd8ed1ab_0         146 KB  conda-forge
colorama-0.4.6             |     pyhd8ed1ab_0          25 KB  conda-forge
comm-0.1.4                 |     pyhd8ed1ab_0          11 KB  conda-forge
contourpy-1.2.0            |  py310h232114e_0         186 KB  conda-forge
cryptography-41.0.7        |  py310hb1f9477_1         1.0 MB  conda-forge
cytoolz-0.12.2             |  py310h8d17308_1         289 KB  conda-forge
dask-2023.12.1             |     pyhd8ed1ab_0           7 KB  conda-forge
dask-core-2023.12.1        |     pyhd8ed1ab_0         846 KB  conda-forge
decorator-5.1.1            |     pyhd8ed1ab_0          12 KB  conda-forge
deprecated-1.2.14          |     pyh1a96a4e_0          14 KB  conda-forge
distributed-2023.12.1      |     pyhd8ed1ab_0         769 KB  conda-forge
exceptiongroup-1.2.0       |     pyhd8ed1ab_0          20 KB  conda-forge
executing-2.0.1            |     pyhd8ed1ab_0          27 KB  conda-forge
fabric-3.2.2               |     pyhd8ed1ab_0          53 KB  conda-forge
filelock-3.13.1            |     pyhd8ed1ab_0          15 KB  conda-forge
freetype-2.12.1            |       hdaf720e_2         498 KB  conda-forge
frozenlist-1.4.1           |  py310h8d17308_0          52 KB  conda-forge
fsspec-2023.12.2           |     pyhca7485f_0         124 KB  conda-forge
gilknocker-0.4.1           |  py310he2c049f_3         148 KB  conda-forge
h11-0.14.0                 |     pyhd8ed1ab_0          47 KB  conda-forge
h2-4.1.0                   |     pyhd8ed1ab_0          46 KB  conda-forge
hpack-4.0.0                |     pyh9f0ad1d_0          25 KB  conda-forge
httpcore-1.0.2             |     pyhd8ed1ab_0          44 KB  conda-forge
httpx-0.25.2               |     pyhd8ed1ab_0          63 KB  conda-forge
hyperframe-6.0.1           |     pyhd8ed1ab_0          14 KB  conda-forge
idna-3.6                   |     pyhd8ed1ab_0          49 KB  conda-forge
importlib-metadata-7.0.0   |     pyha770c72_0          25 KB  conda-forge
importlib_metadata-7.0.0   |       hd8ed1ab_0           9 KB  conda-forge
intel-openmp-2023.2.0      |   h57928b3_50497         2.4 MB  conda-forge
invoke-2.2.0               |     pyhd8ed1ab_0         129 KB  conda-forge
ipython-8.18.1             |     pyh7428d3b_3         576 KB  conda-forge
ipywidgets-8.1.1           |     pyhd8ed1ab_0         111 KB  conda-forge
jedi-0.19.1                |     pyhd8ed1ab_0         822 KB  conda-forge
jinja2-3.1.2               |     pyhd8ed1ab_1          99 KB  conda-forge
jmespath-1.0.1             |     pyhd8ed1ab_0          21 KB  conda-forge
jsondiff-2.0.0             |     pyhd8ed1ab_0          10 KB  conda-forge
jupyterlab_widgets-3.0.9   |     pyhd8ed1ab_0         182 KB  conda-forge
krb5-1.21.2                |       heb0366b_0         694 KB  conda-forge
lcms2-2.16                 |       h67d730c_0         496 KB  conda-forge
lerc-4.0.0                 |       h63175ca_0         190 KB  conda-forge
libabseil-20230802.1       | cxx17_h63175ca_0         1.7 MB  conda-forge
libarrow-14.0.1            |  h1048771_10_cpu         4.7 MB  conda-forge
libarrow-acero-14.0.1      |  h63175ca_10_cpu         421 KB  conda-forge
libarrow-dataset-14.0.1    |  h63175ca_10_cpu         419 KB  conda-forge
libarrow-flight-14.0.1     |  h53b1db0_10_cpu         281 KB  conda-forge
libarrow-flight-sql-14.0.1 |  h78eab7c_10_cpu         219 KB  conda-forge
libarrow-gandiva-14.0.1    |  hb2eaab1_10_cpu         9.7 MB  conda-forge
libarrow-substrait-14.0.1  |  hd4c9904_10_cpu         340 KB  conda-forge
libblas-3.9.0              |     20_win64_mkl         4.8 MB  conda-forge
libbrotlicommon-1.1.0      |       hcfcfb64_1          69 KB  conda-forge
libbrotlidec-1.1.0         |       hcfcfb64_1          32 KB  conda-forge
libbrotlienc-1.1.0         |       hcfcfb64_1         241 KB  conda-forge
libcblas-3.9.0             |     20_win64_mkl         4.8 MB  conda-forge
libcrc32c-1.1.2            |       h0e60522_0          25 KB  conda-forge
libcurl-8.5.0              |       hd5e4a3a_0         316 KB  conda-forge
libdeflate-1.19            |       hcfcfb64_0         150 KB  conda-forge
libevent-2.1.12            |       h3671451_1         401 KB  conda-forge
libffi-3.4.2               |       h8ffe710_5          41 KB  conda-forge
libgoogle-cloud-2.12.0     |       h39f2fc6_4          13 KB  conda-forge
libgrpc-1.59.3             |       h5bbd4a7_0        13.6 MB  conda-forge
libhwloc-2.9.3             |default_haede6df_1009         2.5 MB  conda-forge
libiconv-1.17              |       hcfcfb64_2         621 KB  conda-forge
libjpeg-turbo-3.0.0        |       hcfcfb64_1         804 KB  conda-forge
liblapack-3.9.0            |     20_win64_mkl         4.8 MB  conda-forge
libparquet-14.0.1          |  h7ec3a38_10_cpu         765 KB  conda-forge
libpng-1.6.39              |       h19919ed_0         336 KB  conda-forge
libprotobuf-4.24.4         |       hb8276f3_0         5.0 MB  conda-forge
libre2-11-2023.06.02       |       h8c5ae5e_0         248 KB  conda-forge
libsqlite-3.44.2           |       hcfcfb64_0         833 KB  conda-forge
libssh2-1.11.0             |       h7dfc565_0         261 KB  conda-forge
libthrift-0.19.0           |       ha2b3283_1         598 KB  conda-forge
libtiff-4.6.0              |       h6e2ebb7_2         769 KB  conda-forge
libutf8proc-2.8.0          |       h82a8f57_0         102 KB  conda-forge
libwebp-base-1.3.2         |       hcfcfb64_0         263 KB  conda-forge
libxcb-1.15                |       hcd874cb_0         947 KB  conda-forge
libxml2-2.11.6             |       hc3477c8_0         1.6 MB  conda-forge
libzlib-1.2.13             |       hcfcfb64_5          54 KB  conda-forge
locket-1.0.0               |     pyhd8ed1ab_0           8 KB  conda-forge
lz4-4.3.2                  |  py310hbbb2075_1          73 KB  conda-forge
lz4-c-1.9.4                |       hcfcfb64_0         131 KB  conda-forge
m2w64-gcc-libgfortran-5.3.0|                6         342 KB  conda-forge
m2w64-gcc-libs-5.3.0       |                7         520 KB  conda-forge
m2w64-gcc-libs-core-5.3.0  |                7         214 KB  conda-forge
m2w64-gmp-6.1.0            |                2         726 KB  conda-forge
m2w64-libwinpthread-git-5.0.0.4634.697f757|                2          31 KB  conda-forge
markdown-it-py-3.0.0       |     pyhd8ed1ab_0          63 KB  conda-forge
markupsafe-2.1.3           |  py310h8d17308_1          26 KB  conda-forge
matplotlib-inline-0.1.6    |     pyhd8ed1ab_0          12 KB  conda-forge
mdurl-0.1.0                |     pyhd8ed1ab_0          13 KB  conda-forge
mkl-2023.2.0               |   h6a75c08_50497       138.0 MB  conda-forge
msgpack-python-1.0.7       |  py310h232114e_0         180 KB  conda-forge
msys2-conda-epoch-20160418 |                1           3 KB  conda-forge
multidict-6.0.4            |  py310h8d17308_1          51 KB  conda-forge
numpy-1.26.2               |  py310hf667824_0         5.7 MB  conda-forge
openjpeg-2.5.0             |       h3d672ee_3         231 KB  conda-forge
openssl-3.2.0              |       hcfcfb64_1         7.9 MB  conda-forge
orc-1.9.2                  |       hf0b6bd4_0         864 KB  conda-forge
packaging-23.2             |     pyhd8ed1ab_0          48 KB  conda-forge
pandas-2.1.4               |  py310hecd3228_0        10.8 MB  conda-forge
paramiko-3.3.1             |     pyhd8ed1ab_0         155 KB  conda-forge
parso-0.8.3                |     pyhd8ed1ab_0          69 KB  conda-forge
partd-1.4.1                |     pyhd8ed1ab_0          20 KB  conda-forge
pickleshare-0.7.5          |          py_1003           9 KB  conda-forge
pillow-10.1.0              |  py310h1e6a543_0        43.0 MB  conda-forge
pip-23.3.2                 |     pyhd8ed1ab_0         1.3 MB  conda-forge
pip-requirements-parser-32.0.1|     pyhd8ed1ab_0         111 KB  conda-forge
prometheus_client-0.19.0   |     pyhd8ed1ab_0          47 KB  conda-forge
prompt-toolkit-3.0.42      |     pyha770c72_0         264 KB  conda-forge
psutil-5.9.7               |  py310h8d17308_0         373 KB  conda-forge
pthread-stubs-0.4          |    hcd874cb_1001           6 KB  conda-forge
pthreads-win32-2.9.1       |       hfa6e2cd_3         141 KB  conda-forge
pure_eval-0.2.2            |     pyhd8ed1ab_0          14 KB  conda-forge
pyarrow-14.0.1             |py310hd0bb7c2_10_cpu         3.2 MB  conda-forge
pyarrow-hotfix-0.6         |     pyhd8ed1ab_0          13 KB  conda-forge
pycparser-2.21             |     pyhd8ed1ab_0         100 KB  conda-forge
pygments-2.17.2            |     pyhd8ed1ab_0         840 KB  conda-forge
pynacl-1.5.0               |  py310h635b8f1_3         1.2 MB  conda-forge
pyparsing-3.1.1            |     pyhd8ed1ab_0          87 KB  conda-forge
pysocks-1.7.1              |     pyh0701188_6          19 KB  conda-forge
python-3.10.13             |h4de0772_0_cpython        15.2 MB  conda-forge
python-dateutil-2.8.2      |     pyhd8ed1ab_0         240 KB  conda-forge
python-tzdata-2023.3       |     pyhd8ed1ab_0         140 KB  conda-forge
python_abi-3.10            |          4_cp310           7 KB  conda-forge
pytz-2023.3.post1          |     pyhd8ed1ab_0         183 KB  conda-forge
pyyaml-6.0.1               |  py310h8d17308_1         143 KB  conda-forge
re2-2023.06.02             |       hcbb65ff_0         199 KB  conda-forge
rich-13.7.0                |     pyhd8ed1ab_0         180 KB  conda-forge
s3fs-2023.12.2             |     pyhd8ed1ab_0          31 KB  conda-forge
s3transfer-0.8.2           |     pyhd8ed1ab_0          61 KB  conda-forge
setuptools-68.2.2          |     pyhd8ed1ab_0         454 KB  conda-forge
six-1.16.0                 |     pyh6c4a22f_0          14 KB  conda-forge
snappy-1.1.10              |       hfb803bf_0          56 KB  conda-forge
sniffio-1.3.0              |     pyhd8ed1ab_0          14 KB  conda-forge
sortedcontainers-2.4.0     |     pyhd8ed1ab_0          26 KB  conda-forge
stack_data-0.6.2           |     pyhd8ed1ab_0          26 KB  conda-forge
tbb-2021.11.0              |       h91493d7_0         157 KB  conda-forge
tblib-3.0.0                |     pyhd8ed1ab_0          17 KB  conda-forge
tk-8.6.13                  |       h5226925_1         3.3 MB  conda-forge
toml-0.10.2                |     pyhd8ed1ab_0          18 KB  conda-forge
toolz-0.12.0               |     pyhd8ed1ab_0          48 KB  conda-forge
tornado-6.3.3              |  py310h8d17308_1         630 KB  conda-forge
traitlets-5.14.0           |     pyhd8ed1ab_0         107 KB  conda-forge
typing-extensions-4.9.0    |       hd8ed1ab_0          10 KB  conda-forge
typing_extensions-4.9.0    |     pyha770c72_0          35 KB  conda-forge
tzdata-2023c               |       h71feb2d_0         115 KB  conda-forge
ucrt-10.0.22621.0          |       h57928b3_0         1.2 MB  conda-forge
urllib3-1.26.18            |     pyhd8ed1ab_0         112 KB  conda-forge
vc-14.3                    |      hcf57466_18          17 KB  conda-forge
vc14_runtime-14.38.33130   |      h82b7239_18         732 KB  conda-forge
vs2015_runtime-14.38.33130 |      hcb4865c_18          17 KB  conda-forge
wcwidth-0.2.12             |     pyhd8ed1ab_0          32 KB  conda-forge
wheel-0.42.0               |     pyhd8ed1ab_0          56 KB  conda-forge
widgetsnbextension-4.0.9   |     pyhd8ed1ab_0         865 KB  conda-forge
win_inet_pton-1.1.0        |     pyhd8ed1ab_6           8 KB  conda-forge
wrapt-1.16.0               |  py310h8d17308_0          53 KB  conda-forge
xorg-libxau-1.0.11         |       hcd874cb_0          50 KB  conda-forge
xorg-libxdmcp-1.1.3        |       hcd874cb_0          66 KB  conda-forge
xyzservices-2023.10.1      |     pyhd8ed1ab_0          35 KB  conda-forge
xz-5.2.6                   |       h8d14728_0         213 KB  conda-forge
yaml-0.2.5                 |       h8ffe710_2          62 KB  conda-forge
yarl-1.9.3                 |  py310h8d17308_0         100 KB  conda-forge
zict-3.0.0                 |     pyhd8ed1ab_0          35 KB  conda-forge
zipp-3.17.0                |     pyhd8ed1ab_0          19 KB  conda-forge
zstd-1.5.5                 |       h12be248_0         335 KB  conda-forge
------------------------------------------------------------
                                       Total:       332.2 MB

Then activated it and tried -re-running the coiled command

(coiled-dataframe) PS C:\Users\thoma> conda activate coiled-dataframe (coiled-dataframe) PS C:\Users\thoma> coiled run echo "Hello world" ╭───────────────────────── Running echo 'Hello world' ─────────────────────────╮ │ │ │ Details: . │ │ │ │ Scanning Environment ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ │ │ │ │ Region: . Uptime: 0 │ │ VM Type: . Approx cloud cost: $0.00/hr │ │ Total cost: $0.00 │ │ │ ╰──────────────────────────────────────────────────────────────────────────────╯ Traceback (most recent call last): File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 992, in _wrap_create_connection return await self._loop.create_connection(*args, **kwargs) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\asyncio\base_events.py", line 1076, in create_connection raise exceptions[0] File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\asyncio\base_events.py", line 1060, in create_connection sock = await self._connect_sock( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\asyncio\base_events.py", line 969, in _connect_sock await self.sock_connect(sock, address) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\asyncio\selector_events.py", line 501, in sock_connect return await fut File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\asyncio\selector_events.py", line 541, in _sock_connect_cb raise OSError(err, f'Connect call failed {address}') TimeoutError: [Errno 10060] Connect call failed ('18.164.68.57', 443)

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\Scripts\coiled-script.py", line 9, in sys.exit(cli()) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\click\core.py", line 1157, in call return self.main(args, kwargs) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\click\core.py", line 1078, in main rv = self.invoke(ctx) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\click\core.py", line 1688, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\click\core.py", line 1434, in invoke return ctx.invoke(self.callback, ctx.params) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\click\core.py", line 783, in invoke return __callback(args, kwargs) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\cli\run.py", line 274, in run start_run( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\cli\run.py", line 419, in start_run coiled.add_interaction( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\core.py", line 2927, in add_interaction with Cloud() as cloud: File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\core.py", line 314, in init self._sync(self._start) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\core.py", line 537, in _sync return cast(_T, sync(self.loop, func, *args, *kwargs)) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\distributed\utils.py", line 434, in sync raise error File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\distributed\utils.py", line 408, in f result = yield future File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\tornado\gen.py", line 767, in run value = future.result() File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\context.py", line 112, in async_wrapper return await func(args, kwargs) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\core.py", line 417, in _start self.user, self.token, self.server, memberships = await handle_credentials( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\utils.py", line 395, in handle_credentials user_dict = await _fetch_data( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\backoff_async.py", line 151, in retry ret = await target(*args, **kwargs) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\coiled\utils.py", line 299, in _fetch_data response = await session.request("GET", f"{server}{endpoint}") File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\client.py", line 574, in _request conn = await self._connector.connect( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 544, in connect proto = await self._create_connection(req, traces, timeout) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 911, in _createconnection , proto = await self._create_direct_connection(req, traces, timeout) File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 1235, in _create_direct_connection raise last_exc File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 1204, in _create_direct_connection transp, proto = await self._wrap_create_connection( File "C:\Users\thoma\anaconda3\envs\coiled-dataframe\lib\site-packages\aiohttp\connector.py", line 1000, in _wrap_create_connection raise client_error(req.connection_key, exc) from exc aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host cloud.coiled.io:443 ssl:default [Connect call failed ('18.164.68.57', 443)]

taupirho commented 6 months ago

My coiled user name is thomas-reid

dchudz commented 6 months ago

Hi Thomas! This error is often a sign of network restrictions preventing the machine from reaching the Dask scheduler running in AWS. (E.g. perhaps network rules that prevent making connections outside the VPC you're in, or something along those lines.)

We have ways around that, but as you might imagine, they tend to be a little (not a lot) more involved than the setup process you've been through.

Maybe we should talk to help me learn more about your situation and plans for Coiled? I've sent a note about scheduling.

dchudz commented 6 months ago

Thanks Thomas, looking forward to talking tomorrow.

A couple debugging checks that would be helpful:

  1. Can aiohttp talk to Coiled (in the Python environment you're trying to run Coiled in):

(I expect this to fail in the same way Coiled is currently failing for you.)

import asyncio
import aiohttp

async def main():
    async with aiohttp.ClientSession() as session:
        async with session.get('https://cloud.coiled.io') as resp:
            print(resp.status)
            print(await resp.text())

asyncio.run(main())
  1. Can aiohttp talk to Google (or anything else) (in the Python environment you're trying to run Coiled in):

(This will tell us if the failure is specific to Coiled.)

import asyncio
import aiohttp

async def main():
    async with aiohttp.ClientSession() as session:
        async with session.get('https://google.com') as resp:
            print(resp.status)
            print(await resp.text())

asyncio.run(main())
  1. Can we curl to Coiled? (This will distinguish between problems in the Python environment you've set up, and problems on your machine generally.)
curl -vvI https://cloud.coiled.io/
  1. Can we curl to Google?
curl -vvI https://google.com
taupirho commented 6 months ago

For some reason, I don't know why, as I didn't do anything, it all seems to be working now

Screenshot 2023-12-19 102113

taupirho commented 6 months ago

Patrick, for some reason it's all working now. I'm not sure why. Screenshot attached. I've updated the github issue and happy to close this down. We can cancel the meeting we had scheduled for later today

On Mon, Dec 18, 2023 at 8:01 PM David Chudzicki @.***> wrote:

Thanks Thomas, looking forward to talking tomorrow.

A couple debugging checks that would be helpful:

  1. Can aiohttp talk to Coiled (in the Python environment you're trying to run Coiled in):

(I expect this to fail in the same way Coiled is currently failing for you.)

import asyncio import aiohttp

async def main(): async with aiohttp.ClientSession() as session: async with session.get('https://cloud.coiled.io') as resp: print(resp.status) print(await resp.text())

asyncio.run(main())

  1. Can aiohttp talk to Google (or anything else) (in the Python environment you're trying to run Coiled in):

(This will tell us if the failure is specific to Coiled.)

import asyncio import aiohttp

async def main(): async with aiohttp.ClientSession() as session: async with session.get('https://google.com') as resp: print(resp.status) print(await resp.text())

asyncio.run(main())

  1. Can we curl to Coiled? (This will distinguish between problems in the Python environment you've set up, and problems on your machine generally.)

curl -vvI https://cloud.coiled.io/

  1. Can we curl to Google?

curl -vvI https://google.com

— Reply to this email directly, view it on GitHub https://github.com/coiled/feedback/issues/265#issuecomment-1861496060, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFHMTFPCEVO6I6NKTYULEXTYKCOLLAVCNFSM6AAAAABAZF76H6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRRGQ4TMMBWGA . You are receiving this because you authored the thread.Message ID: @.***>