Docutils version

[hugobowne]

A bug report from twitter (thanks @michaelaye!):

Why does coiled insist on docutils 0.15.2 and uninstalls my conda docutils 0.16? Is it possible to remove that restrictive requirement? It breaks conda environments like this.

[jrbourbeau]

Thank @michaelaye for raising this point (and @hugobowne for opening up an issue here). Today, coileds dependencies are:

aiohttp
aiobotocore>=1.0.7
click
dask[complete]>=2.23.0
distributed>=2.23.0
s3fs
pandas>=1.1.0
ipython

I'm not immediately sure where the docutils version constraint is getting pulled in from. I recall aiobotocore having a somewhat restrictive set of dependencies, so maybe that's a good place to start.

Since you mentioned using conda environments, you may also consider installing coiled from conda-forge

conda install -c conda-forge coiled

[michaelaye]

It's aiobotocore requirement on botocore which, in its conda build history, has the weird property of sometimes depending on docutils<0.16 and sometimes not. The required version of botocore 1.17.44 is resolved to a build that does require docstring<0.16.

EDIT: Oh, i see the difference, but don't understand it, not much experience with conda builds here: The tar.bz2 conda packages do not depend on docutils, the .conda builds do:

botocore 1.19.7 pyhd3deb0d_0
----------------------------
file name   : botocore-1.19.7-pyhd3deb0d_0.tar.bz2
name        : botocore
version     : 1.19.7
build       : pyhd3deb0d_0
build number: 0
size        : 4.1 MB
license     : Apache-2.0
subdir      : noarch
url         : https://conda.anaconda.org/conda-forge/noarch/botocore-1.19.7-pyhd3deb0d_0.tar.bz2
md5         : 3337cfcc6ea5eda74500e224d086c640
timestamp   : 2020-10-28 23:05:14 UTC
dependencies: 
  - jmespath >=0.7.1,<1.0.0
  - python
  - python-dateutil >=2.1,<3.0.0
  - urllib3 >=1.25.4,<1.26

botocore 1.19.7 pyhd3eb1b0_0
----------------------------
file name   : botocore-1.19.7-pyhd3eb1b0_0.conda
name        : botocore
version     : 1.19.7
build       : pyhd3eb1b0_0
build number: 0
size        : 3.2 MB
license     : Apache-2.0
subdir      : noarch
url         : https://repo.anaconda.com/pkgs/main/noarch/botocore-1.19.7-pyhd3eb1b0_0.conda
md5         : d9096ce2de4f2129ee8188bda1dd848f
timestamp   : 2020-10-28 22:41:58 UTC
dependencies: 
  - docutils >=0.10,<0.16
  - jmespath >=0.7.1,<1.0.0
  - python
  - python-dateutil >=2.1,<3.0.0
  - urllib3 >=1.20,<1.26

[FabioRosado]

Hello, I'm going through the open issues on this repository and close some of them. As of today, our version of coiled (0.0.35) uses botocore 1.20.2, which might fix the issue that you were experiencing. I've also tried to install all those dependencies on a new conda environment, and the docutils wasn't downgraded.

I'm closing this issue now, but please feel free to re-open or open a new issue if you experience any further problems