inconsistent notebook and worker images on pangeo.pydata.org

[rabernat]

As noted by @mrocklin in https://github.com/pydata/xarray/issues/2234, we currently have mismatches between package version on notebook and cluster docker images. This causes lots of things to break.

Just opening an issue to remind us of this state and that we need to fix it. I guess we need an updated worker image, or a better solution to worker environments.

client.get_versions(check=True)
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-11-4a95fbecd8f8> in <module>()
----> 1 client.get_versions(check=True)

/opt/conda/lib/python3.6/site-packages/distributed/client.py in get_versions(self, check)
   3064                 raise ValueError("Mismatched versions found\n"
   3065                                  "\n"
-> 3066                                  "%s" % ('\n\n'.join(errs)))
   3067 
   3068         return result

ValueError: Mismatched versions found

bokeh
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 0.12.16 |
| tcp://10.20.209.8:40004 | 0.12.7  |
+-------------------------+---------+

cloudpickle
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 0.5.3   |
| tcp://10.20.209.8:40004 | 0.4.0   |
+-------------------------+---------+

numpy
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 1.14.5  |
| tcp://10.20.209.8:40004 | 1.14.3  |
+-------------------------+---------+

pandas
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 0.23.1  |
| tcp://10.20.209.8:40004 | 0.20.3  |
+-------------------------+---------+

toolz
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 0.9.0   |
| tcp://10.20.209.8:40004 | 0.8.2   |
+-------------------------+---------+

tornado
+-------------------------+---------+
|                         | version |
+-------------------------+---------+
| client                  | 5.0.2   |
| tcp://10.20.209.8:40004 | 4.5.2   |
+-------------------------+---------+

[mrocklin]

cc @martindurant if you have time to look into this

On Fri, Jun 15, 2018 at 4:52 PM, Ryan Abernathey notifications@github.com wrote:

As noted by @mrocklin https://github.com/mrocklin in pydata/xarray#2234 https://github.com/pydata/xarray/issues/2234, we current have mismatches between package version on notebook and cluster docker images. This causes lots of things to break.

Just opening an issue to remind us of this state and that we need to fix it. I guess we need an updated worker image, or a better solution to worker environments.

client.get_versions(check=True)

ValueError Traceback (most recent call last)

in () ----> 1 client.get_versions(check=True) /opt/conda/lib/python3.6/site-packages/distributed/client.py in get_versions(self, check) 3064 raise ValueError("Mismatched versions found\n" 3065 "\n" -> 3066 "%s" % ('\n\n'.join(errs))) 3067 3068 return result ValueError: Mismatched versions found bokeh +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 0.12.16 | | tcp://10.20.209.8:40004 | 0.12.7 | +-------------------------+---------+ cloudpickle +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 0.5.3 | | tcp://10.20.209.8:40004 | 0.4.0 | +-------------------------+---------+ numpy +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 1.14.5 | | tcp://10.20.209.8:40004 | 1.14.3 | +-------------------------+---------+ pandas +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 0.23.1 | | tcp://10.20.209.8:40004 | 0.20.3 | +-------------------------+---------+ toolz +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 0.9.0 | | tcp://10.20.209.8:40004 | 0.8.2 | +-------------------------+---------+ tornado +-------------------------+---------+ | | version | +-------------------------+---------+ | client | 5.0.2 | | tcp://10.20.209.8:40004 | 4.5.2 | +-------------------------+---------+ — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub , or mute the thread .