Dask JupyterLab Extension for Jasmin notebook service

[hmkhatri]

It would be useful to have Dask lab-extension installed on Jasmin notebook service for testing parallel computations on inbuilt dask dashboard.

[agstephens]

Thanks @hmkhatri , we will look into this for the next release.

[alaniwi]

It is available as conda package dask-labextension. However, it will install a number of packages for dependencies which look like they might conflict with whatever the notebook service itself uses, in particular the jupyter* and notebook* packages below.

  anyio                   3.6.1  py310hff52083_0  conda-forge/linux-64     158 KB
  argon2-cffi            21.3.0  pyhd8ed1ab_0     conda-forge/noarch       Cached
  argon2-cffi-bindings   21.2.0  py310h5764c6d_2  conda-forge/linux-64      34 KB
  dask-labextension       5.3.0  pyhd8ed1ab_1     conda-forge/noarch        40 KB
  debugpy                 1.6.0  py310hd8f1fbe_0  conda-forge/linux-64       2 MB
  flit-core               3.7.1  pyhd8ed1ab_0     conda-forge/noarch       Cached
  ipykernel              6.14.0  py310hfdc917e_0  conda-forge/linux-64     188 KB
  ipython_genutils        0.2.0  py_1             conda-forge/noarch       Cached
  json5                   0.9.6  pyhd3eb1b0_0     pkgs/main/noarch          21 KB
  jupyter-server-proxy    3.2.1  pyhd8ed1ab_0     conda-forge/noarch        29 KB
  jupyter_server         1.18.0  pyhd8ed1ab_0     conda-forge/noarch       233 KB
  jupyterlab              3.4.3  pyhd8ed1ab_0     conda-forge/noarch         6 MB
  jupyterlab_server      2.14.0  pyhd8ed1ab_1     conda-forge/noarch        49 KB
  nbclassic               0.3.7  pyhd8ed1ab_0     conda-forge/noarch        14 KB
  notebook               6.4.12  pyha770c72_0     conda-forge/noarch         6 MB
  notebook-shim           0.1.0  pyhd8ed1ab_0     conda-forge/noarch        15 KB
  prometheus_client      0.14.1  pyhd8ed1ab_0     conda-forge/noarch       Cached
  send2trash              1.8.0  pyhd8ed1ab_0     conda-forge/noarch       Cached
  simpervisor               0.4  pyhd8ed1ab_0     conda-forge/noarch         9 KB
  sniffio                 1.2.0  py310hff52083_3  conda-forge/linux-64      16 KB
  terminado              0.15.0  py310hff52083_0  conda-forge/linux-64      28 KB
  websocket-client        1.3.3  pyhd8ed1ab_0     conda-forge/noarch        41 KB

The dependencies that get installed with a pip install also look similar.

We will have to investigate further as to whether this is safe for us to install. To avoid delaying the next release, postponing this for a later release.

[agstephens]

@hmkhatri, we currently have users testing a system that employs dask-gateway to broker tasks between the Notebook Service and the LOTUS batch compute cluster. The dask-gateway web-interface includes a dashboard for viewing and monitoring the parallel running of jobs via dask. Please contact support@ceda.ac.uk for more details.