jupyter-server / enterprise_gateway

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.
https://jupyter-enterprise-gateway.readthedocs.io/en/latest/
Other
620 stars 223 forks source link

Update tensorflow-gpu base image #1122

Closed kevin-bates closed 2 years ago

kevin-bates commented 2 years ago

Attempts to build the tensorflow GPU kernel image using make kernel-tf-gpu-py fail with the following:

...
#6 4.860 W: GPG error: https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64  InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A4B469963BF863CC
#6 4.860 E: The repository 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64  InRelease' is no longer signed.
------
executor failed running [/bin/bash -c apt-get update && apt-get install -yq     build-essential     libsm6     libxext-dev     libxrender1     netcat     python3-dev     tzdata     unzip &&     rm -rf /var/lib/apt/lists/* &&     pip install --upgrade future pycryptodomex ipykernel]: exit code: 100
make[1]: *** [../.image-kernel-tf-gpu-py] Error 1
make: *** [kernel-tf-gpu-py] Error 2

This is because the public key was updated this past April. As a result, we need to update the base image for elyra/kernel-tf-gpu-py to include a more up-to-date version. While testing these changes, I also found we don't need to have a Jupyter server baked into the image via the -jupyter suffix (which we were using previously). This saves another 70MB on the image size (although that amount pales in comparison to the overall size).

We're also bumping the Python version from 2.7 to 2.9.