Jupiter notebook / s3 browser is not working

[rbo]

S3 Brower is blank...

/cc @nexus-Six

[rbo]

Might be this: https://github.com/IBM/jupyterlab-s3-browser ?

[rbo]

Let's try to add the jupyterlab-s3-browser...

[root@pluto ~]# podman run -ti --user 0 --entrypoint bash quay.io/mmurakam/workbenches:object-detection-v1.0.5
(app-root) bash-5.1# 
(app-root) bash-5.1# pip install jupyterlab-s3-browser
Requirement already satisfied: jupyterlab-s3-browser in /opt/app-root/lib/python3.9/site-packages (0.10.1)
Requirement already satisfied: notebook in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-s3-browser) (6.5.4)
Requirement already satisfied: boto3 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-s3-browser) (1.28.2)
Requirement already satisfied: jupyter-server in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-s3-browser) (2.1.0)
Requirement already satisfied: singleton-decorator in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-s3-browser) (1.0.0)
Requirement already satisfied: jupyterlab>=2.0.0 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-s3-browser) (3.5.3)
Requirement already satisfied: ipython in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (8.14.0)
Requirement already satisfied: packaging in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (21.3)
Requirement already satisfied: tornado>=6.1.0 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (6.3.2)
Requirement already satisfied: jupyter-core in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (5.3.0)
Requirement already satisfied: jupyterlab-server~=2.10 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.22.1)
Requirement already satisfied: nbclassic in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (1.0.0)
Requirement already satisfied: jinja2>=2.1 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (3.1.2)
Requirement already satisfied: tomli in /opt/app-root/lib/python3.9/site-packages (from jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.0.1)
Requirement already satisfied: anyio<4,>=3.1.0 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (3.7.0)
Requirement already satisfied: argon2-cffi in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (21.3.0)
Requirement already satisfied: jupyter-client>=7.4.4 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (8.2.0)
Requirement already satisfied: jupyter-events>=0.4.0 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (0.6.3)
Requirement already satisfied: jupyter-server-terminals in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (0.4.4)
Requirement already satisfied: nbconvert>=6.4.4 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (7.4.0)
Requirement already satisfied: nbformat>=5.3.0 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (5.9.0)
Requirement already satisfied: prometheus-client in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (0.17.0)
Requirement already satisfied: pyzmq>=24 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (25.1.0)
Requirement already satisfied: send2trash in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (1.8.2)
Requirement already satisfied: terminado>=0.8.3 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (0.17.1)
Requirement already satisfied: traitlets>=5.6.0 in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (5.9.0)
Requirement already satisfied: websocket-client in /opt/app-root/lib/python3.9/site-packages (from jupyter-server->jupyterlab-s3-browser) (1.5.3)
Requirement already satisfied: ipython-genutils in /opt/app-root/lib/python3.9/site-packages (from notebook->jupyterlab-s3-browser) (0.2.0)
Requirement already satisfied: nest-asyncio>=1.5 in /opt/app-root/lib/python3.9/site-packages (from notebook->jupyterlab-s3-browser) (1.5.6)
Requirement already satisfied: ipykernel in /opt/app-root/lib/python3.9/site-packages (from notebook->jupyterlab-s3-browser) (6.23.2)
Requirement already satisfied: botocore<1.32.0,>=1.31.2 in /opt/app-root/lib/python3.9/site-packages (from boto3->jupyterlab-s3-browser) (1.31.2)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /opt/app-root/lib/python3.9/site-packages (from boto3->jupyterlab-s3-browser) (1.0.1)
Requirement already satisfied: s3transfer<0.7.0,>=0.6.0 in /opt/app-root/lib/python3.9/site-packages (from boto3->jupyterlab-s3-browser) (0.6.1)
Requirement already satisfied: idna>=2.8 in /opt/app-root/lib/python3.9/site-packages (from anyio<4,>=3.1.0->jupyter-server->jupyterlab-s3-browser) (3.4)
Requirement already satisfied: sniffio>=1.1 in /opt/app-root/lib/python3.9/site-packages (from anyio<4,>=3.1.0->jupyter-server->jupyterlab-s3-browser) (1.3.0)
Requirement already satisfied: exceptiongroup in /opt/app-root/lib/python3.9/site-packages (from anyio<4,>=3.1.0->jupyter-server->jupyterlab-s3-browser) (1.1.1)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /opt/app-root/lib/python3.9/site-packages (from botocore<1.32.0,>=1.31.2->boto3->jupyterlab-s3-browser) (2.8.2)
Requirement already satisfied: urllib3<1.27,>=1.25.4 in /opt/app-root/lib/python3.9/site-packages (from botocore<1.32.0,>=1.31.2->boto3->jupyterlab-s3-browser) (1.26.16)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/app-root/lib/python3.9/site-packages (from jinja2>=2.1->jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.1.3)
Requirement already satisfied: importlib-metadata>=4.8.3 in /opt/app-root/lib/python3.9/site-packages (from jupyter-client>=7.4.4->jupyter-server->jupyterlab-s3-browser) (6.6.0)
Requirement already satisfied: platformdirs>=2.5 in /opt/app-root/lib/python3.9/site-packages (from jupyter-core->jupyterlab>=2.0.0->jupyterlab-s3-browser) (3.5.3)
Requirement already satisfied: jsonschema>=3.2.0 in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (4.17.3)
Requirement already satisfied: python-json-logger>=2.0.4 in /opt/app-root/lib/python3.9/site-packages (from jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (2.0.7)
Requirement already satisfied: pyyaml>=5.3 in /opt/app-root/lib/python3.9/site-packages (from jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (5.4.1)
Requirement already satisfied: rfc3339-validator in /opt/app-root/lib/python3.9/site-packages (from jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (0.1.4)
Requirement already satisfied: rfc3986-validator>=0.1.1 in /opt/app-root/lib/python3.9/site-packages (from jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (0.1.1)
Requirement already satisfied: babel>=2.10 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-server~=2.10->jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.12.1)
Requirement already satisfied: json5>=0.9.0 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-server~=2.10->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.9.14)
Requirement already satisfied: requests>=2.28 in /opt/app-root/lib/python3.9/site-packages (from jupyterlab-server~=2.10->jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.31.0)
Requirement already satisfied: notebook-shim>=0.2.3 in /opt/app-root/lib/python3.9/site-packages (from nbclassic->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.2.3)
Requirement already satisfied: beautifulsoup4 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (4.6.3)
Requirement already satisfied: bleach in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (6.0.0)
Requirement already satisfied: defusedxml in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (0.7.1)
Requirement already satisfied: jupyterlab-pygments in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (0.2.2)
Requirement already satisfied: mistune<3,>=2.0.3 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (2.0.5)
Requirement already satisfied: nbclient>=0.5.0 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (0.8.0)
Requirement already satisfied: pandocfilters>=1.4.1 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (1.5.0)
Requirement already satisfied: pygments>=2.4.1 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (2.15.1)
Requirement already satisfied: tinycss2 in /opt/app-root/lib/python3.9/site-packages (from nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (1.2.1)
Requirement already satisfied: fastjsonschema in /opt/app-root/lib/python3.9/site-packages (from nbformat>=5.3.0->jupyter-server->jupyterlab-s3-browser) (2.17.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /opt/app-root/lib/python3.9/site-packages (from packaging->jupyterlab>=2.0.0->jupyterlab-s3-browser) (3.0.9)
Requirement already satisfied: ptyprocess in /opt/app-root/lib/python3.9/site-packages (from terminado>=0.8.3->jupyter-server->jupyterlab-s3-browser) (0.7.0)
Requirement already satisfied: argon2-cffi-bindings in /opt/app-root/lib/python3.9/site-packages (from argon2-cffi->jupyter-server->jupyterlab-s3-browser) (21.2.0)
Requirement already satisfied: comm>=0.1.1 in /opt/app-root/lib/python3.9/site-packages (from ipykernel->notebook->jupyterlab-s3-browser) (0.1.3)
Requirement already satisfied: debugpy>=1.6.5 in /opt/app-root/lib/python3.9/site-packages (from ipykernel->notebook->jupyterlab-s3-browser) (1.6.7)
Requirement already satisfied: matplotlib-inline>=0.1 in /opt/app-root/lib/python3.9/site-packages (from ipykernel->notebook->jupyterlab-s3-browser) (0.1.6)
Requirement already satisfied: psutil in /opt/app-root/lib/python3.9/site-packages (from ipykernel->notebook->jupyterlab-s3-browser) (5.9.5)
Requirement already satisfied: backcall in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.2.0)
Requirement already satisfied: decorator in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (5.1.1)
Requirement already satisfied: jedi>=0.16 in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.18.2)
Requirement already satisfied: pickleshare in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.7.5)
Requirement already satisfied: prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30 in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (3.0.38)
Requirement already satisfied: stack-data in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.6.2)
Requirement already satisfied: typing-extensions in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (4.6.3)
Requirement already satisfied: pexpect>4.3 in /opt/app-root/lib/python3.9/site-packages (from ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (4.8.0)
Requirement already satisfied: zipp>=0.5 in /opt/app-root/lib/python3.9/site-packages (from importlib-metadata>=4.8.3->jupyter-client>=7.4.4->jupyter-server->jupyterlab-s3-browser) (3.15.0)
Requirement already satisfied: parso<0.9.0,>=0.8.0 in /opt/app-root/lib/python3.9/site-packages (from jedi>=0.16->ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.8.3)
Requirement already satisfied: attrs>=17.4.0 in /opt/app-root/lib/python3.9/site-packages (from jsonschema>=3.2.0->jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (23.1.0)
Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /opt/app-root/lib/python3.9/site-packages (from jsonschema>=3.2.0->jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (0.19.3)
Requirement already satisfied: fqdn in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (1.5.1)
Requirement already satisfied: isoduration in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (20.11.0)
Requirement already satisfied: jsonpointer>1.13 in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (2.3)
Requirement already satisfied: uri-template in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (1.2.0)
Requirement already satisfied: webcolors>=1.11 in /opt/app-root/lib/python3.9/site-packages (from jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (1.13)
Requirement already satisfied: wcwidth in /opt/app-root/lib/python3.9/site-packages (from prompt-toolkit!=3.0.37,<3.1.0,>=3.0.30->ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.2.6)
Requirement already satisfied: six>=1.5 in /opt/app-root/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.32.0,>=1.31.2->boto3->jupyterlab-s3-browser) (1.16.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /opt/app-root/lib/python3.9/site-packages (from requests>=2.28->jupyterlab-server~=2.10->jupyterlab>=2.0.0->jupyterlab-s3-browser) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in /opt/app-root/lib/python3.9/site-packages (from requests>=2.28->jupyterlab-server~=2.10->jupyterlab>=2.0.0->jupyterlab-s3-browser) (2023.5.7)
Requirement already satisfied: cffi>=1.0.1 in /opt/app-root/lib/python3.9/site-packages (from argon2-cffi-bindings->argon2-cffi->jupyter-server->jupyterlab-s3-browser) (1.15.1)
Requirement already satisfied: webencodings in /opt/app-root/lib/python3.9/site-packages (from bleach->nbconvert>=6.4.4->jupyter-server->jupyterlab-s3-browser) (0.5.1)
Requirement already satisfied: executing>=1.2.0 in /opt/app-root/lib/python3.9/site-packages (from stack-data->ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (1.2.0)
Requirement already satisfied: asttokens>=2.1.0 in /opt/app-root/lib/python3.9/site-packages (from stack-data->ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (2.2.1)
Requirement already satisfied: pure-eval in /opt/app-root/lib/python3.9/site-packages (from stack-data->ipython->jupyterlab>=2.0.0->jupyterlab-s3-browser) (0.2.2)
Requirement already satisfied: pycparser in /opt/app-root/lib/python3.9/site-packages (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi->jupyter-server->jupyterlab-s3-browser) (2.21)
Requirement already satisfied: arrow>=0.15.0 in /opt/app-root/lib/python3.9/site-packages (from isoduration->jsonschema[format-nongpl]>=3.2.0->jupyter-events>=0.4.0->jupyter-server->jupyterlab-s3-browser) (1.2.3)
(app-root) bash-5.1# jupyter serverextension
Please supply at least one subcommand: disable, enable, list
(app-root) bash-5.1# jupyter serverextension list
config dir: /opt/app-root/src/.jupyter
    jupyterlab_s3_browser  enabled 
    - Validating...
      jupyterlab_s3_browser  OK
config dir: /opt/app-root/etc/jupyter
    elyra  enabled 
    - Validating...
      elyra  OK
    jupyter_lsp  enabled 
    - Validating...
      jupyter_lsp 2.2.0 OK
    jupyter_server_proxy  enabled 
    - Validating...
      jupyter_server_proxy  OK
    jupyter_resource_usage  enabled 
    - Validating...
      jupyter_resource_usage  OK
    jupyterlab  enabled 
    - Validating...
      jupyterlab 3.5.3 OK
    jupyterlab_git  enabled 
    - Validating...
      jupyterlab_git 0.41.0 OK
    nbdime  enabled 
    - Validating...
      nbdime 3.1.1 OK
    nbgitpuller  enabled 
    - Validating...
      nbgitpuller 1.1.1 OK
(app-root) bash-5.1# 

=> Already included

[rbo]

Log from jupyter notebook pod:

[W 2024-07-04 12:33:51.549 ServerApp] 404 GET /notebook/team-2-ai/object-detection/jupyterlab_s3_browser/auth?1720096431467 (51503d4d03cf4f3a91cc86e39e67500b@127.0.0.1) 17.90ms referer=https://object-detection-team-2-ai.apps.cluster-vjcjc.vjcjc.sandbox1590.opentlc.com/notebook/team-2-ai/object-detection/lab?

[rbo]

https://github.com/IBM/jupyterlab-s3-browser/issues/101

[rbo]

May be this is fixed with a new object-detection image:

$ skopeo list-tags docker://quay.io/mmurakam/workbenches | grep object-detection
        "object-detection-v1.0.0",
        "object-detection-v1.0.0-rc.2",
        "object-detection-v1.0.1",
        "object-detection-v1.0.2",
        "object-detection-v1.0.3",
        "object-detection-v1.0.4",
        "object-detection-v1.0.5",
        "object-detection-v1.1.0",
        "object-detection-v1.3.1",
        "object-detection-v1.3.2",
        "object-detection-v2.0.0",

[rbo]

If I'm starting the notebook locally it works:

podman run -ti --rm -p 8888:8888 quay.io/mmurakam/workbenches:object-detection-v1.0.5

[rbo]

My face-reg. workbench with:

kind: ImageStream
apiVersion: image.openshift.io/v1
metadata:
  annotations:
    opendatahub.io/notebook-image-name: "Face recognition Elyra"
    opendatahub.io/notebook-image-desc: >-
      Jupyter notebook image enabling computer vision use cases, in particular face recognition.
  name: face-recognition-elyra
  namespace: redhat-ods-applications
  labels:
    component.opendatahub.io/name: jupyterhub
    opendatahub.io/component: 'true'
    opendatahub.io/notebook-image: 'true'
spec:
  lookupPolicy:
    local: true
  tags:
    - name: "1.1.0"
      from:
        kind: DockerImage
        name: quay.io/mmurakam/face-recognition-notebook:face-recognition-notebook-v1.1.0
      importPolicy: {}
      referencePolicy:
        type: Local
      annotations:
        opendatahub.io/notebook-python-dependencies: >-
          [{"name":"opencv","version":"4.6.0.66"},{"name":"face-recognition","version":"1.3.0"},{"name":"elyra","version":"3.14.1"}]
        opendatahub.io/notebook-software: '[{"name":"Python","version":"3.8"}]'

Works...

[rbo]

That looks strange, the workbench generting new tokens all the time.

[I 2024-07-05 07:05:45.335 ServerApp] Generating new user for token-authenticated request: d6dbfa2ed24742dd947644a9a68cb157
[W 2024-07-05 07:05:45.894 ServerApp] 404 GET /notebook/team-1-ai/s3-tesrt/jupyterlab_s3_browser/auth?1720163145882 (5df8cb3cb89647d0a2cce76522a08878@127.0.0.1) 1.45ms referer=https://s3-tesrt-team-1-ai.apps.cluster-kqb88.kqb88.sandbox1151.opentlc.com/notebook/team-1-ai/s3-tesrt/lab
[I 2024-07-05 07:05:46.527 LabApp] Build is up to date
[I 2024-07-05 07:05:50.334 ServerApp] Generating new user for token-authenticated request: c147fabc55824a1c96d3386a9c9e0cc7
[I 2024-07-05 07:05:50.335 ServerApp] Generating new user for token-authenticated request: 4f4aa3201f094bff802197e3d06e1083

Let's try a workbench with object-detection-v1.3.2

[rbo]

Let's try a workbench with object-detection-v1.3.2

S3 browser is gone.

[rbo]

quay.io/cloud-native-robotz-hackathon/workbench-object-detection:v1.3.2

Works:

[rbo]

S3 Browser in workbench image v1.3.2 available.