IBM / jupyterlab-s3-browser

A JupyterLab extension for browsing S3-compatible object storage
Apache License 2.0
119 stars 43 forks source link

s3-browser not listing any objects from s3(unable to see any object) #52

Closed gopesh1992 closed 2 years ago

gopesh1992 commented 2 years ago

Hi, I have configured the s3 browser extension as per given instructions in readme but I'm unable to see any object under the bucket icon (once clicked).

Steps to reproduce the behavior:

Installed jupyterlab-s3-browser (for jupyter lab 3) following the instructions in the main readme. Added below environment variables as given in the instructions,

export JUPYTERLAB_S3_ENDPOINT="https://s3.us.cloud-object-storage.appdomain.cloud" export JUPYTERLAB_S3_ACCESS_KEY_ID="my-access-key-id" export JUPYTERLAB_S3_SECRET_ACCESS_KEY="secret"

When click on the bucket icon in the jupyter lab UI (saw no prompt come up to enter aws credentials), but see no objects or any errors

Expected behavior Expected to be able to see objects in S3 (at least the ones in the AWS account for which the credentials were configured)

Screenshots image

reevejd commented 2 years ago

Hi @gopesh1992, thanks for reporting the issue. I’m going to try to release a new version of the extension this week after ironing out a few bugs, this will hopefully be one of them.

If you're eager there's a release candidate available that may already fix the issue, you can try it out with:

pip install jupyterlab_s3_browser==0.11.0-rc.0


If you're still seeing the issue on the new version please let me know.

gopesh1992 commented 2 years ago

Hi @reevejd , Thanks a lot for your reply. Tried installing jupyterlab_s3_browser==0.11.0-rc.0, below are the commands

pip install jupyterlab_s3_browser==0.11.0-rc.0

jupyter serverextension enable --py jupyterlab_s3_browser (enabled server extension)

And restarted jupyterlab but still can see blank screen when clicking on bucket icon.

mleuthold commented 2 years ago

Hi @reevejd, I tried out your release candidate and it shows the files now. So it works for me.

Unfortunately I had the use case to open and save Jupyter notebooks, but it seems like I can't open them with a double click nor with a right click -> open as notebook.

This is the error message:

image

This is the log on the console:

image

I hope it helps to make the use case work.

BTW, I'm using region eu-west-1 and using this S3_ENDPOINT, which worked: https://s3.eu-west-1.amazonaws.com

reevejd commented 2 years ago

@mleuthold, thanks for reporting the issue. It's been fixed in 0.11.0-rc.1.

@gopesh1992 Sorry I didn't read your original message carefully enough. You said:

saw no prompt come up to enter aws credentials

If you want to set credentials at runtime you should omit the JUPYTERLAB_S3 environment variables. Or you can set them to your actual credentials instead of the examples I provided. If I've misunderstood and you are using valid credentials for environment variables then I'm not sure what's going on. If you try out 0.11.0-rc.1 are you able to create a new bucket after authenticating?

gaolebber commented 2 years ago

I'm unable to see any object under the bucket icon Steps to reproduce the behavior: Installed jupyterlab-s3-browser following the instructions in the main readme. Added below environment variables as given in the instructions, Configured according to AWS certificate ~ / AWS / credentials configured

export JUPYTERLAB_S3_ENDPOINT="https://s3.us.cloud-object-storage.appdomain.cloud" export JUPYTERLAB_S3_ACCESS_KEY_ID="xxx" export JUPYTERLAB_S3_SECRET_ACCESS_KEY="xxx"

When click on the bucket icon in the jupyter lab UI (saw no prompt come up to enter aws credentials), but see no objects or any errors

Expected behavior Expected to be able to see objects in S3

gaolebber commented 2 years ago

Jupyterhub does not have jupyterlab after starting the command s3 Browser information

jupyterhub --config=/etc/jupyterhub/jupyterhub_ config. py --no-ssl --log-level=DEBUG

reevejd commented 2 years ago

Hi @gaolebber, thanks for reporting the issue. What version of JupyterLab and the extension are you running? You're not seeing the prompt to enter credentials because you've set them through environment variables. If you don't specify the credentials as environment variables, does entering the credentials through the prompt work?

gaolebber commented 2 years ago

@reevejd jupyterlab : 3.2.1 jupyterlab-s3-browser v0.11.0-rc.1 The problem now is that I specify the configured credentials as environment variables, and there is still no browser information There is no description in the jupyterhub debug log. Can I get the log description anywhere else

gaolebber commented 2 years ago

SingleUserLabApp log:189] 404 GET /user/lebber/jupyterlab_s3_browser/files?1646633771191 (lebber@::ffff:172.24.254.210) 20.42ms ValueError: "['jupyterlab-spreadsheet@0.4.1', 'jupyterlab-topbar-extension@0.6.0', 'jupyterlab-system-monitor@0.7.0', 'jupyterlab-drawio@0.9.0', '@jupyter-widgets/jupyterlab-manager@3.0.1', '@krassowski/jupyterlab-lsp@3.10.0', 'jupyterlab-s3-browser@0.11.0']" is not a valid npm package

reevejd commented 2 years ago

@gaolebber thanks for the details. This issue should be fixed in version 0.11.1, which is now available.

gaolebber commented 2 years ago

@reevejd It has been solved perfectly. Thank you