NASA is working on a similar extension (S3A+)

[rabernat]

At the ESIP2022 meeting, I learned that NASA is developing a new S3 Jupyterlab Extension with the following features

S3A+ or S3 Actions Plus is a Jupyterlab extension that allow you to use a ui on your Notebook to:

• Show a list of available datasets in your notebook )for now we only support datasets in AWS buckets)
• Connect to any S3 bucket or key that you have access to (By connect I mean adding them to the list of buckets that you can browse and do S3A+ actions)
• Browse and connect to Public DataSets (We support AWS Public Datasets currently)
• Right click on buckets or dataset and mount them to your file-system on the notebook with Goofy's
• Right click on a dataset and add an event driven action (event likes new file upload to the dataset, file deleted, etc. For instance turn a zarr dataset into a COG whenever a new zarr is uploaded) We are are realizing the first version of this Jlab extension soon and are hoping to make it Open Source ASAP

Tagging @rezuma for potential collaboration points with this project.

[rezuma]

@rabernat We built a complete new extension that fits better with our requirements The goal is to make it open source, soon, hopefully before the end of January 23 The first version would allow you to:

• Browse and upload/download files and "folders" from buckets that are accessible from the server where the Notebook is running. For example. Buckets on the same AWS account where the notebook is, buckets from other AWS accounts (Cross account access)
• It would also be possible to access public datasets from the different cloud providers AWS, GCP and Azure
• There would be a favourites tab where you can add most frequently access datasets .... You can see a video example here https://www.youtube.com/watch?v=Lo7P5wvcOeg

We welcome feedback and are willing to demo this jlab extensions and others that are part of the Open Science Studio platform (API Baker, AI PLatform Support, NLP for each notebooks, etc) Open Science Studio platform and all its extensions will be open source too. You can reach me at rlinan@navteca.com

[octavd]

hello @rabernat @rezuma looking forward for this release. Good luck with it. :)

[octavd]

Hello @rezuma , any news regarding this new extension?

[rezuma]

@octavd @rabernat We made the extension open source bexplorer (to interact with AWS S3 buckets, public datasets and cross account buckets, in the future we hope to add support for Azure Blob and Google bucket) https://github.com/Navteca/jupyterlab-bxplorer

We also made open source Pasarela, a server side extension that allow to launch a notebook from any external web app. It creates an API on the Jhub server, and you can pass a full notebook to be opened or just some specific code that will get opened in the first cell. https://github.com/Navteca/oss-pasarela