search

manzt / zarrita.js

A JavaScript toolkit for working with chunked, compressed, n-dimensional arrays
https://zarrita.dev
MIT License
42 stars 5 forks source link

Reading a single group/dataset from azure blob storage or s3 #126

Closed gastoneb closed 1 month ago

gastoneb commented 9 months ago

Is this possible? Available examples seem to access public files only.

manzt commented 9 months ago

It is definitely possible. From a web browser you'll likely need to access datasets via HTTP endpoints for object storage. These are generally available to setup on buckets for s3/azure/gcs. You'll need to make you you set up CORs.

If you have some other authentication in mind, you may need to create your own custom store. For example, instead of using the FetchStore which uses HTTP requests and is build on the fetch API, you could implement your own storage interface for accessing data from a cloud provider. https://manzt.github.io/zarrita.js/packages/storage.html