Support for GCP bucket access?

deeptools / pyBigWig

A python extension for quick access to bigWig and bigBed files

MIT License

212 stars 48 forks source link

Support for GCP bucket access? #107

Closed francois-a closed 3 years ago

francois-a commented 3 years ago

Hi, Apologies if I missed this, but is there a way to read files directly from Google buckets?

ghuls commented 3 years ago

By using fsspec, it should be easy to add support for Google buckets, S3 buckets, ...:

FSSPEC: Filesystem interfaces for Python

Filesystem Spec (FSSPEC) is a project to unify various projects and classes to work with remote filesystems and file-system-like abstractions using a standard pythonic interface. https://filesystem-spec.readthedocs.io/en/latest/

dpryan79 commented 3 years ago

I really would like to avoid adding direct support for the various cloud storage mechanisms. Please use fuse or something like that to mount the buckets locally. That allows any tool to use data there and we don't then have to modify many thousands of packages.