Aws - Githubissues

int-brain-lab / ONE

Open Neurophysiology Environment

MIT License

17 stars 5 forks source link

Aws #51

Closed oliche closed 2 years ago

oliche commented 2 years ago

Hi, This is an AWS backend to download files and folders. I wanted to re-use what was already done and have a single point of focus to download from S3 in both private and public repos.

This is now currently used for:

aws backend to ONE private
aws backend to open alyx RS release
ibllib.atlas backends files
spike sorting benchmark datasets

I envision we will also use this kind of functions for intermediate data results.

Cheers

k1o0 commented 2 years ago

I'll merge this along with the globus branch once I've updated the docstrings. Can we rename s3_download_public_folder to s3_download_folder? I'd like to make ONE as generic as possible.