AllenInstitute / biofile-finder

An open-use web application created for easy access, collaboration, and sharing of datasets through rich metadata search, filter, sort, and direct viewing in common industry applications or in our web-based 3D Volume Viewer.
https://biofile-finder.allencell.org/
BSD 3-Clause "New" or "Revised" License
3 stars 1 forks source link

Feature Request: Local / Cloud upload/delete toggle. #289

Open BrianWhitneyAI opened 5 days ago

BrianWhitneyAI commented 5 days ago

We currently upload files to both local (Vast) storage and cloud (S3) storage. There is a limited amount of storage on the Vast and as we continue to upload files we are quickly reaching this ceiling. In order to resolve this we are changing our policy of uploading all files to Vast and Cloud in favor of doing Cloud only uploads. However we want to allow users to move files into a local location for ease of access as well as remove files they know that they will no longer need advanced access from the Vast.

This issue contains the following

SeanLeRoy commented 5 days ago

Need to update the ETL to have the path be passed onto BFF. Since we won't always have a local path now.

BrianWhitneyAI commented 5 days ago

Need to update the ETL to have the path be passed onto BFF. Since we won't always have a local path now.

Not sure here since the path property will still exist itll just have should_be_in_local = false