search

mila-iqia / milatools

Tools to connect to and interact with the Mila cluster
MIT License
63 stars 12 forks source link

Long term storage is being provisioned by IDT, we should supoprt it #16

Open manuel-delverme opened 2 years ago

manuel-delverme commented 2 years ago

mila.Archive: Moves (or copies) folders in user’s the mila google drive, useful for long term storage of old projects

mila archive path/to/my/folder/ # returns permalink to resource. mila restore path/to/google/drive/folder/ .

We had this in the design doc.

Initially the storage will be gdrive so we should have that implemented first, later on there should be mila local storage and we should swap backend to that transparently to the user, worst case with some annoying warning like: "Please run mila defrag to move all your drive (deprecated) files to local disks."

(sorry wrote it during IT committee meeting)