biigle / core

:large_blue_circle: Application core of BIIGLE
https://biigle.de
GNU General Public License v3.0
12 stars 15 forks source link

Move all storage to disks #181

Closed mzur closed 5 years ago

mzur commented 5 years ago

Use storage disks for everything, so object storage can be used instead of a local disk. Check if Swift can handle a few million objects in a single container first (ref). Locally stored items are (checked are using disks):

mzur commented 5 years ago

Imports can stay ephemeral. They should be stored only for a few minutes anyway and are not very large or numerous.

mzur commented 5 years ago

As Largo, MAIA and the thumbnails are accounted for, this has no high priority any more. These three account for most of the required storage space.

mzur commented 5 years ago

Video thumbnails will be stored in a storage disk when biigle/videos#33 is merged. This is done.