Copy uploaded builds with timestamp to archive

fiji / fiji-builds

Downloadable Fiji bundles

https://downloads.imagej.net/fiji/latest/

5 stars 3 forks source link

Closed frauzufall closed 5 years ago

frauzufall commented 5 years ago

This PR copies the uploaded files from latest to archive/TIMESTAMP. TIMESTAMP is something like 20190820-1344.

The goal is to save future builds with a timestamp in https://downloads.imagej.net/fiji/archive/.

Warning: I only tested this locally without ssh.

frauzufall commented 5 years ago

An open question might be if we want to archive every time or only once a week / ...When is this job executed? Is this a daily thing?

ctrueden commented 5 years ago

@frauzufall and I did some crunching on how much space this will really take in practice over time.

There have been 16 uploads to sites.imagej.net/Java-8 in 2019. This works out to roughly ~20-25 updates per year.
Each collection of Fiji bundles is <4GB. So 25*4=100GB/year.
We have ~2TB free currently on the box.
So even after 10 years it's probably fine to archive every upload, at least for the near future.