search

martahedl / SC-construction-using-MSMT-CSD

0 stars 0 forks source link

Consider removal of derivative data #17

Open Lestropie opened 2 months ago

Lestropie commented 2 months ago

Currently the Docker image internally stores the OSF-hosted derivatives data. The reasoning was to allow people to use the container to visualise intermediate steps of the protocol without necessitating re-execution of the protocol (have not yet added to the README instructions how to mount that specific location). It does however increase the size of the image. It is alternatively possible for someone to just download those data manually onto their host system and mount it.

There is a certain elegance to having those data embedded in the image allowing anyone to cross-check what the protocol produces for the example data on their system against what it was supposed to generate. But it depends on whether that's worth the cost of the storage space.

Lestropie commented 2 months ago

The prospect of raised of providing within the container a script that would download the sample data to a specified host OS mount location. I expressed disagreement initially, but after more thought am not entirely opposed to the idea.

Lestropie commented 2 months ago

The derivative data are ~ 1.5GB uncompressed, compared to the image that is total 15.5GB compressed & 34.0GB uncompressed. So I don't think the basis of storage space justifies their removal.