Rather than having each of the four download groups (DICOMs, raw converted DICOMs, derivatives, supplementary) appear on OSF as directories, they could instead be presented as tarballs. This should:
Make download statistics based on docker builds count
Streamline Dockerfile, as it can curl pipe to tar xz rather than storing an intermediate zip file
For some weird reason I have however had problems getting this to work. Even without the piping. I can on my native system run a curl, write to file, then tar xzf, and it works fine; but the exact same commands run inside of Dockerfile somehow result in a corrupt tarball. So for now I'm going to re-upload the exemplar data from the latest protocol (0.2.0) as individual files, and leave the issue documented here.
As mentioned in email chain.
Rather than having each of the four download groups (DICOMs, raw converted DICOMs, derivatives, supplementary) appear on OSF as directories, they could instead be presented as tarballs. This should:
docker builds countDockerfile, as it cancurlpipe totar xzrather than storing an intermediate zip fileFor some weird reason I have however had problems getting this to work. Even without the piping. I can on my native system run a
curl, write to file, thentar xzf, and it works fine; but the exact same commands run inside ofDockerfilesomehow result in a corrupt tarball. So for now I'm going to re-upload the exemplar data from the latest protocol (0.2.0) as individual files, and leave the issue documented here.