jamesavery / maxibone

SRμCT Bone tomography analysis
0 stars 0 forks source link

Write scripts that automatically download ESRF data from ERDA with SFTP on demand #10

Closed jamesavery closed 2 years ago

jamesavery commented 2 years ago

It's a huge bother to transfer the original ERDA data, requiring a bunch of manual work.

Instead, a script should automatically create the local directory structure under {esrf_root_local}/{experiment}/ (where {experiment} is e.g. "esrf_dental_implants_2013" or "esrf_dental_granules"), and cleanup afterwards as well. This data set is too large to have fully instantiated on local disk (500GB to 1TB per sample when raw_data, pag and nopag are all included).