search

dekkerlab / cLIMS-docker

cLIMS repository running on Docker Contaienrs
GNU Lesser General Public License v3.0
3 stars 4 forks source link

alternative storage on s3/glacier #92

Open sergpolly opened 1 year ago

sergpolly commented 1 year ago

@Snehal1894 here is the "if" for the alternative storage on S3:

if path starts with "/pi/job.dekker-umw/cshare/data/" :
    replace it with "s3://dekkerlab-backups/nl/cshare/data/"
elif path starts with "/pi/job.dekker-umw/archive/cshare/" :
    replace it with "s3://dekkerlab-backups/cshare/"
elif path starts with "/pi/job.dekker-umw/archive/tmp_cshare/" :
    replace it with "s3://dekkerlab-backups/tmp_cshare/"
else:
    this should not happen - good time to check !?

so that's how it matches:

s3://dekkerlab-backups/nl/cshare/data/2020/fastq/03MAR20_C-Monster-A/*  /pi/job.dekker-umw/cshare/data/2020/fastq/03MAR20_C-Monster-A
s3://dekkerlab-backups/cshare/solexa/*      /pi/job.dekker-umw/archive/cshare/solexa/*
s3://dekkerlab-backups/tmp_cshare/solexa/*      /pi/job.dekker-umw/archive/tmp_cshare/solexa/*