transfer data for run 130322_SN911_0130_AC1GMUACXX

Commands below assume, this variable has been set: RUNID=130322_SN911_0130_AC1GMUACXX

[x] TRANSFER DATA rabbot$ qsub -v DIR=$RUNID ~/bin/hiseq-rsync.pbs 84.rabbotcluster.bio.nyu.edu -- FAILED 85.rabbotcluster.bio.nyu.edu -- FAILED 87.rabbotcluster.bio.nyu.edu -- FAILED 99.rabbotcluster.bio.nyu.edu -- DONE
[x] BACKUP to sftp.bio rabbot:$ qsub -v DIR=$RUNID ~/bin/hiseq-backup.pbs 188.rabbotcluster.bio.nyu.edu -- DONE
[x] COPY SAV FILES rabbot$ qsub -v DIR=$RUNID ~/bin/hiseq-rsync-SAV-files.pbs 189.rabbotcluster.bio.nyu.edu -- FAILED 208.rabbotcluster.bio.nyu.edu -- FAILED 265.rabbotcluster.bio.nyu.edu -- FAILED 293.rabbotcluster.bio.nyu.edu -- DONE
[x] Give Sebastien permissions: bowery$ cd /data/cgsb/gencore-raw/HiSeq/ $ find $RUNID -type d -exec setfacl -m u:sm4431:rx,m:rwx {} \; -- DONE $ find $RUNID -type f -exec setfacl -m u:sm4431:r,m:rwx {} \; -- DONE
[x] SECURE DATA bowery$ screen -S chattr-130 bowery-0-1$ ~/bin/hiseq-chattr.sh $RUNID -- DONE
[x] RUN DIRCMP on rabbot $ qsub -v DIR=$RUNID ~/bin/hiseq-dircmp.pbs 131.rabbotcluster.bio.nyu.edu -- DONE
[x] RUN DIRCMP on OLB directory Created script to run: ~/code/dircmp/dircmp digest \ -parse-tree /scratch/sm4431/gencore_olb/130322_SN911_0130_AC1GMUACXX \ -print-to /home/aa144/tmp/filer-130322_SN911_0130_AC1GMUACXX-OLB.dircmp.txt

132.rabbotcluster.bio.nyu.edu -- DONE

[x] RUN DIRCMP on bowery
$ qsub -v DIR=$RUNID /data/cgsb/gencore-raw/bin/dircmp.pbs
1533802.crunch.local -- DONE

VALIDATE DATA Need to do 2 comparisons:

[x] rabbot:/scratch/sm4431/gencore_olb/$RUNID vs bowery:/data/cgsb/gencore-raw/HiSeq/$RUNID
These should be identical modulo presence of intensity files on the rabbot side.

$ grep -v "Data/Intensities/L00[1-8]/C" filer-130322_SN911_0130_AC1GMUACXX-OLB.dircmp.txt > ~/tmp/filer-130322_SN911_0130_AC1GMUACXX-OLB.dircmp.txt.grep
$ diff ~/tmp/filer-130322_SN911_0130_AC1GMUACXX-OLB.dircmp.txt.grep bowery-130322_SN911_0130_AC1GMUACXX.dircmp.txt
1c1
< Root /scratch/sm4431/gencore_olb/130322_SN911_0130_AC1GMUACXX

---
> Root /data/cgsb/gencore-raw/HiSeq/130322_SN911_0130_AC1GMUACXX

[x] rabbot:/mnt/gencore-raw/$RUNID vs rabbot:/scratch/sm4431/gencore_olb/$RUNID
These should be identical modulo presence of Bustard directory in the OLB directory.

$ grep -v "Data/Intensities/Bustard1.9.4_11-04-2013_sm4431" filer-$RUNID-OLB.dircmp.txt > ~/tmp/filer-$RUNID-OLB.dircmp.txt.grep
$ diff filer-$RUNID.dircmp.txt ~/tmp/filer-$RUNID-OLB.dircmp.txt.grep
1c1
< Root /mnt/gencore-raw/130322_SN911_0130_AC1GMUACXX

---
> Root /scratch/sm4431/gencore_olb/130322_SN911_0130_AC1GMUACXX

cgsb / hitscore

transfer data for run 130322_SN911_0130_AC1GMUACXX #19