search

NCI-CGR / IlluminaSequencingAnalysis

All Illumina Sequencing Related project from Xin will be recorded in this repo
0 stars 0 forks source link

Customized QC: multiple changes for "CustomizedQC.py", " DataReconstruct.py", "MergeQCReport.py" and "Backup2S3.py" #30

Open lxwgcool opened 3 years ago

lxwgcool commented 3 years ago

CustomizedQC.py

  1. Add Mia into email list
  2. Print some additional info in log file for debug
  3. Update the caption of notification email
  4. Update the file name of QC report append flowcell name

DataReconstruct.py

  1. Add a function to make the imperfect match (allow 1 bp diff)
  2. Print some additional info in log file for debug

MergeQCReport.py

1 Update the method to find existing csv file (since csv file name has been updated)

Backup2S3.py

  1. Add time stamp in log file
  2. Change the logic to backup flowcells
    • Old: check one flowcell and backup it, and then next.
      • This will bring us some unexpected issues, since backup takes time & the status of some flowcell may be changed during that time (e.g. from running to finished). Therefore, you can not control how many flowcell show be backup at the beginning.
    • New: scan all finished flowcells, add them into a list, and then backup these flowcells.
      • So everything is under control.