search

NCI-CGR / IlluminaSequencingAnalysis

All Illumina Sequencing Related project from Xin will be recorded in this repo
0 stars 0 forks source link

Auto-decide how many flowcells can be run parallelly #23

Open lxwgcool opened 3 years ago

lxwgcool commented 3 years ago

Motivation

1: The storage space is very limited! 2: Run a flowcells requires the maximum 18 TB (tmp ROM)

Solution

Decide how many flowcells can be run dynamically

  1. Check remaining quota
  2. Check how many flowcells can be support
    • new run
    • finished flowcell
    • un-processed flowcell
    • working flowcell: if the phase of SAM file generating has been finished
lxwgcool commented 3 years ago
  1. For the latest batches uploaded by Clifton on July, many flowcells only contains 1 or 2 flowcells.
  2. As a result, we need to upgrade the algorithm by checking the available storage space based on fixed sample size (0.7T) rather than flowcell (16T)
  3. In this way many flowcell contain small number of samples can be run simultaneously.