NYU-Molecular-Pathology / snsxt

bioinformatics pipeline framework for data analysis
GNU General Public License v3.0
4 stars 3 forks source link

Need to have background qsub job queue for the program #8

Closed stevekm closed 7 years ago

stevekm commented 7 years ago

If an analysis tasks is run with qsub_wait = False, the task will not wait for qsub jobs to finish before moving on to the next task. However, the snsxt program as a whole should still wait for these jobs to finish before completing and moving on to tasks such as report setup & generation. Need to instead put these un-waited jobs in a background queue within the program so that the program waits for all of them to finish before completing.

stevekm commented 7 years ago

functionality has been implemented, but now pre-existing tasks may need to be refactored to ensure that qsub job objects are always returned from analysis tasks that submit them

stevekm commented 7 years ago

done