califano-lab / single-cell-pipeline

40 stars 8 forks source link

Consolidation #6

Open hd2326 opened 6 years ago

hd2326 commented 6 years ago

Current problem:

For instance, one bootstrap aborted during running.

Such issue will ignite a re-submission of that aborted bootstrap (jid=ar*) and new job checking (jid=chk*) through checkjobs.r.

The consolidation job (jid=net*) is depend on job checking (jid=chk) for the first round, but the re-submitted job checking (jid=chk_) is not visible although both job checking have same jid.

Therefore the consolidation job (jid=net_*) will start even that re-submitted bootstrap is still running.

Solve the problem:

The consolidation.r will make sure all bootstraps are completed before proceeding.

Updates available in the new commit @ master.