Running nextflow jobs currently requires an interactive session somewhere, which is apain, because it has to run the whole time the batch job runs.
We'd like to be able to run our nextflow processes that submit to batch in another batch process. That will require a new queue with on-demand instances (so they don't get interrupted)
Running nextflow jobs currently requires an interactive session somewhere, which is apain, because it has to run the whole time the batch job runs.
We'd like to be able to run our nextflow processes that submit to batch in another batch process. That will require a new queue with on-demand instances (so they don't get interrupted)
Some background/ example info: https://genomics-nf.workshop.aws/squared.html