FredHutch / batchman

Batchman - Nextflow on Fargate x AWS Batch
6 stars 1 forks source link

multiple back ends #80

Open dtenenba opened 4 years ago

dtenenba commented 4 years ago

The ability to submit nextflow workflows not just to AWS Batch but to (for example) Fred Hutch's on-prem Slurm cluster. If the nextflow head node is in a VPC connected to FH's network, it can theoretically submit to this cluster, but we might be discussing having that head node hosted somewhere else, perhaps on on-prem infrastructure (the nextflow head node for AWS batch submissions would remain where it is).

This would have to tie in with the authentication piece such that batchman would know who the user is so that it can submit jobs as that user.