Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
This is a pull request to add GPU support for AWS cromwell runs.
Basically this creates a job definition that will allow you passes GPU count to the AWS Batch.
This will require the task to define a queue that has GPU instance, otherwise aws batch will fail to assign resource to it and the job will be stuck at runnable
I have some question about the creation of the job definition. Right now im creating a job definition without GPU count - so that both CPU and GPU jobs can use the same job definition. But if is desired keep 2 separate job definition, let me know and i can add it.
We have tested this with cellblender
Let me know if there is any issue/task/test that you will like me to run before hand! Thanks!
Hi friends,
This is a pull request to add GPU support for AWS cromwell runs. Basically this creates a job definition that will allow you passes GPU count to the AWS Batch.
This will require the task to define a queue that has GPU instance, otherwise aws batch will fail to assign resource to it and the job will be stuck at runnable
I have some question about the creation of the job definition. Right now im creating a job definition without GPU count - so that both CPU and GPU jobs can use the same job definition. But if is desired keep 2 separate job definition, let me know and i can add it.
We have tested this with cellblender
Let me know if there is any issue/task/test that you will like me to run before hand! Thanks!