Multiple GPU support for dorado?

[Amekn]

Hi Team

I am currently running dorado on my Macbook with M1 max and 32 GB unified memory. However I am considering building a workstation for dorado base calling and correct. My plan is to purchase two RTX Ada 4000, each with 20 GB VRAM. Is it possible to use both GPU in a single workload for dorado base caller or dorado correct (So 40 GB VRAM in total is accessible by a single task/process)?

[malton-ont]

Hi @Amekn,

Dorado will attempt to use all present GPUs by default. You can override this by setting the -x parameter - for example to use only the second GPU, you should set -x cuda:1. From dorado basecaller -h:

-x, --device                  Specify CPU or GPU device: 'auto', 'cpu', 'cuda:all' or 'cuda:<device_id>[,<device_id>...]'.
                              Specifying 'auto' will choose either 'cpu', 'metal' or 'cuda:all' depending on the presence of a GPU device
                              [nargs=0..1] [default: "auto"]

[Amekn]

Thanks for that🙂.