What if I have three graphics cards?

AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP

Apache License 2.0

1.38k stars 183 forks source link

Open lianuo opened 4 months ago

lianuo commented 4 months ago

I have rtx3090 1, rtx 3060 16G 2, total mem is 24+16 * 2=56G In this case, is it possible to finetune models?

bilalghanem commented 4 months ago

If they are connected to the same server, yes! but I think you won't be able to use more than 16G in each one.