Open LucasOyarzun opened 10 months ago
Hello, unfortunatelly we do not have a multi-GPU computer available in our lab, so we cannot test this case. Although I believe you may meet the memory requirements of pretraining, if you are using a 24GB GPU (probably a 16GB GPU will also be enough). For finetuning 8GBs of GPU RAM is enough.
Hello, I want to try training with 3 GPUs, can you help me set up the repository for this?
I just naively changed the trainer's devices to 3, but it threw errors. Could you help me?
Here are the logs: