Open itsmasabdi opened 1 year ago
Hey, you can try the following:
You can follow this guide: https://huggingface.co/docs/transformers/perf_train_gpu_one
Hi, @deepanwayx I would like to ask if you have trained tango with deepspeed? I have encountered some problems. Can you provide some advice?
Hi.
I'm trying to train this model on a single P100 with 16 GB memory but seem to be running out of memory with a batch size of 2. Do I need more than 16 GB for this model? How can I reduce the GPU memory usage?
Cheers,