Open woqiang0515 opened 1 year ago
Could you please provide details about the model and the number of GPUs used in the script provided in the example?
We used 8 V100 GPUs (32GB each), and batch size of 1 for both train and dev, we still encounter Out Of Memory (OOM) issues.
@woqiang0515 were you able to resolve it? I am facing the same issue
Could you please provide details about the model and the number of GPUs used in the script provided in the example?
We used 8 V100 GPUs (32GB each), and batch size of 1 for both train and dev, we still encounter Out Of Memory (OOM) issues.