I would like to know about the memory requirements of the model. I am trying to run the original model on 2 48GB GPUs through PyTorch DDP. However, it is giving me OOM error. I'm also performing some transformations on the images as well. Can anyone please tell how much space does the model take and how can I reduce the model size without hurting the performance?
Hello everyone.
I would like to know about the memory requirements of the model. I am trying to run the original model on 2 48GB GPUs through PyTorch DDP. However, it is giving me OOM error. I'm also performing some transformations on the images as well. Can anyone please tell how much space does the model take and how can I reduce the model size without hurting the performance?