search

bingykang / Fewshot_Detection

Few-shot Object Detection via Feature Reweighting
https://arxiv.org/abs/1812.01866
526 stars 111 forks source link

Some questions about memory usage when training base model #33

Open vaynelau opened 4 years ago

vaynelau commented 4 years ago

When I trained the base model, I observed that the memory usage continued to rise and finally reached the maximum limit and the process was killed. My RAM is 250GB and I used four 16GB Tesla V100 GPU. I tried to decrease the batch size but it did not make any difference. I wonder how much memory you used during the base training and if there is something wrong I did. Thank you.

lijuncai794 commented 3 years ago

When I trained the base model, I observed that the memory usage continued to rise and finally reached the maximum limit and the process was killed. My RAM is 250GB and I used four 16GB Tesla V100 GPU. I tried to decrease the batch size but it did not make any difference. I wonder how much memory you used during the base training and if there is something wrong I did. Thank you.

Hello, I meet this problem too. Have you solved it?

zhanghao5 commented 3 years ago

decrease the batch size if you do not have a high end GPU