Open hume2011 opened 4 years ago
I got this issue when I tried to train model with distance regression on 8 blobs of nuScenes:
During training, the usage of memory continues to rise until the usage of swap reaches 100%, then the training stops, and no error is reported.
Please help me with this.Thanks!
config: batchsize=1
@hume2011 This might be related to multiprocessing, which keeps opening new processes. Maybe the processes don't get shut down properly?
Anyone could solve that?
I got this issue when I tried to train model with distance regression on 8 blobs of nuScenes:
During training, the usage of memory continues to rise until the usage of swap reaches 100%, then the training stops, and no error is reported.
Please help me with this.Thanks!
config: batchsize=1