DerrickXuNu / OpenCOOD

[ICRA 2022] An opensource framework for cooperative detection. Official implementation for OPV2V.
https://mobility-lab.seas.ucla.edu/opv2v/
Other
663 stars 99 forks source link

CUDA memory usage varies #42

Closed yifanlu0227 closed 1 year ago

yifanlu0227 commented 2 years ago

Hi runsheng,

Thanks for your framework again! One thing bothers me that I found that the CUDA memory usage varies a lot at runtime. Is there any solution to fix the memory usage? Then my program would not be preempted by others :).

Thank you in advance.

DerrickXuNu commented 2 years ago

Hi Yifan, is it during training or inference?

yifanlu0227 commented 2 years ago

during the training phase

DerrickXuNu commented 2 years ago

I see. This is probably caused by different frames have different number of cavs. Sometime there are 3 agents but sometime 5.