pmj110119 / RenderOcc

[ICRA 2024] RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision. (Early version: UniOcc)
447 stars 25 forks source link

Memory leak #26

Closed samernanoxx closed 10 months ago

samernanoxx commented 11 months ago

Hi, when I train RenderOcc. The CPU memory keeps increasing as training continues, leading then to fully exhausting the CPU memory and eventually killing the job. Has anyone been able to reproduce this? When monitoring the CPU memory usage, I see it increasing by each iteration and never stabilizes. I would appreciate it if someone could test this as well.

samernanoxx commented 11 months ago

After examination, issue occurs here link but not sure why CPU memory keeps increasing when running this.