I have two point clouds loaded as a torch tensor and can correctly create a open3d.t Point cloud and multi-ICP is working with 1.9GB GPU memory occupied but after 100 point cloud pair predictions the memory jumps to 3GB and after the 250th pair it runs out of memory.
I also tried to specificaly del source_pcd, target_pcd without help.
RuntimeError: [Open3D Error] (void open3d::core::__OPEN3D_CUDA_CHECK(cudaError_t, const char*, int)) /root/Open3D/cpp/open3d/core/CUDAUtils.cpp:289: /root/Open3D/cpp/open3d/core/MemoryManagerCUDA.cpp:24 CUDA runtime error: out of memory
Expected behavior
No response
Open3D, Python and System information
- Operating system: Ubuntu 20.04
- Python version: Python 3.9
- Open3D version: 0.17.0 (same problem in 0.16.0)
- System architecture: x86
- Is this a remote workstation?: yes
- How did you install Open3D?: pip
Checklist
master
branch).Describe the issue
I have been running multi ICP in the tensor form and whenever I reach a certain sample it runs to out of memory:
I used this example as help: http://www.open3d.org/docs/release/tutorial/t_pipelines/t_icp_registration.html#Multi-Scale-ICP-Example
I have two point clouds loaded as a torch tensor and can correctly create a open3d.t Point cloud and multi-ICP is working with 1.9GB GPU memory occupied but after 100 point cloud pair predictions the memory jumps to 3GB and after the 250th pair it runs out of memory.
I also tried to specificaly
del source_pcd, target_pcd
without help.I hope you can help me.
Steps to reproduce the bug
Error message
RuntimeError: [Open3D Error] (void open3d::core::__OPEN3D_CUDA_CHECK(cudaError_t, const char*, int)) /root/Open3D/cpp/open3d/core/CUDAUtils.cpp:289: /root/Open3D/cpp/open3d/core/MemoryManagerCUDA.cpp:24 CUDA runtime error: out of memory
Expected behavior
No response
Open3D, Python and System information
Additional information
No response