CUDA kernel failed : an illegal memory access was encountered

mit-han-lab / pvcnn

[NeurIPS 2019, Spotlight] Point-Voxel CNN for Efficient 3D Deep Learning

https://pvcnn.mit.edu/

MIT License

636 stars 129 forks source link

CUDA kernel failed : an illegal memory access was encountered #63

Closed XinYu-Andy closed 2 years ago

XinYu-Andy commented 2 years ago

Hi, I am using part of your code to build another program. However, I got the following error message when I ran the code on multiple GPUs. Any suggestions for solving this problem? Thanks.

CUDA kernel failed : an illegal memory access was encountered void three_nearest_neighbors_interpolate(int, int, int, int, const float, const float, const float, int, float, float) at L:130 in /mnt/backup2/home/pgchen/lzz/diffusion/my_pvd/point_tool/modules/functional/src/interpolate/neighbor_interpolate.cu

XinYu-Andy commented 2 years ago

I have fixed this bug; It's a bug of MPI (not a part of this codebase). I will close this issue.

szy4017 commented 7 months ago

I have fixed this bug; It's a bug of MPI (not a part of this codebase). I will close this issue. Hi, I meet the same problem. I don't know how to fix the bug of MPI. Any suggestions for solving this problem? Thanks.