search

jwyang / fpn.pytorch

Pytorch implementation of Feature Pyramid Network (FPN) for Object Detection
MIT License
955 stars 224 forks source link

Cuda Error: invalid argument nms_cuda_kernel.cu #18

Closed ljtruong closed 6 years ago

ljtruong commented 6 years ago

I'm experiencing a CUDA error when running the scripts. There errors occurs here. in lib/model/nms/src/nms_cuda_kernel.cu. The error is: CUDA Error: invalid argument, at line 147 CUDA Error: invalid argument, at line 154 which I assuming is referring to the line in the nms cuda kernel.

When executing nms in this line, of lib/model/rpn/proposal_layer_fpn.py nms(torch.cat((proposals_single, scores_single), 1), nms_thresh).

as a check, I have ensured in the make.sh file I changed compute to my gtx1080. I'm using pytorch 0.4 with python 2.7.

I haven't worked with cuda files before so I'm not too sure how to solve this.

tyyyang commented 6 years ago

add --cuda flag when running test_net

ljtruong commented 6 years ago

Solved.