xingyizhou / CenterTrack

Simultaneous object detection and tracking using center points.
MIT License
2.38k stars 526 forks source link

RuntimeError: Not compiled with GPU support (my eviroment is pytorch 1.4.0 ubuntu18.04) #79

Open Meteroo opened 4 years ago

Meteroo commented 4 years ago

/home/mts/anaconda3/envs/CenterTrack/bin/python /home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py tracking --load_model ../models/coco_tracking.pth --demo ../image/images --gpu 0 /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/sklearn/utils/linearassignment.py:22: FutureWarning: The linearassignment module is deprecated in 0.21 and will be removed from 0.23. Use scipy.optimize.linear_sum_assignment instead. FutureWarning) Running tracking Using tracking threshold for out threshold! 0.3 Fix size testing. training chunk_sizes: [32] input h w: 512 512 heads {'hm': 80, 'reg': 2, 'wh': 2, 'tracking': 2} weights {'hm': 1, 'reg': 1, 'wh': 0.1, 'tracking': 1} head conv {'hm': [256], 'reg': [256], 'wh': [256], 'tracking': [256]} ../image/images Creating model... Using node type: (<class 'model.networks.dla.DeformConv'>, <class 'model.networks.dla.DeformConv'>) Warning: No ImageNet pretrain!! loaded ../models/coco_tracking.pth, epoch 70 Drop parameter base.pre_hm_layer.0.weight. Drop parameter base.pre_hm_layer.1.weight. Drop parameter base.pre_hm_layer.1.bias. Drop parameter base.pre_hm_layer.1.running_mean. Drop parameter base.pre_hm_layer.1.running_var. Drop parameter base.pre_hm_layer.1.num_batches_tracked. Initialize tracking! Traceback (most recent call last): File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 129, in demo(opt) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 84, in demo ret = detector.run(img) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 119, in run images, self.pre_images, pre_hms, pre_inds, return_time=True) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 339, in process output = self.model(images, pre_images, pre_hms)[-1] File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/base_model.py", line 75, in forward feats = self.imgpre2feats(x, pre_img, pre_hm) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 635, in imgpre2feats x = self.dla_up(x) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, *kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 574, in forward ida(layers, len(layers) -i - 2, len(layers)) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 545, in forward layers[i] = upsample(project(layers[i])) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, *kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 518, in forward x = self.conv(x) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(input, *kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 128, in forward self.deformable_groups) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 31, in forward ctx.deformable_groups) RuntimeError: Not compiled with GPU support (dcn_v2_forward at /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/src/dcn_v2.h:35) frame #0: c10::Error::Error(c10::SourceLocation, std::string const&) + 0x47 (0x7f157763c687 in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libc10.so) frame #1: dcn_v2_forward(at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, int, int, int, int, int, int, int, int, int) + 0x178 (0x7f155ba59c08 in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #2: + 0x193bb (0x7f155ba673bb in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #3: + 0x15c6c (0x7f155ba63c6c in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #4: _PyCFunction_FastCallDict + 0x154 (0x5616c2db6304 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #5: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #6: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #7: PyEval_EvalCodeEx + 0x329 (0x5616c2e38a49 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #8: + 0x195864 (0x5616c2e39864 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #9: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #10: THPFunction_apply(_object, _object*) + 0x9ff (0x7f15ad15390f in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libtorch_python.so) frame #11: _PyCFunction_FastCallDict + 0x91 (0x5616c2db6241 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #12: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #13: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #14: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #15: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #16: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #17: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #18: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #19: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #20: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #21: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #22: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #23: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #24: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #25: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #26: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #27: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #28: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #29: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #30: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #31: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #32: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #33: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #34: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #35: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #36: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #37: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #38: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #39: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #40: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #41: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #42: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #43: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #44: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #45: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #46: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #47: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #48: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #49: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #50: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #51: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #52: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #53: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #54: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #55: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #56: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #57: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #58: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #59: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #60: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #61: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #62: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #63: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)

Process finished with exit code 1

wenjiey2 commented 4 years ago

/home/mts/anaconda3/envs/CenterTrack/bin/python /home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py tracking --load_model ../models/coco_tracking.pth --demo ../image/images --gpu 0 /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/sklearn/utils/linearassignment.py:22: FutureWarning: The linearassignment module is deprecated in 0.21 and will be removed from 0.23. Use scipy.optimize.linear_sum_assignment instead. FutureWarning) Running tracking Using tracking threshold for out threshold! 0.3 Fix size testing. training chunk_sizes: [32] input h w: 512 512 heads {'hm': 80, 'reg': 2, 'wh': 2, 'tracking': 2} weights {'hm': 1, 'reg': 1, 'wh': 0.1, 'tracking': 1} head conv {'hm': [256], 'reg': [256], 'wh': [256], 'tracking': [256]} ../image/images Creating model... Using node type: (<class 'model.networks.dla.DeformConv'>, <class 'model.networks.dla.DeformConv'>) Warning: No ImageNet pretrain!! loaded ../models/coco_tracking.pth, epoch 70 Drop parameter base.pre_hm_layer.0.weight. Drop parameter base.pre_hm_layer.1.weight. Drop parameter base.pre_hm_layer.1.bias. Drop parameter base.pre_hm_layer.1.running_mean. Drop parameter base.pre_hm_layer.1.running_var. Drop parameter base.pre_hm_layer.1.num_batches_tracked. Initialize tracking! Traceback (most recent call last): File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 129, in demo(opt) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 84, in demo ret = detector.run(img) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 119, in run images, self.pre_images, pre_hms, pre_inds, return_time=True) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 339, in process output = self.model(images, pre_images, pre_hms)[-1] File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/base_model.py", line 75, in forward feats = self.imgpre2feats(x, pre_img, pre_hm) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 635, in imgpre2feats x = self.dla_up(x) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 574, in forward ida(layers, len(layers) -i - 2, len(layers)) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call* result = self.forward(input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 545, in forward layers[i] = upsample(project(layers[i])) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call result = self.forward(*input, kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 518, in forward x = self.conv(x) File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call* result = self.forward(input, __kwargs) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 128, in forward self.deformable_groups) File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 31, in forward ctx.deformable_groups) RuntimeError: Not compiled with GPU support (dcn_v2_forward at /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/src/dcn_v2.h:35) frame #0: c10::Error::Error(c10::SourceLocation, std::string const&) + 0x47 (0x7f157763c687 in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libc10.so) frame #1: dcn_v2_forward(at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, int, int, int, int, int, int, int, int, int) + 0x178 (0x7f155ba59c08 in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #2: + 0x193bb (0x7f155ba673bb in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #3: + 0x15c6c (0x7f155ba63c6c in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so) frame #4: _PyCFunction_FastCallDict + 0x154 (0x5616c2db6304 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #5: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #6: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #7: PyEval_EvalCodeEx + 0x329 (0x5616c2e38a49 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #8: + 0x195864 (0x5616c2e39864 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #9: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #10: THPFunction_apply(object, object) + 0x9ff (0x7f15ad15390f in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libtorch_python.so) frame #11: _PyCFunction_FastCallDict + 0x91 (0x5616c2db6241 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #12: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #13: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #14: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #15: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #16: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #17: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #18: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #19: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #20: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #21: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #22: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #23: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #24: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #25: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #26: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #27: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #28: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #29: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #30: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #31: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #32: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #33: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #34: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #35: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #36: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #37: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #38: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #39: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #40: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #41: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #42: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #43: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #44: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #45: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #46: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #47: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #48: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #49: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #50: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #51: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #52: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #53: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #54: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #55: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #56: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #57: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #58: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #59: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #60: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #61: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #62: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python) frame #63: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)

Process finished with exit code 1

Were you able to solve this issue? I am facing the same problem with pytorch 1.4.0-py3.6_cuda101_cudnn7_0 and torchvision 0.5.0-py36_cu101. It is invoked by _backend.dcn_v2_forward where _backend should be _ext built from make.sh. I'm not sure if _ext refers to this _ext.cp36-win_amd64.pyd file. Not sure how to proceed from here.

sradmard commented 3 years ago

Hi. I am also facing the same issue with pytorch=1.2.0, cudatoolkit 10.0.130, torchvision=0.8.1, under ubuntu 20.04 and Cuda version 11.0. I would appreciate any hint on how to resolve it.

sradmard commented 3 years ago

I managed to fix it by getting pytorch==1.4.0, torchvision==0.5.0 installed under my conda environment, so during setting up your conda environment type in:

conda install pytorch==1.4.0 torchvision==0.5.0 -c pytorch

Before installing the requirements at step 4, comment the nuscenes-devkit under the requirement.txt file so that it wouldn't upgrade your pytorch and torchvision. Before compiling DCNv2 at step 5, make sure you have nvcc and gcc, g++ less than 8 (I downgraded them to gcc-7 and g++-7). To make sure your have nvcc installed type in nvcc --version. If it says it is not installed, type in the following under your CenterTrack conda environment:

conda install -c conda-forge cudatoolkit-dev

You can have multiple gcc and g++ version installed on your machine, and you can switch between them. Follow the instructions here.

Finally finish steps 5 and 6, making sure your DCNv2 compiles properly. Afterwards, you should be good to go.

Keiku commented 3 years ago

@Meteroo @wenjiey2 Since the issue has been linked with #XX, enclose it as a code block with ``` ``` as shown below.

frame #1: dcn_v2_forward(at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, int, int, int, int, int, int, int, int, int) + 0x178 (0x7f155ba59c08 in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so)
frame #2: + 0x193bb (0x7f155ba673bb in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so)
zpge commented 3 years ago

I am faceing the same prolem.

  File "CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 191, in forward
    self.deformable_groups,
  File CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 39, in forward
    ctx.deformable_groups,
RuntimeError: Not compiled with GPU support
BruceYu-Bit commented 3 years ago

I am faceing the same prolem.

  File "CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 191, in forward
    self.deformable_groups,
  File CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 39, in forward
    ctx.deformable_groups,
RuntimeError: Not compiled with GPU support

Have u solved it?

fabrizioschiano commented 3 years ago

@BruceYu-Bit , @zpge , @Keiku any news on this?

fabrizioschiano commented 3 years ago

After some research, I understood that the problem was that I actually did not have CUDA installed.

You can find it out by doing:
nvcc –V

If nothing is returned it means that you did not install CUDA

I followed all this:

https://docs.nvidia.com/cuda/cuda-installation-guide-linux/

And I installed CUDA with the following official link

https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=20.04&target_type=deb_local

I think that the following is optional and not needed to solve the problem of

RuntimeError: Not compiled with GPU support

However, after what's explained above, I did installed the nvidia-development-kit simply with

sudo apt install nvidia-cuda-toolkit

Then you can do:

export CUDA_HOME=/usr/local/cuda-11

(before doing it you should check that this is the folder in which CUDA has been installed on your machine)

I hope this helps someone else in the same situation.

sainttelant commented 2 years ago

yes, same issue i face, it is so weird, and annoying, my environment is

ubuntu18.04, rtx3090 nvidia, so i have to use (https://github.com/MatthewHowe/DCNv2/branches) to compile DCNv2, my torch version is Name: torch , Version: 1.7.0+cu110, Name: torchvision,Version: 0.8.1+cu110, finally, i successfully complied the DCN. and import DCN success!!!!!

However, i still get the error of RuntimeError: Not compiled with GPU support , i 've double checked that the nvidia driver and cuda are installed properly, i have no idea why this error popped out, i will appreciated so much if you have some problem and solved it. plz let me know

fabrizioschiano commented 2 years ago

hi @sainttelant , could you give us the result of the following commands:

nvcc --version

and

nvidia-smi

I might help you understing what is the problem.

Also, are you using a virtual environment (conda, virtualenv, or similar)?

sainttelant commented 2 years ago

@fabrizioschiano, as following shows: nvcc-V 1637806624(1)

and nvidia driver has been installed, rtx3090, so it is so weired, why there is still not compiled with GPU support errors! and i runed the application on conda envs, by the way, the logged account of ubuntu18.04 has no suder authority,however, i 've checked the command of export LD_LIBRARY_PATH been written in the bashrc!

1637807153(1)

1637806766(1)

sainttelant commented 2 years ago

@fabrizioschiano That is great, i solved it , it is so tricky that the system can't find the path of ....../nvcc file even though it can display when input nvcc-V. i tryed to grant the account of soder authority, after that operations, i recompiled the ./make.sh in DNCv2. then the problem is solved.

i hope it will be helpful if someone faced a similar issue..... NICE, thanks anyway.

fabrizioschiano commented 2 years ago

Good! Thanks that I could help you @sainttelant .

elkoz commented 2 years ago

Using a docker container following the instructions at #176 was the only thing that helped in my case

xinyang-kul commented 1 year ago

@fabrizioschiano That is great, i solved it , it is so tricky that the system can't find the path of ....../nvcc file even though it can display when input nvcc-V. i tryed to grant the account of soder authority, after that operations, i recompiled the ./make.sh in DNCv2. then the problem is solved.

i hope it will be helpful if someone faced a similar issue..... NICE, thanks anyway.

Hi, could you please clarify the meaning of "soder authority"? was it "sudo authority"?