File "/home/mengce/simple-faster-rcnn-pytorch/train.py", line 132, in
fire.Fire()
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 127, in Fire
component_trace = _Fire(component, args, context, name)
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 366, in _Fire
component, remaining_args)
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 542, in _CallCallable
result = fn(*varargs, **kwargs)
File "/home/mengce/simple-faster-rcnn-pytorch/train.py", line 81, in train
trainer.train_step(img, bbox, label, scale)
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 172, in train_step
self.update_meters(losses)
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 225, in update_meters
loss_d = {k: at.scalar(v) for k, v in losses._asdict().items()}
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 225, in
loss_d = {k: at.scalar(v) for k, v in losses._asdict().items()}
File "/home/mengce/simple-faster-rcnn-pytorch/utils/array_tool.py", line 29, in scalar
return data.item()
RuntimeError: cuda runtime error (4) : unspecified launch failure at /pytorch/aten/src/THC/generic/THCStorage.c:36
If you suspect this is an IPython bug, please report it at:
https://github.com/ipython/ipython/issues
or send an email to the mailing list at ipython-dev@python.org
You can print a more detailed traceback right now with "%tb", or use "%debug"
to interactively debug it.
Extra-detailed tracebacks for bug-reporting purposes can be enabled via:
%config Application.verbose_crash=True
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
Exception ignored in: 'cupy.cuda.function.Module.dealloc'
Traceback (most recent call last):
File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload
File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status
TypeError: 'NoneType' object is not callable
when i run the train.py
File "/home/mengce/simple-faster-rcnn-pytorch/train.py", line 132, in
fire.Fire()
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 127, in Fire
component_trace = _Fire(component, args, context, name)
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 366, in _Fire
component, remaining_args)
File "/home/mengce/.local/lib/python3.5/site-packages/fire/core.py", line 542, in _CallCallable
result = fn(*varargs, **kwargs)
File "/home/mengce/simple-faster-rcnn-pytorch/train.py", line 81, in train
trainer.train_step(img, bbox, label, scale)
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 172, in train_step
self.update_meters(losses)
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 225, in update_meters
loss_d = {k: at.scalar(v) for k, v in losses._asdict().items()}
File "/home/mengce/simple-faster-rcnn-pytorch/trainer.py", line 225, in
loss_d = {k: at.scalar(v) for k, v in losses._asdict().items()}
File "/home/mengce/simple-faster-rcnn-pytorch/utils/array_tool.py", line 29, in scalar
return data.item()
RuntimeError: cuda runtime error (4) : unspecified launch failure at /pytorch/aten/src/THC/generic/THCStorage.c:36
If you suspect this is an IPython bug, please report it at: https://github.com/ipython/ipython/issues or send an email to the mailing list at ipython-dev@python.org
You can print a more detailed traceback right now with "%tb", or use "%debug" to interactively debug it.
Extra-detailed tracebacks for bug-reporting purposes can be enabled via: %config Application.verbose_crash=True
Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status cupy.cuda.driver.CUDADriverError: CUDA_ERROR_LAUNCH_FAILED: unspecified launch failure Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable Exception ignored in: 'cupy.cuda.function.Module.dealloc' Traceback (most recent call last): File "cupy/cuda/driver.pyx", line 193, in cupy.cuda.driver.moduleUnload File "cupy/cuda/driver.pyx", line 82, in cupy.cuda.driver.check_status TypeError: 'NoneType' object is not callable
what does this mean? how can i fix it?