pjreddie / darknet

Convolutional Neural Networks
http://pjreddie.com/darknet/
Other
25.83k stars 21.33k forks source link

CUDA error: Driver shutting down #475

Open ahsan856jalal opened 6 years ago

ahsan856jalal commented 6 years ago

After 2869 iterations on a dataset , yolo training gave me this error, although files were present in the specified directory. Cannot load image "/home/ajalal/Downloads/fish_detection/all_frames/img_pool/image_1269_1719.jpg" Couldn't open file: /home/ajalal/Downloads/fish_detection/all_frames/img_pool/image_1423_2415.txt Cannot load image "/home/ajalal/Downloads/fish_detection/all_frames/img_pool/image_198_199.jpg" CUDA Error: driver shutting down Segmentation fault (core dumped)

pandasMX commented 6 years ago

similar error, have you found out the reason?

Cannot load image "/data/Black-magic-0403-fullcat/YOLO/txt/9af3c02901af6789ff69d3ad89f8b0a2.jpg" STB Reason: bad huffman code CUDA Error: driver shutting down darknet: ./src/cuda.c:36: check_error: Assertion `0' failed. Aborted (core dumped)

25b3nk commented 6 years ago

I too am facing the same issue. Have you found a work around or solution to the issue?

jiangwch commented 6 years ago

same error... 1615: 2.005791, 2.115156 avg, 0.001000 rate, 5.543082 seconds, 51680 images Loaded: 0.000060 seconds Cannot load image "/home/darknet/VOCdevkit/VOC2012/JPEGImages/2008▒001130.jpg" Couldn't open file: /home/darknet/VOCdevkit/VOC2012/labels/2008▒001130.txt CUDA Error: driver shutting down darknet: ./src/cuda.c:36: check_error: Assertion `0' failed. Aborted (core dumped)

buzdarbalooch commented 5 years ago

@ahsan856jalal @pandasMX @csbenk @jiangwch hi guys i am also facing the same issue. Any idea, if any one of you was successful in resolving it ?.

Tough i am facing this issue when trying to use yolo as DLL on Linux

LD_LIBRARY_PATH=./:$LD_LIBRARY_PATH ./uselib data/obj.names cfg/yolo.cfg backup/yolo_10100.weights Car-park.mov image