search

ganyc717 / Darknet-On-OpenCL

Darknet On OpenCL
MIT License
100 stars 44 forks source link

opencl execution error, code -6 -6 #22

Open jan-drozen opened 4 years ago

jan-drozen commented 4 years ago

During training I got following error:

darknet_cl.exe detector train .\domino_training\obj.data .\cfg\yolov2-tiny-ocl.cfg .\domino_training\yolov2-tiny.conv.13

...

Region Avg IOU: 0.209439, Class: 0.002893, Obj: 0.260629, No Obj: 0.591567, Avg Recall: 0.000000, count: 20 opencl execution error, code -6 -6 0x00007FFC6496A839 (0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC), RaiseException() + 0x69 bytes(s) 0x00007FFC418A7ED7 (0x00000046B72F2908 0x00007FF6C076D5D0 0x00000046B72F2808 0xCCCCCCCCCCCCCCCC), _CxxThrowException() + 0x137 bytes(s) 0x00007FF6C06334E1 (0x00000046FFFFFFFA 0x0000000000000000 0x00000046B72F2A60 0x00000046B72F2E98), CLWarpper::checkError() + 0x191 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\cl_warpper.cpp, line 216 + 0x7A byte(s) 0x00007FF6C066F580 (0x00000046B72F5970 0x0000004600000020 0x0000000000000058 0x0000004600000058), im2col_gpu() + 0x440 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\im2col_kernels_cl.cpp, line 36 0x00007FF6C0640685 (0x00000046B72F87D0 0x00000046B72F9600 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC), backward_convolutional_layer_gpu() + 0x5E5 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\convolutional_kernels_cl.cpp, line 244 0x00007FF6C06BD6B3 (0x000001C76E11E3E0 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC), backward_network_gpu() + 0x1E3 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\network.cpp, line 812 + 0x47 byte(s) 0x00007FF6C06BD285 (0x000001C76E11E3E0 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC 0xCCCCCCCCCCCCCCCC), backward_network() + 0x75 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\network.cpp, line 269 0x00007FF6C06C3F39 (0x000001C76E11E3E0 0xCCCCCCCC0000000A 0xCCCCCCCC00000000 0x000001C747106070), train_network_datum() + 0x89 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\network.cpp, line 296 0x00007FF6C06C3E15 (0x000001C76E11E3E0 0x00000046B72FF3A0 0x00000046B72FD0E8 0x000000007FFE6000), train_network() + 0x115 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\src\network.cpp, line 325 + 0xC byte(s) 0x00007FF6C05E0A3B (0x000001C76C086BF6 0x000001C76C086C11 0x000001C76C086C2B 0x00000046B72FF6B4), train_detector() + 0x71B bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\example\detector.cpp, line 120 + 0x2E byte(s) 0x00007FF6C05DF8D8 (0x00007FF600000006 0x000001C76C086BA0 0x00007FF6C070CF28 0xCCCCCCCC00000000), run_detector() + 0x548 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\example\detector.cpp, line 682 + 0x59 byte(s) 0x00007FF6C05DD774 (0x0000000000000006 0x000001C76C086BA0 0x0000000000000000 0x00007FF6C07079F8), main() + 0x204 bytes(s), c:\users\drozi\downloads\darknet-on-opencl-master\darknet_cl\example\darknet.cpp, line 434 + 0x12 byte(s) 0x00007FF6C06EF984 (0x00007FF6C0707000 0x00007FF6C07075B8 0x0000000000000000 0x0000000000000000), invoke_main() + 0x34 bytes(s), d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl, line 79 0x00007FF6C06EF86E (0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000), __scrt_common_main_seh() + 0x12E bytes(s), d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl, line 288 + 0x5 byte(s) 0x00007FF6C06EF72E (0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000), __scrt_common_main() + 0xE bytes(s), d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_common.inl, line 331 0x00007FF6C06EFA19 (0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000), mainCRTStartup() + 0x9 bytes(s), d:\agent\_work\3\s\src\vctools\crt\vcstartup\src\startup\exe_main.cpp, line 17 0x00007FFC66687BD4 (0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000), BaseThreadInitThunk() + 0x14 bytes(s) 0x00007FFC67A0CED1 (0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000), RtlUserThreadStart() + 0x21 bytes(s)

I am on Windows 10 Pro, Core i5 4200U (Intel HD 4000), got newest Open CL stuff from Intel website. I tried it a couple of times and the error occurred everytime, only the amount of successful batches before the error differs. I compiled the project in VS2017, without OpenCV.

rsaxvc commented 4 years ago

Error -6 means you've run out of memory. You might try reducing the batch size in your config file perhaps? How much RAM do you have?