zhaoweicai
commented
7 years ago It looks like the problem is about opencv. But 4GB memory may not be enough for training at this moment.
Open PingDong2017 opened 7 years ago
zhaoweicai
commented
7 years ago It looks like the problem is about opencv. But 4GB memory may not be enough for training at this moment.
I am trying to train the MSCNN model, just as explained in readme.md, but got a segmentation fault. Is this related to GPU memory size? I am using ubuntu 14.04 with GPU grid k520 (4GB memory). How much memory is required to run the training of KITTI dataset.
.... I0131 23:47:50.833986 26703 layer_factory.hpp:77] Creating layer conv1_1 I0131 23:47:50.834022 26703 net.cpp:100] Creating Layer conv1_1 I0131 23:47:50.834034 26703 net.cpp:434] conv1_1 <- data I0131 23:47:50.834048 26703 net.cpp:408] conv1_1 -> conv1_1 Aborted at 1485906471 (unix time) try "date -d @1485906471" if you are using GNU date PC: @ 0x7fb0abbd9842 (unknown) SIGSEGV (@0x48) received by PID 26703 (TID 0x7fb0c1a3e700) from PID 72; stack trace: @ 0x7fb0d5c95cb0 (unknown) @ 0x7fb0abbd9842 (unknown) @ 0x7fb0ab615396 (unknown) @ 0x7fb0ab5f1ed0 (unknown) @ 0x7fb0abbef3ad (unknown) @ 0x7fb0ab5f8c12 (unknown) @ 0x7fb0ab5faf1a (unknown) @ 0x7fb0ab5f184c (unknown) @ 0x7fb0c3794562 (unknown) @ 0x7fb0c03e6392 (unknown) @ 0x7fb0c03e6f13 (unknown) @ 0x7fb0c03e75e3 (unknown) @ 0x7fb0c02e17c7 (unknown) @ 0x7fb0c02e206d (unknown) @ 0x7fb0c02e0fed (unknown) @ 0x7fb0cde47dd9 (anonymous namespace)::opencl_fn6<>::switch_fn() @ 0x7fb0cdc77576 cv::ocl::Context::getDefault() @ 0x7fb0cdc776bb cv::ocl::Device::getDefault() @ 0x7fb0cdc7771d cv::ocl::useOpenCL() @ 0x7fb0cde506cb cv::flip() @ 0x7fb0d73d5a15 caffe::ImageGtDataLayer<>::load_batch() @ 0x7fb0d7352e7c caffe::BasePrefetchingDataLayer<>::InternalThreadEntry() @ 0x7fb0d72cae85 caffe::InternalThread::entry() @ 0x7fb0cbbefa4a (unknown) @ 0x7fb0c66d3184 start_thread @ 0x7fb0d5d5937d (unknown) @ 0x0 (unknown) Segmentation fault (core dumped)