search

SeokjuLee / VPGNet

VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition (ICCV 2017)
MIT License
487 stars 166 forks source link

Training error #13

Closed ranjithrajasimha closed 6 years ago

ranjithrajasimha commented 6 years ago

Hi, I'm getting the below error while I try to train the model. I checked in internet, the sources say that it can happen because of multiple cuda versions. I delete other cudas and tried, the issue still persists. Can you please help me get through this?

F0402 17:15:39.522164 20718 math_functions.cu:422] Check failed: status == CURAND_STATUS_SUCCESS (201 vs. 0) CURAND_STATUS_LAUNCH_FAILURE Check failure stack trace: @ 0x7f4e3e0b35cd google::LogMessage::Fail() @ 0x7f4e3e0b5433 google::LogMessage::SendToLog() @ 0x7f4e3e0b315b google::LogMessage::Flush() @ 0x7f4e3e0b5e1e google::LogMessageFatal::~LogMessageFatal() @ 0x7f4e3e80703a caffe::caffe_gpu_rng_uniform() @ 0x7f4e3e80b2d2 caffe::DropoutLayer<>::Forward_gpu() @ 0x7f4e3e7cfea2 caffe::Net<>::ForwardFromTo() @ 0x7f4e3e7cffc7 caffe::Net<>::ForwardPrefilled() @ 0x7f4e3e7f498d caffe::Solver<>::Step() @ 0x7f4e3e7f551a caffe::Solver<>::Solve() @ 0x40bbfb train() @ 0x408408 main @ 0x7f4e3d53e830 __libc_start_main @ 0x408ab9 _start @ (nil) (unknown) Aborted (core dumped)

ranjithrajasimha commented 6 years ago

looks like it is cuda issue.