Open ronakgupta opened 8 years ago
I am using DSN on Ubuntu 12.04 with Cuda-5.5.
I am getting following error on running ./train_full.sh
$ ./train_full.sh I0622 00:04:40.815856 28860 train_net.cpp:26] Starting Optimization I0622 00:04:40.816721 28860 solver.cpp:26] Creating training net. I0622 00:04:40.816889 28860 net.cpp:70] Creating Layer data I0622 00:04:40.816900 28860 net.cpp:105] data -> data I0622 00:04:40.816915 28860 net.cpp:105] data -> label I0622 00:04:40.816928 28860 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.816994 28860 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fec1db18b7d google::LogMessage::Fail() @ 0x7fec1db1ac7f google::LogMessage::SendToLog() @ 0x7fec1db1876c google::LogMessage::Flush() @ 0x7fec1db1b51d google::LogMessageFatal::~LogMessageFatal() @ 0x45d17f caffe::DataLayer<>::SetUp() @ 0x43a434 caffe::Net<>::Init() @ 0x43bb2a caffe::Net<>::Net() @ 0x426c7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fec1b8607ed (unknown) @ 0x40fdcd (unknown) Aborted (core dumped) I0622 00:04:40.889854 28863 finetune_net.cpp:25] Starting Optimization I0622 00:04:40.890429 28863 solver.cpp:26] Creating training net. I0622 00:04:40.890560 28863 net.cpp:70] Creating Layer data I0622 00:04:40.890580 28863 net.cpp:105] data -> data I0622 00:04:40.890600 28863 net.cpp:105] data -> label I0622 00:04:40.890625 28863 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.890717 28863 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fb874271b7d google::LogMessage::Fail() @ 0x7fb874273c7f google::LogMessage::SendToLog() @ 0x7fb87427176c google::LogMessage::Flush() @ 0x7fb87427451d google::LogMessageFatal::~LogMessageFatal() @ 0x45a63f caffe::DataLayer<>::SetUp() @ 0x42b564 caffe::Net<>::Init() @ 0x42cc5a caffe::Net<>::Net() @ 0x435d7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fb871fb97ed (unknown) @ 0x40fdfd (unknown) Aborted (core dumped) I0622 00:04:40.968624 28866 finetune_net.cpp:25] Starting Optimization I0622 00:04:40.969331 28866 solver.cpp:26] Creating training net. I0622 00:04:40.969472 28866 net.cpp:70] Creating Layer data I0622 00:04:40.969487 28866 net.cpp:105] data -> data I0622 00:04:40.969501 28866 net.cpp:105] data -> label I0622 00:04:40.969517 28866 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.969605 28866 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fdde68fdb7d google::LogMessage::Fail() @ 0x7fdde68ffc7f google::LogMessage::SendToLog() @ 0x7fdde68fd76c google::LogMessage::Flush() @ 0x7fdde690051d google::LogMessageFatal::~LogMessageFatal() @ 0x45a63f caffe::DataLayer<>::SetUp() @ 0x42b564 caffe::Net<>::Init() @ 0x42cc5a caffe::Net<>::Net() @ 0x435d7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fdde46457ed (unknown) @ 0x40fdfd (unknown) Aborted (core dumped)
I am using DSN on Ubuntu 12.04 with Cuda-5.5.
I am getting following error on running ./train_full.sh
$ ./train_full.sh I0622 00:04:40.815856 28860 train_net.cpp:26] Starting Optimization I0622 00:04:40.816721 28860 solver.cpp:26] Creating training net. I0622 00:04:40.816889 28860 net.cpp:70] Creating Layer data I0622 00:04:40.816900 28860 net.cpp:105] data -> data I0622 00:04:40.816915 28860 net.cpp:105] data -> label I0622 00:04:40.816928 28860 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.816994 28860 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fec1db18b7d google::LogMessage::Fail() @ 0x7fec1db1ac7f google::LogMessage::SendToLog() @ 0x7fec1db1876c google::LogMessage::Flush() @ 0x7fec1db1b51d google::LogMessageFatal::~LogMessageFatal() @ 0x45d17f caffe::DataLayer<>::SetUp() @ 0x43a434 caffe::Net<>::Init() @ 0x43bb2a caffe::Net<>::Net() @ 0x426c7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fec1b8607ed (unknown) @ 0x40fdcd (unknown) Aborted (core dumped) I0622 00:04:40.889854 28863 finetune_net.cpp:25] Starting Optimization I0622 00:04:40.890429 28863 solver.cpp:26] Creating training net. I0622 00:04:40.890560 28863 net.cpp:70] Creating Layer data I0622 00:04:40.890580 28863 net.cpp:105] data -> data I0622 00:04:40.890600 28863 net.cpp:105] data -> label I0622 00:04:40.890625 28863 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.890717 28863 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fb874271b7d google::LogMessage::Fail() @ 0x7fb874273c7f google::LogMessage::SendToLog() @ 0x7fb87427176c google::LogMessage::Flush() @ 0x7fb87427451d google::LogMessageFatal::~LogMessageFatal() @ 0x45a63f caffe::DataLayer<>::SetUp() @ 0x42b564 caffe::Net<>::Init() @ 0x42cc5a caffe::Net<>::Net() @ 0x435d7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fb871fb97ed (unknown) @ 0x40fdfd (unknown) Aborted (core dumped) I0622 00:04:40.968624 28866 finetune_net.cpp:25] Starting Optimization I0622 00:04:40.969331 28866 solver.cpp:26] Creating training net. I0622 00:04:40.969472 28866 net.cpp:70] Creating Layer data I0622 00:04:40.969487 28866 net.cpp:105] data -> data I0622 00:04:40.969501 28866 net.cpp:105] data -> label I0622 00:04:40.969517 28866 data_layer.cpp:148] Opening leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb F0622 00:04:40.969605 28866 data_layer.cpp:151] Check failed: status.ok() Failed to open leveldb cifar10_gcn_padded-leveldb/cifar-train-leveldb IO error: cifar10_gcn_padded-leveldb/cifar-train-leveldb/LOCK: No such file or directory * Check failure stack trace: * @ 0x7fdde68fdb7d google::LogMessage::Fail() @ 0x7fdde68ffc7f google::LogMessage::SendToLog() @ 0x7fdde68fd76c google::LogMessage::Flush() @ 0x7fdde690051d google::LogMessageFatal::~LogMessageFatal() @ 0x45a63f caffe::DataLayer<>::SetUp() @ 0x42b564 caffe::Net<>::Init() @ 0x42cc5a caffe::Net<>::Net() @ 0x435d7c caffe::Solver<>::Solver() @ 0x40e79f main @ 0x7fdde46457ed (unknown) @ 0x40fdfd (unknown) Aborted (core dumped)