2018-03-27 00:28:52.140186: W tensorflow/core/framework/op_kernel.cc:1202] OP_REQUIRES failed at mkl_conv_ops.cc:655 : Aborted: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652
Traceback (most recent call last):
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1361, in _do_call
return fn(*args)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1340, in _run_fn
target_list, status, run_metadata)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 516, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.AbortedError: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652
[[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 175, in
cnnTrain()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 167, in cnnTrain
acc = accuracy.eval({x:testx, y:test_y, keep_prob_5:1.0, keep_prob_75:1.0})
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 656, in eval
return _eval_using_default_session(self, feed_dict, self.graph, session)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4901, in _eval_using_default_session
return session.run(tensors, feed_dict)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 905, in run
run_metadata_ptr)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1137, in _run
feed_dict_tensor, options, run_metadata)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1355, in _do_run
options, run_metadata)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1374, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.AbortedError: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652
[[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
Caused by op 'Conv2D', defined at:
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 175, in
cnnTrain()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 133, in cnnTrain
out = cnnLayer()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 97, in cnnLayer
conv1 = tf.nn.relu(conv2d(x, W1) + b1)
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 84, in conv2d
return tf.nn.conv2d(x, W, strides=[1,1,1,1], padding='SAME')
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/ops/gen_nn_ops.py", line 631, in conv2d
data_format=data_format, dilations=dilations, name=name)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
op_def=op_def)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3271, in create_op
op_def=op_def)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1650, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access
AbortedError (see above for traceback): Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652
[[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
sometimes it happened,when running to a hundredfold,anyone can handle it,please tell me,thank you so much !
2018-03-27 00:28:52.140186: W tensorflow/core/framework/op_kernel.cc:1202] OP_REQUIRES failed at mkl_conv_ops.cc:655 : Aborted: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652 Traceback (most recent call last): File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1361, in _do_call return fn(*args) File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1340, in _run_fn target_list, status, run_metadata) File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 516, in exit c_api.TF_GetCode(self.status.status)) tensorflow.python.framework.errors_impl.AbortedError: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652 [[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 175, in
cnnTrain()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 167, in cnnTrain
acc = accuracy.eval({x:testx, y:test_y, keep_prob_5:1.0, keep_prob_75:1.0})
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 656, in eval
return _eval_using_default_session(self, feed_dict, self.graph, session)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 4901, in _eval_using_default_session
return session.run(tensors, feed_dict)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 905, in run
run_metadata_ptr)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1137, in _run
feed_dict_tensor, options, run_metadata)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1355, in _do_run
options, run_metadata)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1374, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.AbortedError: Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652
[[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
Caused by op 'Conv2D', defined at: File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 175, in
cnnTrain()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 133, in cnnTrain
out = cnnLayer()
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 97, in cnnLayer
conv1 = tf.nn.relu(conv2d(x, W1) + b1)
File "/home/wanlu/PycharmProjects/untitled1/train_faces.py", line 84, in conv2d
return tf.nn.conv2d(x, W, strides=[1,1,1,1], padding='SAME')
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/ops/gen_nn_ops.py", line 631, in conv2d
data_format=data_format, dilations=dilations, name=name)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper
op_def=op_def)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 3271, in create_op
op_def=op_def)
File "/home/wanlu/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 1650, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access
AbortedError (see above for traceback): Operation received an exception:Status: 3, message: could not set native handle, in file tensorflow/core/kernels/mkl_conv_ops.cc:652 [[Node: Conv2D = _MklConv2D[T=DT_FLOAT, _kernel="MklOp", data_format="NHWC", padding="SAME", strides=[1, 1, 1, 1], use_cudnn_on_gpu=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_Placeholder_0_0, Variable/read, DMT/_0, DMT/_1)]]
sometimes it happened,when running to a hundredfold,anyone can handle it,please tell me,thank you so much !