Error while training with my own dataset

[techiexplorer]

farhan@farhan-FX503VD:~/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection$ python train.py --logtostderr --train_dir=training/ --pipeline_config_path=training/faster_rcnn_inception_v2_pets.config WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py:125: main (from main) is deprecated and will be removed in a future version. Instructions for updating: Use object_detection/model_main.py. W1003 11:33:52.828501 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py:125: main (from main) is deprecated and will be removed in a future version. Instructions for updating: Use object_detection/model_main.py. WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py:265: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.create_global_step W1003 11:33:52.996471 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py:265: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.create_global_step WARNING:tensorflow:num_readers has been reduced to 1 to match input file shards. W1003 11:33:53.012411 139860996994816 tf_logging.py:125] num_readers has been reduced to 1 to match input file shards. WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/input.py:727: QueueRunner.init (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. W1003 11:33:53.305314 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/input.py:727: QueueRunner.init (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/input.py:727: add_queue_runner (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. W1003 11:33:53.306848 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/input.py:727: add_queue_runner (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. INFO:tensorflow:Scale of 0 disables regularizer. I1003 11:33:55.033824 139860996994816 tf_logging.py:115] Scale of 0 disables regularizer. INFO:tensorflow:Scale of 0 disables regularizer. I1003 11:33:55.047068 139860996994816 tf_logging.py:115] Scale of 0 disables regularizer. INFO:tensorflow:depth of additional conv before box predictor: 0 I1003 11:33:55.047394 139860996994816 tf_logging.py:115] depth of additional conv before box predictor: 0 WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/predictors/heads/box_head.py:93: calling reduce_mean (from tensorflow.python.ops.math_ops) with keep_dims is deprecated and will be removed in a future version. Instructions for updating: keep_dims is deprecated, use keepdims instead W1003 11:33:56.512274 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/predictors/heads/box_head.py:93: calling reduce_mean (from tensorflow.python.ops.math_ops) with keep_dims is deprecated and will be removed in a future version. Instructions for updating: keep_dims is deprecated, use keepdims instead INFO:tensorflow:Scale of 0 disables regularizer. I1003 11:33:56.518822 139860996994816 tf_logging.py:115] Scale of 0 disables regularizer. INFO:tensorflow:Scale of 0 disables regularizer. I1003 11:33:56.538239 139860996994816 tf_logging.py:115] Scale of 0 disables regularizer. WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/core/losses.py:340: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version. Instructions for updating:

Future major versions of TensorFlow will allow gradients to flow into the labels input on backprop by default.

See tf.nn.softmax_cross_entropy_with_logits_v2.

W1003 11:33:56.952112 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/core/losses.py:340: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version. Instructions for updating:

Future major versions of TensorFlow will allow gradients to flow into the labels input on backprop by default.

See tf.nn.softmax_cross_entropy_with_logits_v2.

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/ops/gradients_impl.py:108: UserWarning: Converting sparse IndexedSlices to a dense Tensor of unknown shape. This may consume a large amount of memory. "Converting sparse IndexedSlices to a dense Tensor of unknown shape. " WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/meta_architectures/faster_rcnn_meta_arch.py:2108: get_or_create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.get_or_create_global_step W1003 11:34:01.856547 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/meta_architectures/faster_rcnn_meta_arch.py:2108: get_or_create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.get_or_create_global_step W1003 11:34:01.893640 139860996994816 variables_helper.py:144] Variable [Conv/biases/Momentum] is not available in checkpoint W1003 11:34:01.893791 139860996994816 variables_helper.py:144] Variable [Conv/weights/Momentum] is not available in checkpoint W1003 11:34:01.893882 139860996994816 variables_helper.py:144] Variable [FirstStageBoxPredictor/BoxEncodingPredictor/biases/Momentum] is not available in checkpoint W1003 11:34:01.893990 139860996994816 variables_helper.py:144] Variable [FirstStageBoxPredictor/BoxEncodingPredictor/weights/Momentum] is not available in checkpoint W1003 11:34:01.894060 139860996994816 variables_helper.py:144] Variable [FirstStageBoxPredictor/ClassPredictor/biases/Momentum] is not available in checkpoint W1003 11:34:01.894117 139860996994816 variables_helper.py:144] Variable [FirstStageBoxPredictor/ClassPredictor/weights/Momentum] is not available in checkpoint W1003 11:34:01.894181 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894226 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.894276 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/depthwise_weights/Momentum] is not available in checkpoint W1003 11:34:01.894322 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_1a_7x7/pointwise_weights/Momentum] is not available in checkpoint W1003 11:34:01.894366 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894410 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.894460 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.894504 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894548 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.894597 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Conv2d_2c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.894642 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894685 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.894742 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.894788 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894858 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.894908 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.894952 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.894996 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895045 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.895089 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895133 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895182 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.895226 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895271 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895320 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.895364 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895414 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895466 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.895539 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895584 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895634 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.895678 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895722 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895772 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.895816 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895860 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.895909 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.895953 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.895997 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896046 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.896090 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896143 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896215 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.896262 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896305 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896353 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.896397 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896440 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896491 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.896535 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896578 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896627 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_3c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.896671 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896714 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896763 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.896820 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.896865 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.896940 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_0/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.896984 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897027 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897076 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.897119 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897162 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897211 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.897255 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897298 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897347 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4a/Branch_1/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.897390 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897433 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897482 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.897535 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897604 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897655 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.897699 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897742 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897791 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.897835 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.897879 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.897936 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.897984 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898028 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898077 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.898121 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898164 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898221 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.898283 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898336 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898385 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.898429 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898473 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898522 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.898566 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898609 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898658 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.898702 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898745 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898793 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.898837 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.898887 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.898940 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.899009 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899054 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899102 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.899145 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899189 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899237 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.899280 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899323 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899371 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.899414 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899457 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899506 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.899549 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899601 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899655 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.899723 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899766 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899815 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.899858 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.899902 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.899950 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.899994 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900037 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900085 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.900129 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900173 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900221 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.900272 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900317 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900395 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4d/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.900440 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900484 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900533 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.900577 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900623 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900671 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.900714 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900758 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900807 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.900850 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.900893 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.900941 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.900993 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.901040 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.901113 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.901157 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.901200 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.901248 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.901292 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.901335 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.901384 139860996994816 variables_helper.py:144] Variable [FirstStageFeatureExtractor/InceptionV2/Mixed_4e/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.901430 139860996994816 variables_helper.py:141] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/biases] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[360]], model variable shape: [[124]]. This variable will not be initialized from the checkpoint. W1003 11:34:01.901472 139860996994816 variables_helper.py:144] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/biases/Momentum] is not available in checkpoint W1003 11:34:01.901518 139860996994816 variables_helper.py:141] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/weights] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[1024, 360]], model variable shape: [[1024, 124]]. This variable will not be initialized from the checkpoint. W1003 11:34:01.901558 139860996994816 variables_helper.py:144] Variable [SecondStageBoxPredictor/BoxEncodingPredictor/weights/Momentum] is not available in checkpoint W1003 11:34:01.901603 139860996994816 variables_helper.py:141] Variable [SecondStageBoxPredictor/ClassPredictor/biases] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[91]], model variable shape: [[32]]. This variable will not be initialized from the checkpoint. W1003 11:34:01.901642 139860996994816 variables_helper.py:144] Variable [SecondStageBoxPredictor/ClassPredictor/biases/Momentum] is not available in checkpoint W1003 11:34:01.901697 139860996994816 variables_helper.py:141] Variable [SecondStageBoxPredictor/ClassPredictor/weights] is available in checkpoint, but has an incompatible shape with model variable. Checkpoint shape: [[1024, 91]], model variable shape: [[1024, 32]]. This variable will not be initialized from the checkpoint. W1003 11:34:01.901763 139860996994816 variables_helper.py:144] Variable [SecondStageBoxPredictor/ClassPredictor/weights/Momentum] is not available in checkpoint W1003 11:34:01.901809 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.901853 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.901902 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.901951 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.901995 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902043 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_0/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.902086 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902129 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902177 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.902221 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902265 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902313 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.902365 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902410 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902484 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5a/Branch_1/Conv2d_1a_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.902529 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902573 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902623 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.902667 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902710 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902759 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.902803 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902847 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.902896 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.902941 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.902984 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903038 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.903085 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903155 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903205 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.903249 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903292 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903340 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.903383 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903426 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903475 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5b/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.903519 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903562 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903610 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_0/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.903655 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903698 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903755 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.903800 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.903872 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.903920 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_1/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.903964 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.904008 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.904057 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0a_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.904100 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.904144 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.904198 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0b_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.904243 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.904287 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.904336 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_2/Conv2d_0c_3x3/weights/Momentum] is not available in checkpoint W1003 11:34:01.904380 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/beta/Momentum] is not available in checkpoint W1003 11:34:01.904429 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/BatchNorm/gamma/Momentum] is not available in checkpoint W1003 11:34:01.904480 139860996994816 variables_helper.py:144] Variable [SecondStageFeatureExtractor/InceptionV2/Mixed_5c/Branch_3/Conv2d_0b_1x1/weights/Momentum] is not available in checkpoint W1003 11:34:01.904549 139860996994816 variables_helper.py:144] Variable [global_step] is not available in checkpoint WARNING:tensorflow:From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/contrib/slim/python/slim/learning.py:737: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession W1003 11:34:02.519949 139860996994816 tf_logging.py:125] From /home/farhan/.local/lib/python3.5/site-packages/tensorflow/contrib/slim/python/slim/learning.py:737: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession 2018-10-03 11:34:03.339489: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2018-10-03 11:34:03.670280: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:964] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero 2018-10-03 11:34:03.670838: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1411] Found device 0 with properties: name: GeForce GTX 1050 major: 6 minor: 1 memoryClockRate(GHz): 1.493 pciBusID: 0000:01:00.0 totalMemory: 3.95GiB freeMemory: 3.60GiB 2018-10-03 11:34:03.670861: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0 2018-10-03 11:34:09.220933: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix: 2018-10-03 11:34:09.221018: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977] 0 2018-10-03 11:34:09.221049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0: N 2018-10-03 11:34:09.221525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3324 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1050, pci bus id: 0000:01:00.0, compute capability: 6.1) INFO:tensorflow:Restoring parameters from /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt I1003 11:34:10.790586 139860996994816 tf_logging.py:115] Restoring parameters from /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt 2018-10-03 11:34:10.878818: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at save_restore_v2_ops.cc:184 : Not found: /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory INFO:tensorflow:Error reported to Coordinator: <class 'tensorflow.python.framework.errors_impl.NotFoundError'>, Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

Caused by op 'save_1/RestoreV2', defined at: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 397, in train init_saver = tf.train.Saver(available_var_map) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1094, in init self.build() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1106, in build self._build(self._filename, build_save=True, build_restore=True) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1143, in _build build_save=build_save, build_restore=build_restore) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 787, in _build_internal restore_sequentially, reshape) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 406, in _AddRestoreOps restore_sequentially) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 854, in bulk_restore return io_ops.restore_v2(filename_tensor, names, slices, dtypes) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/ops/gen_io_ops.py", line 1466, in restore_v2 shape_and_slices=shape_and_slices, dtypes=dtypes, name=name) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(args, **kwargs) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 3272, in create_op op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 1768, in init self._traceback = tf_stack.extract_stack()

NotFoundError (see above for traceback): Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

I1003 11:34:10.894390 139860996994816 tf_logging.py:115] Error reported to Coordinator: <class 'tensorflow.python.framework.errors_impl.NotFoundError'>, Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

Caused by op 'save_1/RestoreV2', defined at: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 397, in train init_saver = tf.train.Saver(available_var_map) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1094, in init self.build() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1106, in build self._build(self._filename, build_save=True, build_restore=True) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1143, in _build build_save=build_save, build_restore=build_restore) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 787, in _build_internal restore_sequentially, reshape) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 406, in _AddRestoreOps restore_sequentially) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 854, in bulk_restore return io_ops.restore_v2(filename_tensor, names, slices, dtypes) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/ops/gen_io_ops.py", line 1466, in restore_v2 shape_and_slices=shape_and_slices, dtypes=dtypes, name=name) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(args, **kwargs) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 3272, in create_op op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 1768, in init self._traceback = tf_stack.extract_stack()

NotFoundError (see above for traceback): Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

Traceback (most recent call last): File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1292, in _do_call return fn(*args) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1277, in _run_fn options, feed_dict, fetch_list, target_list, run_metadata) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1367, in _call_tf_sessionrun run_metadata) tensorflow.python.framework.errors_impl.NotFoundError: /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1538, in restore {self.saver_def.filename_tensor_name: save_path}) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 887, in run run_metadata_ptr) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1110, in _run feed_dict_tensor, options, run_metadata) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1286, in _do_run run_metadata) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/client/session.py", line 1308, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.NotFoundError: /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

Caused by op 'save_1/RestoreV2', defined at: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 397, in train init_saver = tf.train.Saver(available_var_map) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1094, in init self.build() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1106, in build self._build(self._filename, build_save=True, build_restore=True) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1143, in _build build_save=build_save, build_restore=build_restore) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 787, in _build_internal restore_sequentially, reshape) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 406, in _AddRestoreOps restore_sequentially) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 854, in bulk_restore return io_ops.restore_v2(filename_tensor, names, slices, dtypes) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/ops/gen_io_ops.py", line 1466, in restore_v2 shape_and_slices=shape_and_slices, dtypes=dtypes, name=name) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(args, **kwargs) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 3272, in create_op op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 1768, in init self._traceback = tf_stack.extract_stack()

NotFoundError (see above for traceback): /home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1548, in restore names_to_keys = object_graph_key_mapping(save_path) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1822, in object_graph_key_mapping checkpointable.OBJECT_GRAPH_PROTO_KEY) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 359, in get_tensor status) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/errors_impl.py", line 526, in exit c_api.TF_GetCode(self.status.status)) tensorflow.python.framework.errors_impl.NotFoundError: Key _CHECKPOINTABLE_OBJECT_GRAPH not found in checkpoint

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 415, in train saver=saver) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/contrib/slim/python/slim/learning.py", line 748, in train master, start_standard_services=False, config=session_config) as sess: File "/usr/lib/python3.5/contextlib.py", line 59, in enter return next(self.gen) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/supervisor.py", line 1005, in managed_session self.stop(close_summary_writer=close_summary_writer) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/supervisor.py", line 833, in stop ignore_live_threads=ignore_live_threads) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/coordinator.py", line 389, in join six.reraise(self._exc_info_to_raise) File "/home/farhan/.local/lib/python3.5/site-packages/six.py", line 693, in reraise raise value File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/supervisor.py", line 994, in managed_session start_standard_services=start_standard_services) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/supervisor.py", line 731, in prepare_or_wait_for_session init_feed_dict=self._init_feed_dict, init_fn=self._init_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/session_manager.py", line 289, in prepare_session init_fn(sess) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 399, in initializer_fn init_saver.restore(sess, train_config.fine_tune_checkpoint) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1554, in restore err, "a Variable name or other graph key that is missing") tensorflow.python.framework.errors_impl.NotFoundError: Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

Caused by op 'save_1/RestoreV2', defined at: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 397, in train init_saver = tf.train.Saver(available_var_map) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1094, in init self.build() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1106, in build self._build(self._filename, build_save=True, build_restore=True) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 1143, in _build build_save=build_save, build_restore=build_restore) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 787, in _build_internal restore_sequentially, reshape) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 406, in _AddRestoreOps restore_sequentially) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/training/saver.py", line 854, in bulk_restore return io_ops.restore_v2(filename_tensor, names, slices, dtypes) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/ops/gen_io_ops.py", line 1466, in restore_v2 shape_and_slices=shape_and_slices, dtypes=dtypes, name=name) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/op_def_library.py", line 787, in _apply_op_helper op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(args, **kwargs) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 3272, in create_op op_def=op_def) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/framework/ops.py", line 1768, in init self._traceback = tf_stack.extract_stack()

NotFoundError (see above for traceback): Restoring from checkpoint failed. This is most likely due to a Variable name or other graph key that is missing from the checkpoint. Please ensure that you have not altered the graph expected based on the checkpoint. Original error:

/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/faster_rcnn_inception_v2_coco_2018_01_28/model.ckpt.data-00000-of-00001; No such file or directory [[{{node save_1/RestoreV2}} = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, ..., DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save_1/Const_0_0, save_1/RestoreV2/tensor_names, save_1/RestoreV2/shape_and_slices)]]

ERROR:tensorflow:================================== Object was never used (type <class 'tensorflow.python.framework.ops.Tensor'>): <tf.Tensor 'init_ops/report_uninitialized_variables/boolean_mask/GatherV2:0' shape=(?,) dtype=string> If you want to mark it as used call its "mark_used()" method. It was originally created here: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 415, in train saver=saver) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/contrib/slim/python/slim/learning.py", line 791, in train should_retry = True File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/tf_should_use.py", line 189, in wrapped return _add_should_use_warning(fn(args, **kwargs))

E1003 11:34:11.483081 139860996994816 tf_logging.py:105] ================================== Object was never used (type <class 'tensorflow.python.framework.ops.Tensor'>): <tf.Tensor 'init_ops/report_uninitialized_variables/boolean_mask/GatherV2:0' shape=(?,) dtype=string> If you want to mark it as used call its "mark_used()" method. It was originally created here: File "train.py", line 184, in tf.app.run() File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/platform/app.py", line 125, in run _sys.exit(main(argv)) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/deprecation.py", line 306, in new_func return func(*args, *kwargs) File "train.py", line 180, in main graph_hook_fn=graph_rewriter_fn) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection/legacy/trainer.py", line 415, in train saver=saver) File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/contrib/slim/python/slim/learning.py", line 791, in train should_retry = True File "/home/farhan/.local/lib/python3.5/site-packages/tensorflow/python/util/tf_should_use.py", line 189, in wrapped return _add_should_use_warning(fn(args, **kwargs)) farhan@farhan-FX503VD:~/.local/lib/python3.5/site-packages/tensorflow/models/research/object_detection$

[Viile1]

error depend on tensorflow developer change regualtion.

[kowsikbabu]

i have the same error, did you find a solution?

[anonym24]

The same issue when using ssd_mobilenet_v1_quantized_300x300_coco14_sync.config

[EthiopianOne]

Hey guys, I had the same issue, and after a loooong annoying searching and trying to debug it worked for me when i switched to model_main.py. get rid of that evil legacy\train.py.