AarohiSingla / SSD-Tensorflow-On-Custom-Dataset

21 stars 42 forks source link

training error_ #2

Open riyaj8888 opened 2 years ago

riyaj8888 commented 2 years ago

WARNING:tensorflow: The TensorFlow contrib module will not be included in TensorFlow 2.0. For more information, please see:

WARNING:tensorflow:From train_ssd_network.py:394: The name tf.app.run is deprecated. Please use tf.compat.v1.app.run instead.

WARNING:tensorflow:From train_ssd_network.py:192: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

W1029 06:07:11.047179 140050557368192 module_wrapper.py:139] From train_ssd_network.py:192: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From train_ssd_network.py:192: The name tf.logging.DEBUG is deprecated. Please use tf.compat.v1.logging.DEBUG instead.

W1029 06:07:11.047486 140050557368192 module_wrapper.py:139] From train_ssd_network.py:192: The name tf.logging.DEBUG is deprecated. Please use tf.compat.v1.logging.DEBUG instead.

WARNING:tensorflow:From train_ssd_network.py:204: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.create_global_step W1029 06:07:11.048661 140050557368192 deprecation.py:323] From train_ssd_network.py:204: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.create_global_step WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/pascalvoc_common.py:58: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

W1029 06:07:11.054536 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/pascalvoc_common.py:58: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/pascalvoc_common.py:64: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

W1029 06:07:11.054860 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/pascalvoc_common.py:64: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/dataset_utils.py:112: The name tf.gfile.Exists is deprecated. Please use tf.io.gfile.exists instead.

W1029 06:07:11.055070 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/datasets/dataset_utils.py:112: The name tf.gfile.Exists is deprecated. Please use tf.io.gfile.exists instead.

===========================================================================

Training | Evaluation flags:

===========================================================================

{'?': <absl.app.HelpFlag object at 0x7f5f9adf81d0>, 'adadelta_rho': <absl.flags._flag.Flag object at 0x7f5f9776cb50>, 'adagrad_initial_accumulator_value': <absl.flags._flag.Flag object at 0x7f5f9776cc10>, 'adam_beta1': <absl.flags._flag.Flag object at 0x7f5f9776ccd0>, 'adam_beta2': <absl.flags._flag.Flag object at 0x7f5f9776cd90>, 'alsologtostderr': <absl.flags._flag.BooleanFlag object at 0x7f5fbd02a790>, 'batch_size': <absl.flags._flag.Flag object at 0x7f5f9776fe50>, 'checkpoint_exclude_scopes': <absl.flags._flag.Flag object at 0x7f5f97772150>, 'checkpoint_model_scope': <absl.flags._flag.Flag object at 0x7f5f977720d0>, 'checkpoint_path': <absl.flags._flag.Flag object at 0x7f5f97772050>, 'clone_on_cpu': <absl.flags._flag.BooleanFlag object at 0x7f5f9776c510>, 'dataset_dir': <absl.flags._flag.Flag object at 0x7f5f9776fb90>, 'dataset_name': <absl.flags._flag.Flag object at 0x7f5f9776f990>, 'dataset_split_name': <absl.flags._flag.Flag object at 0x7f5f9776fad0>, 'end_learning_rate': <absl.flags._flag.Flag object at 0x7f5f9776f610>, 'ftrl_initial_accumulator_value': <absl.flags._flag.Flag object at 0x7f5f9776cfd0>, 'ftrl_l1': <absl.flags._flag.Flag object at 0x7f5f9776f0d0>, 'ftrl_l2': <absl.flags._flag.Flag object at 0x7f5f9776f190>, 'ftrl_learning_rate_power': <absl.flags._flag.Flag object at 0x7f5f9776cf10>, 'gpu_memory_fraction': <absl.flags._flag.Flag object at 0x7f5f9776c910>, 'help': <absl.app.HelpFlag object at 0x7f5f9adf81d0>, 'helpfull': <absl.app.HelpfullFlag object at 0x7f5fbd0324d0>, 'helpshort': <absl.app.HelpshortFlag object at 0x7f5f97772250>, 'helpxml': <absl.app.HelpXMLFlag object at 0x7f5fbd032490>, 'ignore_missing_vars': <absl.flags._flag.BooleanFlag object at 0x7f5f97772210>, 'label_smoothing': <absl.flags._flag.Flag object at 0x7f5f9776f6d0>, 'labels_offset': <absl.flags._flag.Flag object at 0x7f5f9776fc50>, 'learning_rate': <absl.flags._flag.Flag object at 0x7f5f9776f550>, 'learning_rate_decay_factor': <absl.flags._flag.Flag object at 0x7f5f9776f790>, 'learning_rate_decay_type': <absl.flags._flag.Flag object at 0x7f5f9776f490>, 'log_dir': <absl.flags._flag.Flag object at 0x7f5fbd02a890>, 'log_every_n_steps': <absl.flags._flag.Flag object at 0x7f5f9776c750>, 'logger_levels': <absl.logging._LoggerLevelsFlag object at 0x7f5fbd02aa10>, 'logtostderr': <absl.flags._flag.BooleanFlag object at 0x7f5fbd028f50>, 'loss_alpha': <absl.flags._flag.Flag object at 0x7f5f98b53150>, 'match_threshold': <absl.flags._flag.Flag object at 0x7f5f9776c2d0>, 'max_number_of_steps': <absl.flags._flag.Flag object at 0x7f5f9776ff90>, 'model_name': <absl.flags._flag.Flag object at 0x7f5f9776fd10>, 'momentum': <absl.flags._flag.Flag object at 0x7f5f9776f250>, 'moving_average_decay': <absl.flags._flag.Flag object at 0x7f5f9776f910>, 'negative_ratio': <absl.flags._flag.Flag object at 0x7f5f9776c210>, 'num_classes': <absl.flags._flag.Flag object at 0x7f5f9776fa10>, 'num_clones': <absl.flags._flag.Flag object at 0x7f5f9776c410>, 'num_epochs_per_decay': <absl.flags._flag.Flag object at 0x7f5f9776f850>, 'num_preprocessing_threads': <absl.flags._flag.Flag object at 0x7f5f9776c690>, 'num_readers': <absl.flags._flag.Flag object at 0x7f5f9776c5d0>, 'only_check_args': <absl.flags._flag.BooleanFlag object at 0x7f5fbd032550>, 'op_conversion_fallback_to_while_loop': <absl.flags._flag.BooleanFlag object at 0x7f5fba5d7190>, 'opt_epsilon': <absl.flags._flag.Flag object at 0x7f5f9776ce50>, 'optimizer': <absl.flags._flag.Flag object at 0x7f5f9776ca90>, 'pdb': <absl.flags._defines.DEFINE_alias.._FlagAlias object at 0x7f5fbd032310>, 'pdb_post_mortem': <absl.flags._flag.BooleanFlag object at 0x7f5fbd5c0d90>, 'preprocessing_name': <absl.flags._flag.Flag object at 0x7f5f9776fdd0>, 'profile_file': <absl.flags._flag.Flag object at 0x7f5fbd032450>, 'rmsprop_decay': <absl.flags._flag.Flag object at 0x7f5f9776f3d0>, 'rmsprop_momentum': <absl.flags._flag.Flag object at 0x7f5f9776f310>, 'run_with_pdb': <absl.flags._flag.BooleanFlag object at 0x7f5fbd5c0b10>, 'run_with_profiling': <absl.flags._flag.BooleanFlag object at 0x7f5fbd032390>, 'save_interval_secs': <absl.flags._flag.Flag object at 0x7f5f9776c850>, 'save_summaries_secs': <absl.flags._flag.Flag object at 0x7f5f9776c450>, 'showprefixforinfo': <absl.flags._flag.BooleanFlag object at 0x7f5fbd02ad50>, 'stderrthreshold': <absl.logging._StderrthresholdFlag object at 0x7f5fbd02ac50>, 'test_random_seed': <absl.flags._flag.Flag object at 0x7f5fac36e910>, 'test_randomize_ordering_seed': <absl.flags._flag.Flag object at 0x7f5fac36eb90>, 'test_srcdir': <absl.flags._flag.Flag object at 0x7f5fac418310>, 'test_tmpdir': <absl.flags._flag.Flag object at 0x7f5fac36a310>, 'train_dir': <absl.flags._flag.Flag object at 0x7f5f9776c390>, 'train_image_size': <absl.flags._flag.Flag object at 0x7f5f9776ff10>, 'trainable_scopes': <absl.flags._flag.Flag object at 0x7f5f977721d0>, 'use_cprofile_for_profiling': <absl.flags._flag.BooleanFlag object at 0x7f5fbd032510>, 'v': <absl.logging._VerbosityFlag object at 0x7f5fbd02a910>, 'verbosity': <absl.logging._VerbosityFlag object at 0x7f5fbd02a910>, 'weight_decay': <absl.flags._flag.Flag object at 0x7f5f9776c9d0>, 'xml_output_file': <absl.flags._flag.Flag object at 0x7f5fac3745d0>}

===========================================================================

SSD net parameters:

===========================================================================

{'anchor_offset': 0.5, 'anchor_ratios': [[2, 0.5], [2, 0.5, 3, 0.3333333333333333], [2, 0.5, 3, 0.3333333333333333], [2, 0.5, 3, 0.3333333333333333], [2, 0.5], [2, 0.5]], 'anchor_size_bounds': [0.15, 0.9], 'anchor_sizes': [(21.0, 45.0), (45.0, 99.0), (99.0, 153.0), (153.0, 207.0), (207.0, 261.0), (261.0, 315.0)], 'anchor_steps': [8, 16, 32, 64, 100, 300], 'feat_layers': ['block4', 'block7', 'block8', 'block9', 'block10', 'block11'], 'feat_shapes': [(38, 38), (19, 19), (10, 10), (5, 5), (3, 3), (1, 1)], 'img_shape': (300, 300), 'no_annotation_label': 2, 'normalizations': [20, -1, -1, -1, -1, -1], 'num_classes': 1, 'prior_scaling': [0.1, 0.1, 0.2, 0.2]}

===========================================================================

Training | Evaluation dataset files:

===========================================================================

['tfrecords/voc_2007_train_000.tfrecord', 'tfrecords/voc_2007_train_001.tfrecord', 'tfrecords/voc_2007_train_002.tfrecord', 'tfrecords/voc_2007_train_003.tfrecord', 'tfrecords/voc_2007_train_004.tfrecord', 'tfrecords/voc_2007_train_005.tfrecord', 'tfrecords/voc_2007_train_006.tfrecord', 'tfrecords/voc_2007_train_007.tfrecord', 'tfrecords/voc_2007_train_008.tfrecord', 'tfrecords/voc_2007_train_009.tfrecord', 'tfrecords/voc_2007_train_010.tfrecord', 'tfrecords/voc_2007_train_011.tfrecord', 'tfrecords/voc_2007_train_012.tfrecord', 'tfrecords/voc_2007_train_013.tfrecord', 'tfrecords/voc_2007_train_014.tfrecord', 'tfrecords/voc_2007_train_015.tfrecord', 'tfrecords/voc_2007_train_016.tfrecord', 'tfrecords/voc_2007_train_017.tfrecord', 'tfrecords/voc_2007_train_018.tfrecord', 'tfrecords/voc_2007_train_019.tfrecord', 'tfrecords/voc_2007_train_020.tfrecord', 'tfrecords/voc_2007_train_021.tfrecord', 'tfrecords/voc_2007_train_022.tfrecord', 'tfrecords/voc_2007_train_023.tfrecord', 'tfrecords/voc_2007_train_024.tfrecord', 'tfrecords/voc_2007_train_025.tfrecord', 'tfrecords/voc_2007_train_026.tfrecord', 'tfrecords/voc_2007_train_027.tfrecord', 'tfrecords/voc_2007_train_028.tfrecord', 'tfrecords/voc_2007_train_029.tfrecord', 'tfrecords/voc_2007_train_030.tfrecord', 'tfrecords/voc_2007_train_031.tfrecord', 'tfrecords/voc_2007_train_032.tfrecord', 'tfrecords/voc_2007_train_033.tfrecord', 'tfrecords/voc_2007_train_034.tfrecord', 'tfrecords/voc_2007_train_035.tfrecord', 'tfrecords/voc_2007_train_036.tfrecord', 'tfrecords/voc_2007_train_037.tfrecord', 'tfrecords/voc_2007_train_038.tfrecord', 'tfrecords/voc_2007_train_039.tfrecord', 'tfrecords/voc_2007_train_040.tfrecord', 'tfrecords/voc_2007_train_041.tfrecord', 'tfrecords/voc_2007_train_042.tfrecord', 'tfrecords/voc_2007_train_043.tfrecord', 'tfrecords/voc_2007_train_044.tfrecord', 'tfrecords/voc_2007_train_045.tfrecord', 'tfrecords/voc_2007_train_046.tfrecord', 'tfrecords/voc_2007_train_047.tfrecord', 'tfrecords/voc_2007_train_048.tfrecord', 'tfrecords/voc_2007_train_049.tfrecord', 'tfrecords/voc_2007_train_050.tfrecord', 'tfrecords/voc_2007_train_051.tfrecord', 'tfrecords/voc_2007_train_052.tfrecord', 'tfrecords/voc_2007_train_053.tfrecord', 'tfrecords/voc_2007_train_054.tfrecord', 'tfrecords/voc_2007_train_055.tfrecord', 'tfrecords/voc_2007_train_056.tfrecord', 'tfrecords/voc_2007_train_057.tfrecord', 'tfrecords/voc_2007_train_058.tfrecord', 'tfrecords/voc_2007_train_059.tfrecord', 'tfrecords/voc_2007_train_060.tfrecord', 'tfrecords/voc_2007_train_061.tfrecord', 'tfrecords/voc_2007_train_062.tfrecord', 'tfrecords/voc_2007_train_063.tfrecord', 'tfrecords/voc_2007_train_064.tfrecord', 'tfrecords/voc_2007_train_065.tfrecord', 'tfrecords/voc_2007_train_066.tfrecord', 'tfrecords/voc_2007_train_067.tfrecord', 'tfrecords/voc_2007_train_068.tfrecord', 'tfrecords/voc_2007_train_069.tfrecord', 'tfrecords/voc_2007_train_070.tfrecord', 'tfrecords/voc_2007_train_071.tfrecord', 'tfrecords/voc_2007_train_072.tfrecord', 'tfrecords/voc_2007_train_073.tfrecord', 'tfrecords/voc_2007_train_074.tfrecord', 'tfrecords/voc_2007_train_075.tfrecord', 'tfrecords/voc_2007_train_076.tfrecord', 'tfrecords/voc_2007_train_077.tfrecord', 'tfrecords/voc_2007_train_078.tfrecord', 'tfrecords/voc_2007_train_079.tfrecord', 'tfrecords/voc_2007_train_080.tfrecord', 'tfrecords/voc_2007_train_081.tfrecord', 'tfrecords/voc_2007_train_082.tfrecord', 'tfrecords/voc_2007_train_083.tfrecord', 'tfrecords/voc_2007_train_084.tfrecord', 'tfrecords/voc_2007_train_085.tfrecord', 'tfrecords/voc_2007_train_086.tfrecord', 'tfrecords/voc_2007_train_087.tfrecord', 'tfrecords/voc_2007_train_088.tfrecord', 'tfrecords/voc_2007_train_089.tfrecord', 'tfrecords/voc_2007_train_090.tfrecord', 'tfrecords/voc_2007_train_091.tfrecord', 'tfrecords/voc_2007_train_092.tfrecord', 'tfrecords/voc_2007_train_093.tfrecord', 'tfrecords/voc_2007_train_094.tfrecord', 'tfrecords/voc_2007_train_095.tfrecord', 'tfrecords/voc_2007_train_096.tfrecord', 'tfrecords/voc_2007_train_097.tfrecord', 'tfrecords/voc_2007_train_098.tfrecord', 'tfrecords/voc_2007_train_099.tfrecord', 'tfrecords/voc_2007_train_100.tfrecord', 'tfrecords/voc_2007_train_101.tfrecord', 'tfrecords/voc_2007_train_102.tfrecord', 'tfrecords/voc_2007_train_103.tfrecord', 'tfrecords/voc_2007_train_104.tfrecord', 'tfrecords/voc_2007_train_105.tfrecord', 'tfrecords/voc_2007_train_106.tfrecord', 'tfrecords/voc_2007_train_107.tfrecord', 'tfrecords/voc_2007_train_108.tfrecord', 'tfrecords/voc_2007_train_109.tfrecord', 'tfrecords/voc_2007_train_110.tfrecord', 'tfrecords/voc_2007_train_111.tfrecord', 'tfrecords/voc_2007_train_112.tfrecord', 'tfrecords/voc_2007_train_113.tfrecord', 'tfrecords/voc_2007_train_114.tfrecord', 'tfrecords/voc_2007_train_115.tfrecord', 'tfrecords/voc_2007_train_116.tfrecord', 'tfrecords/voc_2007_train_117.tfrecord', 'tfrecords/voc_2007_train_118.tfrecord', 'tfrecords/voc_2007_train_119.tfrecord', 'tfrecords/voc_2007_train_120.tfrecord', 'tfrecords/voc_2007_train_121.tfrecord', 'tfrecords/voc_2007_train_122.tfrecord', 'tfrecords/voc_2007_train_123.tfrecord', 'tfrecords/voc_2007_train_124.tfrecord', 'tfrecords/voc_2007_train_125.tfrecord', 'tfrecords/voc_2007_train_126.tfrecord', 'tfrecords/voc_2007_train_127.tfrecord', 'tfrecords/voc_2007_train_128.tfrecord', 'tfrecords/voc_2007_train_129.tfrecord', 'tfrecords/voc_2007_train_130.tfrecord', 'tfrecords/voc_2007_train_131.tfrecord', 'tfrecords/voc_2007_train_132.tfrecord', 'tfrecords/voc_2007_train_133.tfrecord', 'tfrecords/voc_2007_train_134.tfrecord', 'tfrecords/voc_2007_train_135.tfrecord', 'tfrecords/voc_2007_train_136.tfrecord', 'tfrecords/voc_2007_train_137.tfrecord', 'tfrecords/voc_2007_train_138.tfrecord', 'tfrecords/voc_2007_train_139.tfrecord', 'tfrecords/voc_2007_train_140.tfrecord', 'tfrecords/voc_2007_train_141.tfrecord', 'tfrecords/voc_2007_train_142.tfrecord', 'tfrecords/voc_2007_train_143.tfrecord', 'tfrecords/voc_2007_train_144.tfrecord', 'tfrecords/voc_2007_train_145.tfrecord', 'tfrecords/voc_2007_train_146.tfrecord', 'tfrecords/voc_2007_train_147.tfrecord', 'tfrecords/voc_2007_train_148.tfrecord', 'tfrecords/voc_2007_train_149.tfrecord', 'tfrecords/voc_2007_train_150.tfrecord', 'tfrecords/voc_2007_train_151.tfrecord', 'tfrecords/voc_2007_train_152.tfrecord', 'tfrecords/voc_2007_train_153.tfrecord', 'tfrecords/voc_2007_train_154.tfrecord', 'tfrecords/voc_2007_train_155.tfrecord', 'tfrecords/voc_2007_train_156.tfrecord', 'tfrecords/voc_2007_train_157.tfrecord', 'tfrecords/voc_2007_train_158.tfrecord', 'tfrecords/voc_2007_train_159.tfrecord', 'tfrecords/voc_2007_train_160.tfrecord', 'tfrecords/voc_2007_train_161.tfrecord', 'tfrecords/voc_2007_train_162.tfrecord', 'tfrecords/voc_2007_train_163.tfrecord', 'tfrecords/voc_2007_train_164.tfrecord', 'tfrecords/voc_2007_train_165.tfrecord', 'tfrecords/voc_2007_train_166.tfrecord', 'tfrecords/voc_2007_train_167.tfrecord', 'tfrecords/voc_2007_train_168.tfrecord', 'tfrecords/voc_2007_train_169.tfrecord', 'tfrecords/voc_2007_train_170.tfrecord', 'tfrecords/voc_2007_train_171.tfrecord', 'tfrecords/voc_2007_train_172.tfrecord', 'tfrecords/voc_2007_train_173.tfrecord', 'tfrecords/voc_2007_train_174.tfrecord', 'tfrecords/voc_2007_train_175.tfrecord', 'tfrecords/voc_2007_train_176.tfrecord', 'tfrecords/voc_2007_train_177.tfrecord', 'tfrecords/voc_2007_train_178.tfrecord', 'tfrecords/voc_2007_train_179.tfrecord', 'tfrecords/voc_2007_train_180.tfrecord', 'tfrecords/voc_2007_train_181.tfrecord', 'tfrecords/voc_2007_train_182.tfrecord', 'tfrecords/voc_2007_train_183.tfrecord', 'tfrecords/voc_2007_train_184.tfrecord', 'tfrecords/voc_2007_train_185.tfrecord', 'tfrecords/voc_2007_train_186.tfrecord', 'tfrecords/voc_2007_train_187.tfrecord', 'tfrecords/voc_2007_train_188.tfrecord', 'tfrecords/voc_2007_train_189.tfrecord', 'tfrecords/voc_2007_train_190.tfrecord', 'tfrecords/voc_2007_train_191.tfrecord', 'tfrecords/voc_2007_train_192.tfrecord', 'tfrecords/voc_2007_train_193.tfrecord', 'tfrecords/voc_2007_train_194.tfrecord', 'tfrecords/voc_2007_train_195.tfrecord', 'tfrecords/voc_2007_train_196.tfrecord', 'tfrecords/voc_2007_train_197.tfrecord', 'tfrecords/voc_2007_train_198.tfrecord', 'tfrecords/voc_2007_train_199.tfrecord', 'tfrecords/voc_2007_train_200.tfrecord', 'tfrecords/voc_2007_train_201.tfrecord', 'tfrecords/voc_2007_train_202.tfrecord', 'tfrecords/voc_2007_train_203.tfrecord', 'tfrecords/voc_2007_train_204.tfrecord', 'tfrecords/voc_2007_train_205.tfrecord', 'tfrecords/voc_2007_train_206.tfrecord', 'tfrecords/voc_2007_train_207.tfrecord', 'tfrecords/voc_2007_train_208.tfrecord', 'tfrecords/voc_2007_train_209.tfrecord', 'tfrecords/voc_2007_train_210.tfrecord', 'tfrecords/voc_2007_train_211.tfrecord', 'tfrecords/voc_2007_train_212.tfrecord', 'tfrecords/voc_2007_train_213.tfrecord', 'tfrecords/voc_2007_train_214.tfrecord', 'tfrecords/voc_2007_train_215.tfrecord', 'tfrecords/voc_2007_train_216.tfrecord', 'tfrecords/voc_2007_train_217.tfrecord', 'tfrecords/voc_2007_train_218.tfrecord', 'tfrecords/voc_2007_train_219.tfrecord', 'tfrecords/voc_2007_train_220.tfrecord', 'tfrecords/voc_2007_train_221.tfrecord', 'tfrecords/voc_2007_train_222.tfrecord', 'tfrecords/voc_2007_train_223.tfrecord', 'tfrecords/voc_2007_train_224.tfrecord', 'tfrecords/voc_2007_train_225.tfrecord', 'tfrecords/voc_2007_train_226.tfrecord', 'tfrecords/voc_2007_train_227.tfrecord', 'tfrecords/voc_2007_train_228.tfrecord', 'tfrecords/voc_2007_train_229.tfrecord', 'tfrecords/voc_2007_train_230.tfrecord', 'tfrecords/voc_2007_train_231.tfrecord', 'tfrecords/voc_2007_train_232.tfrecord', 'tfrecords/voc_2007_train_233.tfrecord', 'tfrecords/voc_2007_train_234.tfrecord', 'tfrecords/voc_2007_train_235.tfrecord', 'tfrecords/voc_2007_train_236.tfrecord', 'tfrecords/voc_2007_train_237.tfrecord', 'tfrecords/voc_2007_train_238.tfrecord', 'tfrecords/voc_2007_train_239.tfrecord', 'tfrecords/voc_2007_train_240.tfrecord', 'tfrecords/voc_2007_train_241.tfrecord', 'tfrecords/voc_2007_train_242.tfrecord', 'tfrecords/voc_2007_train_243.tfrecord', 'tfrecords/voc_2007_train_244.tfrecord', 'tfrecords/voc_2007_train_245.tfrecord', 'tfrecords/voc_2007_train_246.tfrecord', 'tfrecords/voc_2007_train_247.tfrecord', 'tfrecords/voc_2007_train_248.tfrecord', 'tfrecords/voc_2007_train_249.tfrecord', 'tfrecords/voc_2007_train_250.tfrecord', 'tfrecords/voc_2007_train_251.tfrecord', 'tfrecords/voc_2007_train_252.tfrecord', 'tfrecords/voc_2007_train_253.tfrecord', 'tfrecords/voc_2007_train_254.tfrecord', 'tfrecords/voc_2007_train_255.tfrecord', 'tfrecords/voc_2007_train_256.tfrecord', 'tfrecords/voc_2007_train_257.tfrecord', 'tfrecords/voc_2007_train_258.tfrecord', 'tfrecords/voc_2007_train_259.tfrecord', 'tfrecords/voc_2007_train_260.tfrecord', 'tfrecords/voc_2007_train_261.tfrecord', 'tfrecords/voc_2007_train_262.tfrecord', 'tfrecords/voc_2007_train_263.tfrecord', 'tfrecords/voc_2007_train_264.tfrecord', 'tfrecords/voc_2007_train_265.tfrecord', 'tfrecords/voc_2007_train_266.tfrecord', 'tfrecords/voc_2007_train_267.tfrecord', 'tfrecords/voc_2007_train_268.tfrecord', 'tfrecords/voc_2007_train_269.tfrecord', 'tfrecords/voc_2007_train_270.tfrecord', 'tfrecords/voc_2007_train_271.tfrecord', 'tfrecords/voc_2007_train_272.tfrecord', 'tfrecords/voc_2007_train_273.tfrecord', 'tfrecords/voc_2007_train_274.tfrecord', 'tfrecords/voc_2007_train_275.tfrecord', 'tfrecords/voc_2007_train_276.tfrecord', 'tfrecords/voc_2007_train_277.tfrecord', 'tfrecords/voc_2007_train_278.tfrecord', 'tfrecords/voc_2007_train_279.tfrecord', 'tfrecords/voc_2007_train_280.tfrecord', 'tfrecords/voc_2007_train_281.tfrecord', 'tfrecords/voc_2007_train_282.tfrecord', 'tfrecords/voc_2007_train_283.tfrecord', 'tfrecords/voc_2007_train_284.tfrecord', 'tfrecords/voc_2007_train_285.tfrecord', 'tfrecords/voc_2007_train_286.tfrecord', 'tfrecords/voc_2007_train_287.tfrecord', 'tfrecords/voc_2007_train_288.tfrecord', 'tfrecords/voc_2007_train_289.tfrecord', 'tfrecords/voc_2007_train_290.tfrecord', 'tfrecords/voc_2007_train_291.tfrecord', 'tfrecords/voc_2007_train_292.tfrecord', 'tfrecords/voc_2007_train_293.tfrecord', 'tfrecords/voc_2007_train_294.tfrecord', 'tfrecords/voc_2007_train_295.tfrecord', 'tfrecords/voc_2007_train_296.tfrecord', 'tfrecords/voc_2007_train_297.tfrecord', 'tfrecords/voc_2007_train_298.tfrecord', 'tfrecords/voc_2007_train_299.tfrecord', 'tfrecords/voc_2007_train_300.tfrecord', 'tfrecords/voc_2007_train_301.tfrecord', 'tfrecords/voc_2007_train_302.tfrecord', 'tfrecords/voc_2007_train_303.tfrecord', 'tfrecords/voc_2007_train_304.tfrecord', 'tfrecords/voc_2007_train_305.tfrecord', 'tfrecords/voc_2007_train_306.tfrecord', 'tfrecords/voc_2007_train_307.tfrecord', 'tfrecords/voc_2007_train_308.tfrecord', 'tfrecords/voc_2007_train_309.tfrecord', 'tfrecords/voc_2007_train_310.tfrecord', 'tfrecords/voc_2007_train_311.tfrecord', 'tfrecords/voc_2007_train_312.tfrecord', 'tfrecords/voc_2007_train_313.tfrecord', 'tfrecords/voc_2007_train_314.tfrecord', 'tfrecords/voc_2007_train_315.tfrecord', 'tfrecords/voc_2007_train_316.tfrecord', 'tfrecords/voc_2007_train_317.tfrecord', 'tfrecords/voc_2007_train_318.tfrecord', 'tfrecords/voc_2007_train_319.tfrecord', 'tfrecords/voc_2007_train_320.tfrecord', 'tfrecords/voc_2007_train_321.tfrecord', 'tfrecords/voc_2007_train_322.tfrecord', 'tfrecords/voc_2007_train_323.tfrecord', 'tfrecords/voc_2007_train_324.tfrecord', 'tfrecords/voc_2007_train_325.tfrecord', 'tfrecords/voc_2007_train_326.tfrecord', 'tfrecords/voc_2007_train_327.tfrecord', 'tfrecords/voc_2007_train_328.tfrecord', 'tfrecords/voc_2007_train_329.tfrecord', 'tfrecords/voc_2007_train_330.tfrecord', 'tfrecords/voc_2007_train_331.tfrecord', 'tfrecords/voc_2007_train_332.tfrecord', 'tfrecords/voc_2007_train_333.tfrecord', 'tfrecords/voc_2007_train_334.tfrecord', 'tfrecords/voc_2007_train_335.tfrecord', 'tfrecords/voc_2007_train_336.tfrecord', 'tfrecords/voc_2007_train_337.tfrecord', 'tfrecords/voc_2007_train_338.tfrecord', 'tfrecords/voc_2007_train_339.tfrecord', 'tfrecords/voc_2007_train_340.tfrecord', 'tfrecords/voc_2007_train_341.tfrecord', 'tfrecords/voc_2007_train_342.tfrecord', 'tfrecords/voc_2007_train_343.tfrecord', 'tfrecords/voc_2007_train_344.tfrecord', 'tfrecords/voc_2007_train_345.tfrecord', 'tfrecords/voc_2007_train_346.tfrecord', 'tfrecords/voc_2007_train_347.tfrecord', 'tfrecords/voc_2007_train_348.tfrecord', 'tfrecords/voc_2007_train_349.tfrecord', 'tfrecords/voc_2007_train_350.tfrecord', 'tfrecords/voc_2007_train_351.tfrecord', 'tfrecords/voc_2007_train_352.tfrecord', 'tfrecords/voc_2007_train_353.tfrecord', 'tfrecords/voc_2007_train_354.tfrecord', 'tfrecords/voc_2007_train_355.tfrecord', 'tfrecords/voc_2007_train_356.tfrecord', 'tfrecords/voc_2007_train_357.tfrecord', 'tfrecords/voc_2007_train_358.tfrecord', 'tfrecords/voc_2007_train_359.tfrecord', 'tfrecords/voc_2007_train_360.tfrecord', 'tfrecords/voc_2007_train_361.tfrecord', 'tfrecords/voc_2007_train_362.tfrecord', 'tfrecords/voc_2007_train_363.tfrecord', 'tfrecords/voc_2007_train_364.tfrecord', 'tfrecords/voc_2007_train_365.tfrecord', 'tfrecords/voc_2007_train_366.tfrecord', 'tfrecords/voc_2007_train_367.tfrecord', 'tfrecords/voc_2007_train_368.tfrecord', 'tfrecords/voc_2007_train_369.tfrecord', 'tfrecords/voc_2007_train_370.tfrecord', 'tfrecords/voc_2007_train_371.tfrecord', 'tfrecords/voc_2007_train_372.tfrecord', 'tfrecords/voc_2007_train_373.tfrecord', 'tfrecords/voc_2007_train_374.tfrecord', 'tfrecords/voc_2007_train_375.tfrecord', 'tfrecords/voc_2007_train_376.tfrecord', 'tfrecords/voc_2007_train_377.tfrecord', 'tfrecords/voc_2007_train_378.tfrecord', 'tfrecords/voc_2007_train_379.tfrecord', 'tfrecords/voc_2007_train_380.tfrecord', 'tfrecords/voc_2007_train_381.tfrecord', 'tfrecords/voc_2007_train_382.tfrecord', 'tfrecords/voc_2007_train_383.tfrecord', 'tfrecords/voc_2007_train_384.tfrecord', 'tfrecords/voc_2007_train_385.tfrecord', 'tfrecords/voc_2007_train_386.tfrecord', 'tfrecords/voc_2007_train_387.tfrecord', 'tfrecords/voc_2007_train_388.tfrecord', 'tfrecords/voc_2007_train_389.tfrecord', 'tfrecords/voc_2007_train_390.tfrecord', 'tfrecords/voc_2007_train_391.tfrecord', 'tfrecords/voc_2007_train_392.tfrecord', 'tfrecords/voc_2007_train_393.tfrecord', 'tfrecords/voc_2007_train_394.tfrecord', 'tfrecords/voc_2007_train_395.tfrecord', 'tfrecords/voc_2007_train_396.tfrecord', 'tfrecords/voc_2007_train_397.tfrecord', 'tfrecords/voc_2007_train_398.tfrecord', 'tfrecords/voc_2007_train_399.tfrecord', 'tfrecords/voc_2007_train_400.tfrecord', 'tfrecords/voc_2007_train_401.tfrecord', 'tfrecords/voc_2007_train_402.tfrecord', 'tfrecords/voc_2007_train_403.tfrecord', 'tfrecords/voc_2007_train_404.tfrecord', 'tfrecords/voc_2007_train_405.tfrecord', 'tfrecords/voc_2007_train_406.tfrecord', 'tfrecords/voc_2007_train_407.tfrecord', 'tfrecords/voc_2007_train_408.tfrecord', 'tfrecords/voc_2007_train_409.tfrecord', 'tfrecords/voc_2007_train_410.tfrecord', 'tfrecords/voc_2007_train_411.tfrecord', 'tfrecords/voc_2007_train_412.tfrecord', 'tfrecords/voc_2007_train_413.tfrecord', 'tfrecords/voc_2007_train_414.tfrecord', 'tfrecords/voc_2007_train_415.tfrecord', 'tfrecords/voc_2007_train_416.tfrecord', 'tfrecords/voc_2007_train_417.tfrecord', 'tfrecords/voc_2007_train_418.tfrecord', 'tfrecords/voc_2007_train_419.tfrecord', 'tfrecords/voc_2007_train_420.tfrecord', 'tfrecords/voc_2007_train_421.tfrecord', 'tfrecords/voc_2007_train_422.tfrecord', 'tfrecords/voc_2007_train_423.tfrecord', 'tfrecords/voc_2007_train_424.tfrecord', 'tfrecords/voc_2007_train_425.tfrecord', 'tfrecords/voc_2007_train_426.tfrecord', 'tfrecords/voc_2007_train_427.tfrecord', 'tfrecords/voc_2007_train_428.tfrecord', 'tfrecords/voc_2007_train_429.tfrecord', 'tfrecords/voc_2007_train_430.tfrecord', 'tfrecords/voc_2007_train_431.tfrecord', 'tfrecords/voc_2007_train_432.tfrecord', 'tfrecords/voc_2007_train_433.tfrecord', 'tfrecords/voc_2007_train_434.tfrecord', 'tfrecords/voc_2007_train_435.tfrecord', 'tfrecords/voc_2007_train_436.tfrecord', 'tfrecords/voc_2007_train_437.tfrecord', 'tfrecords/voc_2007_train_438.tfrecord', 'tfrecords/voc_2007_train_439.tfrecord', 'tfrecords/voc_2007_train_440.tfrecord', 'tfrecords/voc_2007_train_441.tfrecord', 'tfrecords/voc_2007_train_442.tfrecord', 'tfrecords/voc_2007_train_443.tfrecord', 'tfrecords/voc_2007_train_444.tfrecord', 'tfrecords/voc_2007_train_445.tfrecord', 'tfrecords/voc_2007_train_446.tfrecord', 'tfrecords/voc_2007_train_447.tfrecord', 'tfrecords/voc_2007_train_448.tfrecord', 'tfrecords/voc_2007_train_449.tfrecord', 'tfrecords/voc_2007_train_450.tfrecord', 'tfrecords/voc_2007_train_451.tfrecord', 'tfrecords/voc_2007_train_452.tfrecord', 'tfrecords/voc_2007_train_453.tfrecord', 'tfrecords/voc_2007_train_454.tfrecord', 'tfrecords/voc_2007_train_455.tfrecord', 'tfrecords/voc_2007_train_456.tfrecord', 'tfrecords/voc_2007_train_457.tfrecord', 'tfrecords/voc_2007_train_458.tfrecord', 'tfrecords/voc_2007_train_459.tfrecord', 'tfrecords/voc_2007_train_460.tfrecord', 'tfrecords/voc_2007_train_461.tfrecord', 'tfrecords/voc_2007_train_462.tfrecord', 'tfrecords/voc_2007_train_463.tfrecord', 'tfrecords/voc_2007_train_464.tfrecord', 'tfrecords/voc_2007_train_465.tfrecord', 'tfrecords/voc_2007_train_466.tfrecord', 'tfrecords/voc_2007_train_467.tfrecord', 'tfrecords/voc_2007_train_468.tfrecord', 'tfrecords/voc_2007_train_469.tfrecord', 'tfrecords/voc_2007_train_470.tfrecord', 'tfrecords/voc_2007_train_471.tfrecord', 'tfrecords/voc_2007_train_472.tfrecord', 'tfrecords/voc_2007_train_473.tfrecord', 'tfrecords/voc_2007_train_474.tfrecord', 'tfrecords/voc_2007_train_475.tfrecord', 'tfrecords/voc_2007_train_476.tfrecord', 'tfrecords/voc_2007_train_477.tfrecord', 'tfrecords/voc_2007_train_478.tfrecord', 'tfrecords/voc_2007_train_479.tfrecord', 'tfrecords/voc_2007_train_480.tfrecord', 'tfrecords/voc_2007_train_481.tfrecord', 'tfrecords/voc_2007_train_482.tfrecord', 'tfrecords/voc_2007_train_483.tfrecord', 'tfrecords/voc_2007_train_484.tfrecord', 'tfrecords/voc_2007_train_485.tfrecord', 'tfrecords/voc_2007_train_486.tfrecord', 'tfrecords/voc_2007_train_487.tfrecord', 'tfrecords/voc_2007_train_488.tfrecord', 'tfrecords/voc_2007_train_489.tfrecord', 'tfrecords/voc_2007_train_490.tfrecord', 'tfrecords/voc_2007_train_491.tfrecord', 'tfrecords/voc_2007_train_492.tfrecord', 'tfrecords/voc_2007_train_493.tfrecord', 'tfrecords/voc_2007_train_494.tfrecord', 'tfrecords/voc_2007_train_495.tfrecord', 'tfrecords/voc_2007_train_496.tfrecord', 'tfrecords/voc_2007_train_497.tfrecord', 'tfrecords/voc_2007_train_498.tfrecord', 'tfrecords/voc_2007_train_499.tfrecord', 'tfrecords/voc_2007_train_500.tfrecord', 'tfrecords/voc_2007_train_501.tfrecord', 'tfrecords/voc_2007_train_502.tfrecord', 'tfrecords/voc_2007_train_503.tfrecord', 'tfrecords/voc_2007_train_504.tfrecord', 'tfrecords/voc_2007_train_505.tfrecord', 'tfrecords/voc_2007_train_506.tfrecord', 'tfrecords/voc_2007_train_507.tfrecord', 'tfrecords/voc_2007_train_508.tfrecord', 'tfrecords/voc_2007_train_509.tfrecord', 'tfrecords/voc_2007_train_510.tfrecord', 'tfrecords/voc_2007_train_511.tfrecord', 'tfrecords/voc_2007_train_512.tfrecord', 'tfrecords/voc_2007_train_513.tfrecord', 'tfrecords/voc_2007_train_514.tfrecord', 'tfrecords/voc_2007_train_515.tfrecord', 'tfrecords/voc_2007_train_516.tfrecord', 'tfrecords/voc_2007_train_517.tfrecord', 'tfrecords/voc_2007_train_518.tfrecord', 'tfrecords/voc_2007_train_519.tfrecord', 'tfrecords/voc_2007_train_520.tfrecord', 'tfrecords/voc_2007_train_521.tfrecord', 'tfrecords/voc_2007_train_522.tfrecord', 'tfrecords/voc_2007_train_523.tfrecord', 'tfrecords/voc_2007_train_524.tfrecord', 'tfrecords/voc_2007_train_525.tfrecord', 'tfrecords/voc_2007_train_526.tfrecord', 'tfrecords/voc_2007_train_527.tfrecord', 'tfrecords/voc_2007_train_528.tfrecord', 'tfrecords/voc_2007_train_529.tfrecord', 'tfrecords/voc_2007_train_530.tfrecord', 'tfrecords/voc_2007_train_531.tfrecord', 'tfrecords/voc_2007_train_532.tfrecord', 'tfrecords/voc_2007_train_533.tfrecord', 'tfrecords/voc_2007_train_534.tfrecord', 'tfrecords/voc_2007_train_535.tfrecord', 'tfrecords/voc_2007_train_536.tfrecord', 'tfrecords/voc_2007_train_537.tfrecord', 'tfrecords/voc_2007_train_538.tfrecord', 'tfrecords/voc_2007_train_539.tfrecord', 'tfrecords/voc_2007_train_540.tfrecord', 'tfrecords/voc_2007_train_541.tfrecord', 'tfrecords/voc_2007_train_542.tfrecord', 'tfrecords/voc_2007_train_543.tfrecord', 'tfrecords/voc_2007_train_544.tfrecord', 'tfrecords/voc_2007_train_545.tfrecord', 'tfrecords/voc_2007_train_546.tfrecord', 'tfrecords/voc_2007_train_547.tfrecord', 'tfrecords/voc_2007_train_548.tfrecord', 'tfrecords/voc_2007_train_549.tfrecord', 'tfrecords/voc_2007_train_550.tfrecord', 'tfrecords/voc_2007_train_551.tfrecord', 'tfrecords/voc_2007_train_552.tfrecord', 'tfrecords/voc_2007_train_553.tfrecord', 'tfrecords/voc_2007_train_554.tfrecord', 'tfrecords/voc_2007_train_555.tfrecord', 'tfrecords/voc_2007_train_556.tfrecord', 'tfrecords/voc_2007_train_557.tfrecord', 'tfrecords/voc_2007_train_558.tfrecord', 'tfrecords/voc_2007_train_559.tfrecord', 'tfrecords/voc_2007_train_560.tfrecord', 'tfrecords/voc_2007_train_561.tfrecord', 'tfrecords/voc_2007_train_562.tfrecord', 'tfrecords/voc_2007_train_563.tfrecord', 'tfrecords/voc_2007_train_564.tfrecord', 'tfrecords/voc_2007_train_565.tfrecord', 'tfrecords/voc_2007_train_566.tfrecord', 'tfrecords/voc_2007_train_567.tfrecord', 'tfrecords/voc_2007_train_568.tfrecord', 'tfrecords/voc_2007_train_569.tfrecord', 'tfrecords/voc_2007_train_570.tfrecord', 'tfrecords/voc_2007_train_571.tfrecord', 'tfrecords/voc_2007_train_572.tfrecord', 'tfrecords/voc_2007_train_573.tfrecord', 'tfrecords/voc_2007_train_574.tfrecord', 'tfrecords/voc_2007_train_575.tfrecord', 'tfrecords/voc_2007_train_576.tfrecord', 'tfrecords/voc_2007_train_577.tfrecord', 'tfrecords/voc_2007_train_578.tfrecord', 'tfrecords/voc_2007_train_579.tfrecord', 'tfrecords/voc_2007_train_580.tfrecord', 'tfrecords/voc_2007_train_581.tfrecord', 'tfrecords/voc_2007_train_582.tfrecord', 'tfrecords/voc_2007_train_583.tfrecord', 'tfrecords/voc_2007_train_584.tfrecord', 'tfrecords/voc_2007_train_585.tfrecord', 'tfrecords/voc_2007_train_586.tfrecord', 'tfrecords/voc_2007_train_587.tfrecord', 'tfrecords/voc_2007_train_588.tfrecord', 'tfrecords/voc_2007_train_589.tfrecord', 'tfrecords/voc_2007_train_590.tfrecord', 'tfrecords/voc_2007_train_591.tfrecord', 'tfrecords/voc_2007_train_592.tfrecord', 'tfrecords/voc_2007_train_593.tfrecord', 'tfrecords/voc_2007_train_594.tfrecord', 'tfrecords/voc_2007_train_595.tfrecord', 'tfrecords/voc_2007_train_596.tfrecord', 'tfrecords/voc_2007_train_597.tfrecord', 'tfrecords/voc_2007_train_598.tfrecord', 'tfrecords/voc_2007_train_599.tfrecord', 'tfrecords/voc_2007_train_600.tfrecord', 'tfrecords/voc_2007_train_601.tfrecord', 'tfrecords/voc_2007_train_602.tfrecord', 'tfrecords/voc_2007_train_603.tfrecord', 'tfrecords/voc_2007_train_604.tfrecord', 'tfrecords/voc_2007_train_605.tfrecord', 'tfrecords/voc_2007_train_606.tfrecord', 'tfrecords/voc_2007_train_607.tfrecord', 'tfrecords/voc_2007_train_608.tfrecord', 'tfrecords/voc_2007_train_609.tfrecord', 'tfrecords/voc_2007_train_610.tfrecord', 'tfrecords/voc_2007_train_611.tfrecord', 'tfrecords/voc_2007_train_612.tfrecord', 'tfrecords/voc_2007_train_613.tfrecord', 'tfrecords/voc_2007_train_614.tfrecord', 'tfrecords/voc_2007_train_615.tfrecord', 'tfrecords/voc_2007_train_616.tfrecord', 'tfrecords/voc_2007_train_617.tfrecord', 'tfrecords/voc_2007_train_618.tfrecord', 'tfrecords/voc_2007_train_619.tfrecord', 'tfrecords/voc_2007_train_620.tfrecord', 'tfrecords/voc_2007_train_621.tfrecord', 'tfrecords/voc_2007_train_622.tfrecord', 'tfrecords/voc_2007_train_623.tfrecord', 'tfrecords/voc_2007_train_624.tfrecord', 'tfrecords/voc_2007_train_625.tfrecord', 'tfrecords/voc_2007_train_626.tfrecord', 'tfrecords/voc_2007_train_627.tfrecord', 'tfrecords/voc_2007_train_628.tfrecord', 'tfrecords/voc_2007_train_629.tfrecord', 'tfrecords/voc_2007_train_630.tfrecord', 'tfrecords/voc_2007_train_631.tfrecord', 'tfrecords/voc_2007_train_632.tfrecord', 'tfrecords/voc_2007_train_633.tfrecord', 'tfrecords/voc_2007_train_634.tfrecord', 'tfrecords/voc_2007_train_635.tfrecord', 'tfrecords/voc_2007_train_636.tfrecord', 'tfrecords/voc_2007_train_637.tfrecord', 'tfrecords/voc_2007_train_638.tfrecord', 'tfrecords/voc_2007_train_639.tfrecord', 'tfrecords/voc_2007_train_640.tfrecord', 'tfrecords/voc_2007_train_641.tfrecord', 'tfrecords/voc_2007_train_642.tfrecord', 'tfrecords/voc_2007_train_643.tfrecord', 'tfrecords/voc_2007_train_644.tfrecord', 'tfrecords/voc_2007_train_645.tfrecord', 'tfrecords/voc_2007_train_646.tfrecord', 'tfrecords/voc_2007_train_647.tfrecord', 'tfrecords/voc_2007_train_648.tfrecord', 'tfrecords/voc_2007_train_649.tfrecord', 'tfrecords/voc_2007_train_650.tfrecord', 'tfrecords/voc_2007_train_651.tfrecord', 'tfrecords/voc_2007_train_652.tfrecord', 'tfrecords/voc_2007_train_653.tfrecord', 'tfrecords/voc_2007_train_654.tfrecord', 'tfrecords/voc_2007_train_655.tfrecord', 'tfrecords/voc_2007_train_656.tfrecord', 'tfrecords/voc_2007_train_657.tfrecord', 'tfrecords/voc_2007_train_658.tfrecord', 'tfrecords/voc_2007_train_659.tfrecord', 'tfrecords/voc_2007_train_660.tfrecord', 'tfrecords/voc_2007_train_661.tfrecord', 'tfrecords/voc_2007_train_662.tfrecord', 'tfrecords/voc_2007_train_663.tfrecord', 'tfrecords/voc_2007_train_664.tfrecord', 'tfrecords/voc_2007_train_665.tfrecord', 'tfrecords/voc_2007_train_666.tfrecord', 'tfrecords/voc_2007_train_667.tfrecord', 'tfrecords/voc_2007_train_668.tfrecord']

WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/data/parallel_reader.py:246: string_input_producer (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensor_slices(string_tensor).shuffle(tf.shape(input_tensor, out_type=tf.int64)[0]).repeat(num_epochs). If shuffle=False, omit the .shuffle(...). W1029 06:07:11.159587 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/data/parallel_reader.py:246: string_input_producer (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensor_slices(string_tensor).shuffle(tf.shape(input_tensor, out_type=tf.int64)[0]).repeat(num_epochs). If shuffle=False, omit the .shuffle(...). WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:277: input_producer (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensor_slices(input_tensor).shuffle(tf.shape(input_tensor, out_type=tf.int64)[0]).repeat(num_epochs). If shuffle=False, omit the .shuffle(...). W1029 06:07:11.168070 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:277: input_producer (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensor_slices(input_tensor).shuffle(tf.shape(input_tensor, out_type=tf.int64)[0]).repeat(num_epochs). If shuffle=False, omit the .shuffle(...). WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:189: limit_epochs (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensors(tensor).repeat(num_epochs). W1029 06:07:11.170156 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:189: limit_epochs (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.from_tensors(tensor).repeat(num_epochs). WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:198: QueueRunner.init (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. W1029 06:07:11.172859 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:198: QueueRunner.init (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:198: add_queue_runner (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. W1029 06:07:11.174089 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/input.py:198: add_queue_runner (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version. Instructions for updating: To construct input pipelines, use the tf.data module. WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/data/parallel_reader.py:95: TFRecordReader.init (from tensorflow.python.ops.io_ops) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.TFRecordDataset. W1029 06:07:11.182954 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/data/parallel_reader.py:95: TFRecordReader.init (from tensorflow.python.ops.io_ops) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.TFRecordDataset. WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:101: The name tf.summary.image is deprecated. Please use tf.compat.v1.summary.image instead.

W1029 06:07:11.303120 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:101: The name tf.summary.image is deprecated. Please use tf.compat.v1.summary.image instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:219: sample_distorted_bounding_box (from tensorflow.python.ops.image_ops_impl) is deprecated and will be removed in a future version. Instructions for updating: seed2 arg is deprecated.Use sample_distorted_bounding_box_v2 instead. W1029 06:07:11.306609 140050557368192 deprecation.py:323] From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:219: sample_distorted_bounding_box (from tensorflow.python.ops.image_ops_impl) is deprecated and will be removed in a future version. Instructions for updating: seed2 arg is deprecated.Use sample_distorted_bounding_box_v2 instead. WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/tf_extended/math.py:38: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.where in 2.0, which has the same broadcast rule as np.where W1029 06:07:11.396303 140050557368192 deprecation.py:323] From /content/SSD-Tensorflow-On-Custom-Dataset/tf_extended/math.py:38: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.where in 2.0, which has the same broadcast rule as np.where WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/tf_image.py:275: The name tf.image.resize_images is deprecated. Please use tf.image.resize instead.

W1029 06:07:11.435607 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/tf_image.py:275: The name tf.image.resize_images is deprecated. Please use tf.image.resize instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:116: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead.

W1029 06:07:11.473040 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/preprocessing/ssd_vgg_preprocessing.py:116: The name tf.random_uniform is deprecated. Please use tf.random.uniform instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_common.py:77: div (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Deprecated in favor of operator or tf.math.divide. W1029 06:07:11.672674 140050557368192 deprecation.py:323] From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_common.py:77: div (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Deprecated in favor of operator or tf.math.divide. WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_common.py:152: The name tf.log is deprecated. Please use tf.math.log instead.

W1029 06:07:11.726665 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_common.py:152: The name tf.log is deprecated. Please use tf.math.log instead.

WARNING:tensorflow:From train_ssd_network.py:254: batch (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.batch(batch_size) (or padded_batch(...) if dynamic_pad=True). W1029 06:07:12.396471 140050557368192 deprecation.py:323] From train_ssd_network.py:254: batch (from tensorflow.python.training.input) is deprecated and will be removed in a future version. Instructions for updating: Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.batch(batch_size) (or padded_batch(...) if dynamic_pad=True). WARNING:tensorflow:From train_ssd_network.py:290: The name tf.get_collection is deprecated. Please use tf.compat.v1.get_collection instead.

W1029 06:07:12.413952 140050557368192 module_wrapper.py:139] From train_ssd_network.py:290: The name tf.get_collection is deprecated. Please use tf.compat.v1.get_collection instead.

WARNING:tensorflow:From train_ssd_network.py:290: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead.

W1029 06:07:12.414308 140050557368192 module_wrapper.py:139] From train_ssd_network.py:290: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py:194: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

W1029 06:07:12.414710 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py:194: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py:194: The name tf.get_variable_scope is deprecated. Please use tf.compat.v1.get_variable_scope instead.

W1029 06:07:12.414895 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py:194: The name tf.get_variable_scope is deprecated. Please use tf.compat.v1.get_variable_scope instead.

WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1057: Layer.apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version. Instructions for updating: Please use layer.__call__ method instead. W1029 06:07:12.417875 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1057: Layer.apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version. Instructions for updating: Please use layer.__call__ method instead. WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py:476: dropout (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.dropout instead. W1029 06:07:12.847347 140050557368192 deprecation.py:323] From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py:476: dropout (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.dropout instead. WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py:642: The name tf.losses.add_loss is deprecated. Please use tf.compat.v1.losses.add_loss instead.

W1029 06:07:13.435043 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py:642: The name tf.losses.add_loss is deprecated. Please use tf.compat.v1.losses.add_loss instead.

WARNING:tensorflow:From train_ssd_network.py:305: The name tf.summary.histogram is deprecated. Please use tf.compat.v1.summary.histogram instead.

W1029 06:07:13.448806 140050557368192 module_wrapper.py:139] From train_ssd_network.py:305: The name tf.summary.histogram is deprecated. Please use tf.compat.v1.summary.histogram instead.

WARNING:tensorflow:From train_ssd_network.py:306: The name tf.summary.scalar is deprecated. Please use tf.compat.v1.summary.scalar instead.

W1029 06:07:13.450209 140050557368192 module_wrapper.py:139] From train_ssd_network.py:306: The name tf.summary.scalar is deprecated. Please use tf.compat.v1.summary.scalar instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:105: The name tf.train.exponential_decay is deprecated. Please use tf.compat.v1.train.exponential_decay instead.

W1029 06:07:13.715663 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:105: The name tf.train.exponential_decay is deprecated. Please use tf.compat.v1.train.exponential_decay instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:144: The name tf.train.AdamOptimizer is deprecated. Please use tf.compat.v1.train.AdamOptimizer instead.

W1029 06:07:13.720755 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:144: The name tf.train.AdamOptimizer is deprecated. Please use tf.compat.v1.train.AdamOptimizer instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:245: The name tf.trainable_variables is deprecated. Please use tf.compat.v1.trainable_variables instead.

W1029 06:07:13.722188 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:245: The name tf.trainable_variables is deprecated. Please use tf.compat.v1.trainable_variables instead.

WARNING:tensorflow:From train_ssd_network.py:365: The name tf.summary.merge is deprecated. Please use tf.compat.v1.summary.merge instead.

W1029 06:07:15.386627 140050557368192 module_wrapper.py:139] From train_ssd_network.py:365: The name tf.summary.merge is deprecated. Please use tf.compat.v1.summary.merge instead.

WARNING:tensorflow:From train_ssd_network.py:370: The name tf.GPUOptions is deprecated. Please use tf.compat.v1.GPUOptions instead.

W1029 06:07:15.390333 140050557368192 module_wrapper.py:139] From train_ssd_network.py:370: The name tf.GPUOptions is deprecated. Please use tf.compat.v1.GPUOptions instead.

WARNING:tensorflow:From train_ssd_network.py:371: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

W1029 06:07:15.390676 140050557368192 module_wrapper.py:139] From train_ssd_network.py:371: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead.

WARNING:tensorflow:From train_ssd_network.py:373: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.

W1029 06:07:15.390909 140050557368192 module_wrapper.py:139] From train_ssd_network.py:373: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead.

WARNING:tensorflow:From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:198: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info instead.

W1029 06:07:15.583815 140050557368192 module_wrapper.py:139] From /content/SSD-Tensorflow-On-Custom-Dataset/tf_utils.py:198: The name tf.logging.info is deprecated. Please use tf.compat.v1.logging.info instead.

INFO:tensorflow:Ignoring --checkpointpath because a checkpoint already exists in /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007/log/ I1029 06:07:15.584077 140050557368192 tf_utils.py:200] Ignoring --checkpointpath because a checkpoint already exists in /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007/log/ WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/learning.py:742: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession W1029 06:07:15.754359 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/learning.py:742: Supervisor.init (from tensorflow.python.training.supervisor) is deprecated and will be removed in a future version. Instructions for updating: Please switch to tf.train.MonitoredTrainingSession 2021-10-29 06:07:16.156634: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2021-10-29 06:07:16.161958: I tensorflow/core/platform/profile_utils/cpu_utils.cc:94] CPU Frequency: 2199995000 Hz 2021-10-29 06:07:16.162214: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x5607865479c0 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2021-10-29 06:07:16.162270: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2021-10-29 06:07:16.164748: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2021-10-29 06:07:16.178424: E tensorflow/stream_executor/cuda/cuda_driver.cc:318] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected 2021-10-29 06:07:16.178484: I tensorflow/stream_executor/cuda/cudadiagnostics.cc:156] kernel driver does not appear to be running on this host (1d15cca539b9): /proc/driver/nvidia/version does not exist INFO:tensorflow:Restoring parameters from /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007/log/model.ckpt-0 I1029 06:07:16.180835 140050557368192 saver.py:1284] Restoring parameters from /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007_/log/model.ckpt-0 WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/saver.py:1069: get_checkpoint_mtimes (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version. Instructions for updating: Use standard file utilities to get mtimes. W1029 06:07:16.854556 140050557368192 deprecation.py:323] From /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/saver.py:1069: get_checkpoint_mtimes (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version. Instructions for updating: Use standard file utilities to get mtimes. INFO:tensorflow:Running local_init_op. I1029 06:07:16.856429 140050557368192 session_manager.py:500] Running local_init_op. INFO:tensorflow:Done running local_init_op. I1029 06:07:16.949088 140050557368192 session_manager.py:502] Done running local_initop. INFO:tensorflow:Starting Session. I1029 06:07:19.242920 140050557368192 learning.py:754] Starting Session. INFO:tensorflow:Saving checkpoint to path /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007/log/model.ckpt I1029 06:07:19.351276 140048355174144 supervisor.py:1117] Saving checkpoint to path /content/SSD-Tensorflow-On-Custom-Dataset/VOC2007_/log/model.ckpt INFO:tensorflow:Starting Queues. I1029 06:07:19.356847 140050557368192 learning.py:768] Starting Queues. 2021-10-29 06:07:20.027180: E tensorflow/core/common_runtime/executor.cc:642] Executor failed to create kernel. Invalid argument: Default MaxPoolingOp only supports NHWC on device type CPU [[{{node ssd_300_vgg/pool1/MaxPool}}]] INFO:tensorflow:Error reported to Coordinator: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack() Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call return fn(args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn target_list, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun run_metadata) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[{{node ssd_300_vgg/pool1/MaxPool}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 297, in stop_on_exception yield File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 495, in run self.run_loop() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 1045, in run_loop [self._sv.summary_op, self._sv.global_step]) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 956, in run run_metadata_ptr) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1180, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, **kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack()

I1029 06:07:20.048422 140048338388736 coordinator.py:219] Error reported to Coordinator: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack() Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call return fn(args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn target_list, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun run_metadata) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[{{node ssd_300_vgg/pool1/MaxPool}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 297, in stop_on_exception yield File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 495, in run self.run_loop() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 1045, in run_loop [self._sv.summary_op, self._sv.global_step]) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 956, in run run_metadata_ptr) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1180, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, **kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack()

INFO:tensorflow:global_step/sec: 0 I1029 06:07:22.276000 140048346781440 supervisor.py:1099] global_step/sec: 0 2021-10-29 06:07:25.589759: E tensorflow/core/common_runtime/executor.cc:642] Executor failed to create kernel. Invalid argument: Default MaxPoolingOp only supports NHWC on device type CPU [[{{node ssd_300_vgg/pool1/MaxPool}}]] Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1365, in _do_call return fn(*args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1350, in _run_fn target_list, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1443, in _call_tf_sessionrun run_metadata) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[{{node ssd_300_vgg/pool1/MaxPool}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 1004, in managed_session yield sess File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/learning.py", line 775, in train train_step_kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/learning.py", line 490, in train_step run_metadata=run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 956, in run run_metadata_ptr) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1180, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, **kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack()

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 390, in main sync_optimizer=None) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/slim/python/slim/learning.py", line 790, in train ignore_live_threads=ignore_live_threads) File "/usr/lib/python3.7/contextlib.py", line 130, in exit self.gen.throw(type, value, traceback) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 1014, in managed_session self.stop(close_summary_writer=close_summary_writer) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 839, in stop ignore_live_threads=ignore_live_threads) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 389, in join six.reraise(*self._exc_info_to_raise) File "/usr/local/lib/python3.7/dist-packages/six.py", line 703, in reraise raise value File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 297, in stop_on_exception yield File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/coordinator.py", line 495, in run self.run_loop() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/training/supervisor.py", line 1045, in run_loop [self._sv.summary_op, self._sv.global_step]) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 956, in run run_metadata_ptr) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1180, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1359, in _do_run run_metadata) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/client/session.py", line 1384, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.InvalidArgumentError: Default MaxPoolingOp only supports NHWC on device type CPU [[node ssd_300_vgg/pool1/MaxPool (defined at /usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

Original stack trace for 'ssd_300_vgg/pool1/MaxPool': File "train_ssd_network.py", line 394, in tf.app.run() File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/platform/app.py", line 40, in run _run(main=main, argv=argv, flags_parser=_parse_flags_tolerate_undef) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 303, in run _run_main(main, args) File "/usr/local/lib/python3.7/dist-packages/absl/app.py", line 251, in _run_main sys.exit(main(argv)) File "train_ssd_network.py", line 295, in main clones = model_deploy.create_clones(deploy_config, clone_fn, [batch_queue]) File "/content/SSD-Tensorflow-On-Custom-Dataset/deployment/model_deploy.py", line 196, in create_clones outputs = model_fn(*args, kwargs) File "train_ssd_network.py", line 279, in clone_fn ssd_net.net(b_image, is_training=True) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 155, in net scope=scope) File "/content/SSD-Tensorflow-On-Custom-Dataset/nets/ssd_vgg_300.py", line 454, in ssd_net net = slim.max_pool2d(net, [2, 2], scope='pool1') File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/framework/python/ops/arg_scope.py", line 182, in func_with_args return func(*args, *current_args) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/contrib/layers/python/layers/layers.py", line 2417, in max_pool2d outputs = layer.apply(inputs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 324, in new_func return func(args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 1700, in apply return self.call(inputs, *args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/layers/base.py", line 548, in call outputs = super(Layer, self).call(inputs, *args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/engine/base_layer.py", line 854, in call outputs = call_fn(cast_inputs, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 234, in wrapper return converted_call(f, options, args, kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 439, in converted_call return _call_unconverted(f, args, kwargs, options) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/autograph/impl/api.py", line 330, in _call_unconverted return f(*args, *kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/keras/layers/pooling.py", line 248, in call data_format=conv_utils.convert_data_format(self.data_format, 4)) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/nn_ops.py", line 3815, in max_pool name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/ops/gen_nn_ops.py", line 5674, in max_pool data_format=data_format, name=name) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/op_def_library.py", line 794, in _apply_op_helper op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/util/deprecation.py", line 507, in new_func return func(args, **kwargs) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3357, in create_op attrs, op_def, compute_device) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 3426, in _create_op_internal op_def=op_def) File "/usr/local/lib/python3.7/dist-packages/tensorflow_core/python/framework/ops.py", line 1748, in init self._traceback = tf_stack.extract_stack()

shayneDuncan commented 2 years ago

I had a similar issue. My problem was that tensorflow-gpu needed a better NVIDIA GPU.