search

jmiller656 / EDSR-Tensorflow

Tensorflow implementation of Enhanced Deep Residual Networks for Single Image Super-Resolution
MIT License
332 stars 107 forks source link

test.py errors #3

Closed delray closed 7 years ago

delray commented 7 years ago

Thanks for the test.py script, but getting some errors here, it looks like the weights aren't being found in the checkpoint during the restore process. I'm using python 3.5.2 and tensorflow 1.1.0 (gpu). I'm happy to try out some other things to try and get this working. I tried inserting a 'tf.reset_default_graph()' before the restore process, but to no avail. When training, the only thing i changed from the defaults were --dataset and --imgsize here is my train cmd used:

python3 test.py --dataset /media/sugbuntu/Data/TSA/data/output/stage1_aps_front_crop/ --imgsize 128 

`sugbuntu@sugbuntu:~/ml/EDSR-Tensorflow$ python3 test.py --dataset /media/sugbuntu/Data/TSA/data/output/stage1_aps_front_crop/ --imgsize 128
Building EDSR...
2017-07-25 09:31:30.279734: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.1 instructions, but these are available on your machine and could speed up CPU computations.
2017-07-25 09:31:30.279752: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations.
2017-07-25 09:31:30.279758: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
2017-07-25 09:31:30.279779: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX2 instructions, but these are available on your machine and could speed up CPU computations.
2017-07-25 09:31:30.279784: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use FMA instructions, but these are available on your machine and could speed up CPU computations.
2017-07-25 09:31:30.393032: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:901] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2017-07-25 09:31:30.393311: I tensorflow/core/common_runtime/gpu/gpu_device.cc:887] Found device 0 with properties: 
name: GeForce GTX 1080
major: 6 minor: 1 memoryClockRate (GHz) 1.7715
pciBusID 0000:01:00.0
Total memory: 7.92GiB
Free memory: 7.36GiB
2017-07-25 09:31:30.393335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:908] DMA: 0 
2017-07-25 09:31:30.393340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:918] 0:   Y 
2017-07-25 09:31:30.393347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977] Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX 1080, pci bus id: 0000:01:00.0)
Done building!
Restoring...
2017-07-25 09:31:30.676009: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
2017-07-25 09:31:30.676679: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.677198: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.677394: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/biases not found in checkpoint
2017-07-25 09:31:30.678313: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.678432: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.678654: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.679109: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.679750: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.680074: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.680097: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.680523: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.681036: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.681337: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.681435: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.681846: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.682255: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.682564: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.682752: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.683063: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.683428: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.683765: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.683970: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.684257: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.684664: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.684969: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.685164: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.685550: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.685913: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.686444: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.686850: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.687899: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.688083: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.688249: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.689113: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.689281: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.689493: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.689779: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.690540: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.690848: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.691314: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.691696: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.691779: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.692192: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.692640: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.692975: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.693065: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.693892: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.694197: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.694248: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.695140: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.695321: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.695446: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.695706: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.696381: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.696770: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.697244: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.697564: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.697725: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.698130: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.698474: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.698781: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.699013: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.699321: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.699659: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.699954: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.700251: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.700553: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.700806: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.701113: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.701409: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.701712: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.702012: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.702503: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.703580: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.703977: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.704232: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.704848: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.705596: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.705832: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.706234: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.706474: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.707488: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.707731: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.707880: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.708060: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.709126: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.709283: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.709448: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.709607: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.710399: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.710609: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.710715: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.710920: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.711398: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.711828: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.712136: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.712945: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.713232: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.714027: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.714310: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.715131: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.715424: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.716229: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.716512: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.717279: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.717561: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.718350: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.718644: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.719437: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.719749: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.720532: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
2017-07-25 09:31:30.720833: W tensorflow/core/framework/op_kernel.cc:1152] Not found: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1039, in _do_call
    return fn(*args)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1021, in _run_fn
    status, run_metadata)
  File "/usr/lib/python3.5/contextlib.py", line 66, in __exit__
    next(self.gen)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status
    pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.NotFoundError: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "test.py", line 24, in <module>
    network.resume(args.savedir)
  File "/home/sugbuntu/ml/EDSR-Tensorflow/model.py", line 117, in resume
    self.saver.restore(self.sess,tf.train.latest_checkpoint(savedir))
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 1457, in restore
    {self.saver_def.filename_tensor_name: save_path})
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 778, in run
    run_metadata_ptr)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 982, in _run
    feed_dict_string, options, run_metadata)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1032, in _do_run
    target_list, options, run_metadata)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1052, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.NotFoundError: Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]

Caused by op 'save/RestoreV2_129', defined at:
  File "test.py", line 23, in <module>
    network = EDSR(down_size,args.layers,args.featuresize,scale=args.scale)
  File "/home/sugbuntu/ml/EDSR-Tensorflow/model.py", line 101, in __init__
    self.saver = tf.train.Saver()
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 1056, in __init__
    self.build()
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 1086, in build
    restore_sequentially=self._restore_sequentially)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 691, in build
    restore_sequentially, reshape)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 407, in _AddRestoreOps
    tensors = self.restore_op(filename_tensor, saveable, preferred_shard)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 247, in restore_op
    [spec.tensor.dtype])[0])
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/gen_io_ops.py", line 669, in restore_v2
    dtypes=dtypes, name=name)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 768, in apply_op
    op_def=op_def)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 2336, in create_op
    original_op=self._default_original_op, op_def=op_def)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1228, in __init__
    self._traceback = _extract_stack()

NotFoundError (see above for traceback): Key Conv_67/weights not found in checkpoint
     [[Node: save/RestoreV2_129 = RestoreV2[dtypes=[DT_FLOAT], _device="/job:localhost/replica:0/task:0/cpu:0"](_recv_save/Const_0, save/RestoreV2_129/tensor_names, save/RestoreV2_129/shape_and_slices)]]
`
jmiller656 commented 7 years ago

Shoot, sorry about this man. I think I know what the problem is. Did you happen to train your model, call git pull, and then run the test script? If that's the case, I think that some changes I've made in model.py and utils.py may have broken this.

From here you have two options:

  1. Retrain with the new model files (your results will likely look better this way)
  2. You replace your model.py and utils.py files with the ones that are listed here: https://github.com/jmiller656/EDSR-Tensorflow/tree/4280fefa95d1f0077d8682f6a0e74cb8724139cb and then try testing again.

Hope this helps!

delray commented 7 years ago

Thats exactly what I did - retraining now, ill let you know how it goes...thanks for all this help...

jmiller656 commented 7 years ago

No prob!