search

Tencent / tencent-ml-images

Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet
Other
3.05k stars 514 forks source link

Finetune on my own multi-label dataset loss goes up #39

Closed GorvinChen closed 5 years ago

GorvinChen commented 5 years ago

I build my own multi-label dataset, which have 746 categories. And I restore from ckpt-resnet101-mlimages. But when I use finetune.py my loss goes up. Any ideas? env: win7, python3, tf: 1.10, gpu: tesla k80 init-lr: 0.001, lr_decay_step: 5000

snipaste_2019-01-17_20-16-45 snipaste_2019-01-17_20-26-20

I had checked my data. Seems no problem. snipaste_2019-01-17_14-23-26

wubaoyuan commented 5 years ago

@GorvinChen Good to hear that your problem has been fixed.

Easyfeng222 commented 5 years ago

@GorvinChen Excuse me, let me talk about how you solve the problem? If you can talk privately?

Easyfeng222 commented 5 years ago

@wubaoyuan Excuse me, I also want to do it according to his method. Do you know how to do muti-label datasets?

Easyfeng222 commented 5 years ago

@wubaoyuan @GorvinChen When i finetune ,raise this problem,any ideas?? feng@feng-Precision-Tower-5810:~/fengfeng/tencent-ml-images$ ./example/finetune.sh ++ python2 finetune.py --mode=train --class_num=1000 --data_dir=./data/imagenet --num_gpus=4 --batch_size=64 --max_iter=600000 --lr=0.1 --lr_decay_step=150000 --lr_decay_factor=0.1 --weight_decay_rate=0.0001 --optimizer=mom --batch_norm_elipson=1e-5 --resnet_size=101 --prof_interval=500 --log_interval=5000 --snapshot=5000 --model_dir=./out/checkpoint/ --log_dir=./out/log/ --image_size=224 --FixBlock2=True --restore=True --data_format=NCHW --pretrain_ckpt=./out/checkpoint/model.ckpt batch_size=256 Building graph ... WARNING:tensorflow:From /home/feng/fengfeng/tencent-ml-images/models/resnet.py:191: calling reduce_mean (from tensorflow.python.ops.math_ops) with keep_dims is deprecated and will be removed in a future version. Instructions for updating: keep_dims is deprecated, use keepdims instead Build Graph (1/4) Build Graph (2/4) Build Graph (3/4) Build Graph (4/4) 2019-02-26 21:27:59.669783: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2019-02-26 21:27:59.829911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1392] Found device 0 with properties: name: GeForce GTX 1080 Ti major: 6 minor: 1 memoryClockRate(GHz): 1.6325 pciBusID: 0000:03:00.0 totalMemory: 10.91GiB freeMemory: 10.00GiB 2019-02-26 21:27:59.829944: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1471] Adding visible gpu devices: 0 2019-02-26 21:28:00.051811: I tensorflow/core/common_runtime/gpu/gpu_device.cc:952] Device interconnect StreamExecutor with strength 1 edge matrix: 2019-02-26 21:28:00.051849: I tensorflow/core/common_runtime/gpu/gpu_device.cc:958] 0 2019-02-26 21:28:00.051858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] 0: N 2019-02-26 21:28:00.052061: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1084] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9672 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1080 Ti, pci bus id: 0000:03:00.0, compute capability: 6.1) Restoring checkpoint from ./out/checkpoint/model.ckpt restore from ckpt key:stages_2_block_18/conv1_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_19/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_14/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_3_block_1/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_17/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_0/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_17/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_12/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_7/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_3_block_2/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_4/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_10/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_20/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_1_block_0/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_3_block_1/conv1_b2/conv2d/kernel restore from ckpt key:stages_3_block_0/conv1_b1_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_1/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_5/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_0_block_2/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_3_block_2/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_13/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_3_block_2/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_3_block_1/conv3_b2/conv2d/kernel restore from ckpt key:stages_0_block_0/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_15/conv1_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_3_block_0/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_15/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_3_block_0/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_9/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_0_block_1/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_1_block_1/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_17/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_8/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_0_block_0/conv1_b1_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_0/conv3_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_13/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_21/conv2_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_3_block_1/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_3_block_1/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_1/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_2/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_2/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_7/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_1/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_20/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_1_block_2/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_7/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_21/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_7/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_18/conv1_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_0_block_0/conv1_b1_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_3_block_1/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_0/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_1_block_0/conv1_b1_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_17/conv2_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_21/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_12/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_15/conv3_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_4/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_21/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_5/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_17/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_18/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_20/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_11/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_14/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_3_block_1/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_3/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_0_block_2/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_0_block_0/conv3_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_9/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_14/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_1_block_3/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_6/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_3/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_6/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_3_block_2/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_0_block_0/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_8/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_19/conv1_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_20/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_1_block_1/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_1_block_1/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_19/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_2/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_9/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_1_block_1/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_3/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_5/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_0/conv1_b2/conv2d/kernel restore from ckpt key:stages_2_block_15/conv2_b2/conv2d/kernel restore from ckpt key:stages_3_block_2/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_9/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_20/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_17/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_0_block_1/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_10/conv2_b2/conv2d/kernel restore from ckpt key:stages_2_block_21/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_13/conv2_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_8/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_13/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_15/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:init/init_conv/conv2d/kernel do not need restore from ckpt key:stages_3_block_1/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_16/conv2_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_9/conv1_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_1/conv1_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:global_pool/bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_19/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_4/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_0_block_2/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_0_block_0/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_21/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_3/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_14/conv3_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_20/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_0_block_1/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_6/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_12/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_5/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_1_block_0/conv3_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_5/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_19/conv3_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_2/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_0/conv2_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_9/conv2_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_16/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_9/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_0/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_16/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_17/conv3_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_0_block_2/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_11/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_18/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_7/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_13/conv1_b2/conv2d/kernel restore from ckpt key:stages_0_block_1/conv3_b2/conv2d/kernel restore from ckpt key:stages_1_block_2/conv3_b2/conv2d/kernel restore from ckpt key:stages_2_block_1/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_6/conv3_b2/conv2d/kernel restore from ckpt key:stages_3_block_2/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_8/conv2_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_5/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_11/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_0/conv2_b2/conv2d/kernel restore from ckpt key:stages_2_block_0/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_0_block_2/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_20/conv1_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_6/conv1_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_15/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_2/conv3_b2/conv2d/kernel restore from ckpt key:stages_2_block_20/conv3_b2/conv2d/kernel restore from ckpt key:stages_1_block_2/conv3_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_12/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_1/conv2_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_14/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_5/conv1_b2/conv2d/kernel restore from ckpt key:stages_2_block_5/conv3_b2/conv2d/kernel restore from ckpt key:stages_2_block_1/conv1_b2/conv2d/kernel restore from ckpt key:stages_2_block_11/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_15/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_2/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_0/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_8/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_0_block_2/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_3_block_1/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_18/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_17/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_4/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_11/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_3_block_2/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_3_block_1/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_20/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_3_block_2/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_5/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_1_block_1/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_17/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_5/conv2_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_6/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_1/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_3_block_0/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_3/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_17/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_10/conv3_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_2/conv1_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_12/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_1/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_1_block_1/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_13/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_0_block_2/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_1_block_2/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_11/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_0_block_2/conv3_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_0_block_0/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_4/conv3_b2/conv2d/kernel restore from ckpt key:stages_2_block_2/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_0_block_0/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:logits/dense/bias/Momentum restore from ckpt key:stages_2_block_18/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_13/conv3_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_4/conv2_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_0/conv1_b1_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_15/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_21/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_0/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_3/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_4/conv2_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_0/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_12/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_10/conv1_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_0_block_1/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_0_block_0/conv1_b1_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_10/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_4/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_0_block_1/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_1_block_0/conv1_b1/conv2d/kernel restore from ckpt key:stages_2_block_14/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_5/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_0_block_0/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_0_block_2/conv3_b2/conv2d/kernel restore from ckpt key:stages_2_block_3/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:init/init_conv/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_2/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_1_block_0/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_22/conv2_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_10/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_18/conv1_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_19/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_3_block_0/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_4/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_4/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_19/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_0_block_1/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_7/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_18/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_3_block_2/conv3_b2_bn/batch_normalization/moving_variance do not need restore from ckpt key:stages_2_block_13/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_14/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_3/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_1_block_2/conv2_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_21/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_14/conv3_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_2/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_9/conv2_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_1_block_0/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_2/conv2_b2/conv2d/kernel do not need restore from ckpt key:stages_2_block_1/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_6/conv1_b2_bn/batch_normalization/beta restore from ckpt key:global_pool/bn/batch_normalization/moving_variance restore from ckpt key:stages_3_block_0/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_19/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_7/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_8/conv1_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_16/conv1_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_11/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_21/conv2_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_13/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_7/conv3_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_20/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_7/conv1_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_0/conv2_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_10/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_0/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_3_block_0/conv1_b1/conv2d/kernel do not need restore from ckpt key:stages_2_block_11/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_4/conv3_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_9/conv1_b2/conv2d/kernel do not need restore from ckpt key:stages_1_block_2/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_15/conv3_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_19/conv1_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_2_block_0/conv2_b2/conv2d/kernel/Momentum do not need restore from ckpt key:stages_2_block_5/conv1_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_17/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_10/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_14/conv3_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_12/conv3_b2/conv2d/kernel/Momentum do not need restore from ckpt key:logits/dense/kernel/Momentum do not need restore from ckpt key:stages_1_block_0/conv1_b1/conv2d/kernel/Momentum do not need restore from ckpt key:stages_3_block_2/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_0/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_0/conv1_b1/conv2d/kernel do not need restore from ckpt key:stages_2_block_14/conv1_b2/conv2d/kernel/Momentum restore from ckpt key:stages_1_block_1/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_0_block_1/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_20/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_9/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_12/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_16/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_3/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_14/conv2_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_1_block_0/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_3/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_3_block_1/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_1_block_3/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_3_block_0/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_10/conv2_b2_bn/batch_normalization/beta/Momentum do not need restore from ckpt key:stages_2_block_4/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_19/conv3_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_5/conv3_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_10/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_7/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_16/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_1/conv2_b2_bn/batch_normalization/gamma/Momentum do not need restore from ckpt key:stages_0_block_2/conv3_b2/conv2d/kernel/Momentum restore from ckpt key:stages_0_block_1/conv2_b2_bn/batch_normalization/gamma restore from ckpt key:stages_3_block_2/conv1_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_2_block_18/conv3_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_2_block_12/conv1_b2/conv2d/kernel restore from ckpt key:stages_2_block_7/conv2_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_9/conv1_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_2_block_3/conv2_b2_bn/batch_normalization/gamma/Momentum restore from ckpt key:stages_2_block_1/conv3_b2_bn/batch_normalization/beta restore from ckpt key:stages_3_block_0/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_16/conv1_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_1/conv1_b2_bn/batch_normalization/beta restore from ckpt key:stages_2_block_15/conv1_b2_bn/batch_normalization/moving_mean restore from ckpt key:stages_2_block_12/conv3_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_1_block_0/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:global_pool/bn/batch_normalization/gamma restore from ckpt key:stages_2_block_6/conv3_b2_bn/batch_normalization/moving_variance restore from ckpt key:stages_2_block_15/conv2_b2_bn/batch_normalization/moving_mean do not need restore from ckpt key:stages_0_block_2/conv1_b2_bn/batch_normalization/beta/Momentum restore from ckpt key:stages_1_block_2/conv2_b2_bn/batch_normalization/beta do not need restore from ckpt key:stages_0_block_0/conv1_b1/conv2d/kernel/Momentum restore from ckpt key:stages_2_block_4/conv3_b2_bn/batch_normalization/gamma restore from ckpt key:stages_2_block_3/conv1_b2_bn/batch_normalization/gamma do not need restore from ckpt key:stages_2_block_11/conv2_b2/conv2d/kernel/Momentum

hanztup commented 5 years ago

@GorvinChen hi, did you add additional code for evaluation, when you use the finetune.py? can you shed some light to me ? thanks!

mehrazi commented 4 years ago

@wubaoyuan @GorvinChen Hi, I have the same problem. what should I do to solve this problem? what's your python and tensorflow version?