search

AIWintermuteAI / aXeleRate

Keras-based framework for AI on the Edge
MIT License
174 stars 72 forks source link

'ProgbarLogger' object has no attribute 'log_values' #36

Closed spstrademark closed 3 years ago

spstrademark commented 3 years ago

Hello, I am facing the specified error with the following config :

OS : Ubuntu 18.04 Tensorflow: 1.15.04 Keras : 2.3.1

JSON:

{
    "model" : {
        "type":                 "Classifier",
        "architecture":         "NASNetMobile",
        "input_size":           224,
        "fully-connected":      [],
        "labels":               [],
        "dropout" :             0.2
    },
     "weights" : {
            "full":                 "",
            "backend":              "imagenet",
            "save_bottleneck":      false

    },
    "train" : {
        "actual_epoch":         100,
        "train_image_folder":   "/mnt/0d2701de-7997-4d53-99fb-0c9de0a116c9/K210_tools/data/fire_dataset/cat_imaages",
        "train_times":          1,
        "valid_image_folder":   "/mnt/0d2701de-7997-4d53-99fb-0c9de0a116c9/K210_tools/data/fire_dataset/non_cat_images",
        "valid_times":          1,
        "valid_metric":         "val_accuracy",
        "batch_size":           16,
        "learning_rate":        1e-3,
        "saved_folder":         "cat",
        "first_trainable_layer": "",
        "augumentation":         true
    },
    "converter" : {
        "type":                 ["k210"]
    }
}

When i run python train.py -c ../configs/cat_classifier.json i get the following error AttributeError: 'ProgbarLogger' object has no attribute 'log_values' I have tried adding " dense " to the first_trainable_layer but i get a different error Exception: First trainable layer specified in config file is not in the model Also i have tried with the dogs_classifier with the provided data from the sample_datasets and the result is the same.

Thank you for your time!

AIWintermuteAI commented 3 years ago

Hi there! You're supposed to switch to Tensorflow 2.3.0 with new version of aXeleRate (starting 0.7). Strange problems may occur if you use 1.15. Your issue however is likely not related to tensorflow version. AttributeError: 'ProgbarLogger' object has no attribute 'log_values' is a cryptic Keras message that normally is caused by not having enough data to create a batch (either for training or evaluation). Make sure you have at least as many data samples as 16 (your specified batch size).

spstrademark commented 3 years ago

Hello, I have updated to the latest version of AxeleRate, installed the packages from the requirements.txt file, tried with both tensorflow 2.3.0 and 2.4.1 ( current version ). The train_image_folder contains 755 images. The valid_image_folder contains 244 images. Now when i run the classifer i get ValueError: Asked to retrieve element 0, but the Sequence has length 0

Thank you for your time!

AIWintermuteAI commented 3 years ago

Can you post full command and error output?

spstrademark commented 3 years ago

Here is the compleye log

2021-02-06 09:09:39.453284: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-02-06 09:09:39.453309: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Project folder projects/cat already exists. Creating a folder for new training session.
K210 Converter ready
Classifier
2021-02-06 09:09:40.968753: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-02-06 09:09:40.969444: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-02-06 09:09:40.988853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: 
pciBusID: 0000:65:00.0 name: GeForce GTX 1080 Ti computeCapability: 6.1
coreClock: 1.6705GHz coreCount: 28 deviceMemorySize: 10.91GiB deviceMemoryBandwidth: 451.17GiB/s
2021-02-06 09:09:40.989010: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2021-02-06 09:09:40.989068: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcublas.so.11'; dlerror: libcublas.so.11: cannot open shared object file: No such file or directory
2021-02-06 09:09:40.989111: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcublasLt.so.11'; dlerror: libcublasLt.so.11: cannot open shared object file: No such file or directory
2021-02-06 09:09:40.990365: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-02-06 09:09:40.990649: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-02-06 09:09:40.991850: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-02-06 09:09:40.991949: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcusparse.so.11'; dlerror: libcusparse.so.11: cannot open shared object file: No such file or directory
2021-02-06 09:09:40.991996: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory
2021-02-06 09:09:40.992005: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1757] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2021-02-06 09:09:40.992239: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2021-02-06 09:09:40.992664: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-02-06 09:09:40.992685: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-02-06 09:09:40.992690: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267]      
Successfully loaded imagenet backend weights
Failed to load pre-trained weights for the whole model. It might be because you didn't specify any or the weight file cannot be found
Found 0 images belonging to 0 classes.
Found 0 images belonging to 0 classes.
Current training session folder is projects/cat/2021-02-06_09-09-44

Model: "classifier"
__________________________________________________________________________________________________
Layer (type)                    Output Shape         Param #     Connected to                     
==================================================================================================
input_1 (InputLayer)            [(None, 224, 224, 3) 0                                            
__________________________________________________________________________________________________
stem_conv1 (Conv2D)             (None, 111, 111, 32) 864         input_1[0][0]                    
__________________________________________________________________________________________________
stem_bn1 (BatchNormalization)   (None, 111, 111, 32) 128         stem_conv1[0][0]                 
__________________________________________________________________________________________________
activation (Activation)         (None, 111, 111, 32) 0           stem_bn1[0][0]                   
__________________________________________________________________________________________________
reduction_conv_1_stem_1 (Conv2D (None, 111, 111, 11) 352         activation[0][0]                 
__________________________________________________________________________________________________
reduction_bn_1_stem_1 (BatchNor (None, 111, 111, 11) 44          reduction_conv_1_stem_1[0][0]    
__________________________________________________________________________________________________
activation_1 (Activation)       (None, 111, 111, 11) 0           reduction_bn_1_stem_1[0][0]      
__________________________________________________________________________________________________
activation_3 (Activation)       (None, 111, 111, 32) 0           stem_bn1[0][0]                   
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 115, 115, 11) 0           activation_1[0][0]               
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 117, 117, 32) 0           activation_3[0][0]               
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 56, 56, 11)   396         separable_conv_1_pad_reduction_le
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 56, 56, 11)   1920        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 56, 56, 11)   44          separable_conv_1_reduction_left1_
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_1_reduction_right1
__________________________________________________________________________________________________
activation_2 (Activation)       (None, 56, 56, 11)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
activation_4 (Activation)       (None, 56, 56, 11)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 56, 56, 11)   396         activation_2[0][0]               
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 56, 56, 11)   660         activation_4[0][0]               
__________________________________________________________________________________________________
activation_5 (Activation)       (None, 111, 111, 32) 0           stem_bn1[0][0]                   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 56, 56, 11)   44          separable_conv_2_reduction_left1_
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_2_reduction_right1
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 117, 117, 32) 0           activation_5[0][0]               
__________________________________________________________________________________________________
activation_7 (Activation)       (None, 111, 111, 32) 0           stem_bn1[0][0]                   
__________________________________________________________________________________________________
reduction_add_1_stem_1 (Add)    (None, 56, 56, 11)   0           separable_conv_2_bn_reduction_lef
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 56, 56, 11)   1920        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 115, 115, 32) 0           activation_7[0][0]               
__________________________________________________________________________________________________
activation_9 (Activation)       (None, 56, 56, 11)   0           reduction_add_1_stem_1[0][0]     
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_1_reduction_right2
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 56, 56, 11)   1152        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 56, 56, 11)   220         activation_9[0][0]               
__________________________________________________________________________________________________
activation_6 (Activation)       (None, 56, 56, 11)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_1_reduction_right3
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 56, 56, 11)   44          separable_conv_1_reduction_left4_
__________________________________________________________________________________________________
reduction_pad_1_stem_1 (ZeroPad (None, 113, 113, 11) 0           reduction_bn_1_stem_1[0][0]      
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 56, 56, 11)   660         activation_6[0][0]               
__________________________________________________________________________________________________
activation_8 (Activation)       (None, 56, 56, 11)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
activation_10 (Activation)      (None, 56, 56, 11)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
reduction_left2_stem_1 (MaxPool (None, 56, 56, 11)   0           reduction_pad_1_stem_1[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_2_reduction_right2
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 56, 56, 11)   396         activation_8[0][0]               
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 56, 56, 11)   220         activation_10[0][0]              
__________________________________________________________________________________________________
adjust_relu_1_stem_2 (Activatio (None, 111, 111, 32) 0           stem_bn1[0][0]                   
__________________________________________________________________________________________________
reduction_add_2_stem_1 (Add)    (None, 56, 56, 11)   0           reduction_left2_stem_1[0][0]     
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
reduction_left3_stem_1 (Average (None, 56, 56, 11)   0           reduction_pad_1_stem_1[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 56, 56, 11)   44          separable_conv_2_reduction_right3
__________________________________________________________________________________________________
reduction_left4_stem_1 (Average (None, 56, 56, 11)   0           reduction_add_1_stem_1[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 56, 56, 11)   44          separable_conv_2_reduction_left4_
__________________________________________________________________________________________________
reduction_right5_stem_1 (MaxPoo (None, 56, 56, 11)   0           reduction_pad_1_stem_1[0][0]     
__________________________________________________________________________________________________
zero_padding2d (ZeroPadding2D)  (None, 112, 112, 32) 0           adjust_relu_1_stem_2[0][0]       
__________________________________________________________________________________________________
reduction_add3_stem_1 (Add)     (None, 56, 56, 11)   0           reduction_left3_stem_1[0][0]     
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
add (Add)                       (None, 56, 56, 11)   0           reduction_add_2_stem_1[0][0]     
                                                                 reduction_left4_stem_1[0][0]     
__________________________________________________________________________________________________
reduction_add4_stem_1 (Add)     (None, 56, 56, 11)   0           separable_conv_2_bn_reduction_lef
                                                                 reduction_right5_stem_1[0][0]    
__________________________________________________________________________________________________
cropping2d (Cropping2D)         (None, 111, 111, 32) 0           zero_padding2d[0][0]             
__________________________________________________________________________________________________
reduction_concat_stem_1 (Concat (None, 56, 56, 44)   0           reduction_add_2_stem_1[0][0]     
                                                                 reduction_add3_stem_1[0][0]      
                                                                 add[0][0]                        
                                                                 reduction_add4_stem_1[0][0]      
__________________________________________________________________________________________________
adjust_avg_pool_1_stem_2 (Avera (None, 56, 56, 32)   0           adjust_relu_1_stem_2[0][0]       
__________________________________________________________________________________________________
adjust_avg_pool_2_stem_2 (Avera (None, 56, 56, 32)   0           cropping2d[0][0]                 
__________________________________________________________________________________________________
activation_11 (Activation)      (None, 56, 56, 44)   0           reduction_concat_stem_1[0][0]    
__________________________________________________________________________________________________
adjust_conv_1_stem_2 (Conv2D)   (None, 56, 56, 11)   352         adjust_avg_pool_1_stem_2[0][0]   
__________________________________________________________________________________________________
adjust_conv_2_stem_2 (Conv2D)   (None, 56, 56, 11)   352         adjust_avg_pool_2_stem_2[0][0]   
__________________________________________________________________________________________________
reduction_conv_1_stem_2 (Conv2D (None, 56, 56, 22)   968         activation_11[0][0]              
__________________________________________________________________________________________________
concatenate (Concatenate)       (None, 56, 56, 22)   0           adjust_conv_1_stem_2[0][0]       
                                                                 adjust_conv_2_stem_2[0][0]       
__________________________________________________________________________________________________
reduction_bn_1_stem_2 (BatchNor (None, 56, 56, 22)   88          reduction_conv_1_stem_2[0][0]    
__________________________________________________________________________________________________
adjust_bn_stem_2 (BatchNormaliz (None, 56, 56, 22)   88          concatenate[0][0]                
__________________________________________________________________________________________________
activation_12 (Activation)      (None, 56, 56, 22)   0           reduction_bn_1_stem_2[0][0]      
__________________________________________________________________________________________________
activation_14 (Activation)      (None, 56, 56, 22)   0           adjust_bn_stem_2[0][0]           
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 59, 59, 22)   0           activation_12[0][0]              
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 61, 61, 22)   0           activation_14[0][0]              
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 28, 28, 22)   1034        separable_conv_1_pad_reduction_le
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 28, 28, 22)   1562        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 28, 28, 22)   88          separable_conv_1_reduction_left1_
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_1_reduction_right1
__________________________________________________________________________________________________
activation_13 (Activation)      (None, 28, 28, 22)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
activation_15 (Activation)      (None, 28, 28, 22)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 28, 28, 22)   1034        activation_13[0][0]              
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 28, 28, 22)   1562        activation_15[0][0]              
__________________________________________________________________________________________________
activation_16 (Activation)      (None, 56, 56, 22)   0           adjust_bn_stem_2[0][0]           
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 28, 28, 22)   88          separable_conv_2_reduction_left1_
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_2_reduction_right1
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 61, 61, 22)   0           activation_16[0][0]              
__________________________________________________________________________________________________
activation_18 (Activation)      (None, 56, 56, 22)   0           adjust_bn_stem_2[0][0]           
__________________________________________________________________________________________________
reduction_add_1_stem_2 (Add)    (None, 28, 28, 22)   0           separable_conv_2_bn_reduction_lef
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 28, 28, 22)   1562        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 59, 59, 22)   0           activation_18[0][0]              
__________________________________________________________________________________________________
activation_20 (Activation)      (None, 28, 28, 22)   0           reduction_add_1_stem_2[0][0]     
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_1_reduction_right2
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 28, 28, 22)   1034        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 28, 28, 22)   682         activation_20[0][0]              
__________________________________________________________________________________________________
activation_17 (Activation)      (None, 28, 28, 22)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_1_reduction_right3
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 28, 28, 22)   88          separable_conv_1_reduction_left4_
__________________________________________________________________________________________________
reduction_pad_1_stem_2 (ZeroPad (None, 57, 57, 22)   0           reduction_bn_1_stem_2[0][0]      
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 28, 28, 22)   1562        activation_17[0][0]              
__________________________________________________________________________________________________
activation_19 (Activation)      (None, 28, 28, 22)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
activation_21 (Activation)      (None, 28, 28, 22)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
reduction_left2_stem_2 (MaxPool (None, 28, 28, 22)   0           reduction_pad_1_stem_2[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_2_reduction_right2
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 28, 28, 22)   1034        activation_19[0][0]              
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 28, 28, 22)   682         activation_21[0][0]              
__________________________________________________________________________________________________
adjust_relu_1_0 (Activation)    (None, 56, 56, 44)   0           reduction_concat_stem_1[0][0]    
__________________________________________________________________________________________________
reduction_add_2_stem_2 (Add)    (None, 28, 28, 22)   0           reduction_left2_stem_2[0][0]     
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
reduction_left3_stem_2 (Average (None, 28, 28, 22)   0           reduction_pad_1_stem_2[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 28, 28, 22)   88          separable_conv_2_reduction_right3
__________________________________________________________________________________________________
reduction_left4_stem_2 (Average (None, 28, 28, 22)   0           reduction_add_1_stem_2[0][0]     
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 28, 28, 22)   88          separable_conv_2_reduction_left4_
__________________________________________________________________________________________________
reduction_right5_stem_2 (MaxPoo (None, 28, 28, 22)   0           reduction_pad_1_stem_2[0][0]     
__________________________________________________________________________________________________
zero_padding2d_1 (ZeroPadding2D (None, 57, 57, 44)   0           adjust_relu_1_0[0][0]            
__________________________________________________________________________________________________
reduction_add3_stem_2 (Add)     (None, 28, 28, 22)   0           reduction_left3_stem_2[0][0]     
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
add_1 (Add)                     (None, 28, 28, 22)   0           reduction_add_2_stem_2[0][0]     
                                                                 reduction_left4_stem_2[0][0]     
__________________________________________________________________________________________________
reduction_add4_stem_2 (Add)     (None, 28, 28, 22)   0           separable_conv_2_bn_reduction_lef
                                                                 reduction_right5_stem_2[0][0]    
__________________________________________________________________________________________________
cropping2d_1 (Cropping2D)       (None, 56, 56, 44)   0           zero_padding2d_1[0][0]           
__________________________________________________________________________________________________
reduction_concat_stem_2 (Concat (None, 28, 28, 88)   0           reduction_add_2_stem_2[0][0]     
                                                                 reduction_add3_stem_2[0][0]      
                                                                 add_1[0][0]                      
                                                                 reduction_add4_stem_2[0][0]      
__________________________________________________________________________________________________
adjust_avg_pool_1_0 (AveragePoo (None, 28, 28, 44)   0           adjust_relu_1_0[0][0]            
__________________________________________________________________________________________________
adjust_avg_pool_2_0 (AveragePoo (None, 28, 28, 44)   0           cropping2d_1[0][0]               
__________________________________________________________________________________________________
adjust_conv_1_0 (Conv2D)        (None, 28, 28, 22)   968         adjust_avg_pool_1_0[0][0]        
__________________________________________________________________________________________________
adjust_conv_2_0 (Conv2D)        (None, 28, 28, 22)   968         adjust_avg_pool_2_0[0][0]        
__________________________________________________________________________________________________
activation_22 (Activation)      (None, 28, 28, 88)   0           reduction_concat_stem_2[0][0]    
__________________________________________________________________________________________________
concatenate_1 (Concatenate)     (None, 28, 28, 44)   0           adjust_conv_1_0[0][0]            
                                                                 adjust_conv_2_0[0][0]            
__________________________________________________________________________________________________
normal_conv_1_0 (Conv2D)        (None, 28, 28, 44)   3872        activation_22[0][0]              
__________________________________________________________________________________________________
adjust_bn_0 (BatchNormalization (None, 28, 28, 44)   176         concatenate_1[0][0]              
__________________________________________________________________________________________________
normal_bn_1_0 (BatchNormalizati (None, 28, 28, 44)   176         normal_conv_1_0[0][0]            
__________________________________________________________________________________________________
activation_23 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_0[0][0]              
__________________________________________________________________________________________________
activation_25 (Activation)      (None, 28, 28, 44)   0           adjust_bn_0[0][0]                
__________________________________________________________________________________________________
activation_27 (Activation)      (None, 28, 28, 44)   0           adjust_bn_0[0][0]                
__________________________________________________________________________________________________
activation_29 (Activation)      (None, 28, 28, 44)   0           adjust_bn_0[0][0]                
__________________________________________________________________________________________________
activation_31 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_0[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_0 (None, 28, 28, 44)   3036        activation_23[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 28, 28, 44)   2332        activation_25[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_0 (None, 28, 28, 44)   3036        activation_27[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 28, 28, 44)   2332        activation_29[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left5_0 (None, 28, 28, 44)   2332        activation_31[0][0]              
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left1_0[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right1_0[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left2_0[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right2_0[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left5_0[0
__________________________________________________________________________________________________
activation_24 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_26 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_28 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_30 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_32 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_0 (None, 28, 28, 44)   3036        activation_24[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 28, 28, 44)   2332        activation_26[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_0 (None, 28, 28, 44)   3036        activation_28[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 28, 28, 44)   2332        activation_30[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left5_0 (None, 28, 28, 44)   2332        activation_32[0][0]              
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left1_0[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right1_0[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left2_0[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right2_0[
__________________________________________________________________________________________________
normal_left3_0 (AveragePooling2 (None, 28, 28, 44)   0           normal_bn_1_0[0][0]              
__________________________________________________________________________________________________
normal_left4_0 (AveragePooling2 (None, 28, 28, 44)   0           adjust_bn_0[0][0]                
__________________________________________________________________________________________________
normal_right4_0 (AveragePooling (None, 28, 28, 44)   0           adjust_bn_0[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left5_0[0
__________________________________________________________________________________________________
normal_add_1_0 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_0 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_0 (Add)            (None, 28, 28, 44)   0           normal_left3_0[0][0]             
                                                                 adjust_bn_0[0][0]                
__________________________________________________________________________________________________
normal_add_4_0 (Add)            (None, 28, 28, 44)   0           normal_left4_0[0][0]             
                                                                 normal_right4_0[0][0]            
__________________________________________________________________________________________________
normal_add_5_0 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_0[0][0]              
__________________________________________________________________________________________________
normal_concat_0 (Concatenate)   (None, 28, 28, 264)  0           adjust_bn_0[0][0]                
                                                                 normal_add_1_0[0][0]             
                                                                 normal_add_2_0[0][0]             
                                                                 normal_add_3_0[0][0]             
                                                                 normal_add_4_0[0][0]             
                                                                 normal_add_5_0[0][0]             
__________________________________________________________________________________________________
activation_33 (Activation)      (None, 28, 28, 88)   0           reduction_concat_stem_2[0][0]    
__________________________________________________________________________________________________
activation_34 (Activation)      (None, 28, 28, 264)  0           normal_concat_0[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_1 (Conv2 (None, 28, 28, 44)   3872        activation_33[0][0]              
__________________________________________________________________________________________________
normal_conv_1_1 (Conv2D)        (None, 28, 28, 44)   11616       activation_34[0][0]              
__________________________________________________________________________________________________
adjust_bn_1 (BatchNormalization (None, 28, 28, 44)   176         adjust_conv_projection_1[0][0]   
__________________________________________________________________________________________________
normal_bn_1_1 (BatchNormalizati (None, 28, 28, 44)   176         normal_conv_1_1[0][0]            
__________________________________________________________________________________________________
activation_35 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_1[0][0]              
__________________________________________________________________________________________________
activation_37 (Activation)      (None, 28, 28, 44)   0           adjust_bn_1[0][0]                
__________________________________________________________________________________________________
activation_39 (Activation)      (None, 28, 28, 44)   0           adjust_bn_1[0][0]                
__________________________________________________________________________________________________
activation_41 (Activation)      (None, 28, 28, 44)   0           adjust_bn_1[0][0]                
__________________________________________________________________________________________________
activation_43 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_1[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_1 (None, 28, 28, 44)   3036        activation_35[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 28, 28, 44)   2332        activation_37[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_1 (None, 28, 28, 44)   3036        activation_39[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 28, 28, 44)   2332        activation_41[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left5_1 (None, 28, 28, 44)   2332        activation_43[0][0]              
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left1_1[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right1_1[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left2_1[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right2_1[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left5_1[0
__________________________________________________________________________________________________
activation_36 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_38 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_40 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_42 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_44 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_1 (None, 28, 28, 44)   3036        activation_36[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 28, 28, 44)   2332        activation_38[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_1 (None, 28, 28, 44)   3036        activation_40[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 28, 28, 44)   2332        activation_42[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left5_1 (None, 28, 28, 44)   2332        activation_44[0][0]              
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left1_1[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right1_1[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left2_1[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right2_1[
__________________________________________________________________________________________________
normal_left3_1 (AveragePooling2 (None, 28, 28, 44)   0           normal_bn_1_1[0][0]              
__________________________________________________________________________________________________
normal_left4_1 (AveragePooling2 (None, 28, 28, 44)   0           adjust_bn_1[0][0]                
__________________________________________________________________________________________________
normal_right4_1 (AveragePooling (None, 28, 28, 44)   0           adjust_bn_1[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left5_1[0
__________________________________________________________________________________________________
normal_add_1_1 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_1 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_1 (Add)            (None, 28, 28, 44)   0           normal_left3_1[0][0]             
                                                                 adjust_bn_1[0][0]                
__________________________________________________________________________________________________
normal_add_4_1 (Add)            (None, 28, 28, 44)   0           normal_left4_1[0][0]             
                                                                 normal_right4_1[0][0]            
__________________________________________________________________________________________________
normal_add_5_1 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_1[0][0]              
__________________________________________________________________________________________________
normal_concat_1 (Concatenate)   (None, 28, 28, 264)  0           adjust_bn_1[0][0]                
                                                                 normal_add_1_1[0][0]             
                                                                 normal_add_2_1[0][0]             
                                                                 normal_add_3_1[0][0]             
                                                                 normal_add_4_1[0][0]             
                                                                 normal_add_5_1[0][0]             
__________________________________________________________________________________________________
activation_45 (Activation)      (None, 28, 28, 264)  0           normal_concat_0[0][0]            
__________________________________________________________________________________________________
activation_46 (Activation)      (None, 28, 28, 264)  0           normal_concat_1[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_2 (Conv2 (None, 28, 28, 44)   11616       activation_45[0][0]              
__________________________________________________________________________________________________
normal_conv_1_2 (Conv2D)        (None, 28, 28, 44)   11616       activation_46[0][0]              
__________________________________________________________________________________________________
adjust_bn_2 (BatchNormalization (None, 28, 28, 44)   176         adjust_conv_projection_2[0][0]   
__________________________________________________________________________________________________
normal_bn_1_2 (BatchNormalizati (None, 28, 28, 44)   176         normal_conv_1_2[0][0]            
__________________________________________________________________________________________________
activation_47 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_2[0][0]              
__________________________________________________________________________________________________
activation_49 (Activation)      (None, 28, 28, 44)   0           adjust_bn_2[0][0]                
__________________________________________________________________________________________________
activation_51 (Activation)      (None, 28, 28, 44)   0           adjust_bn_2[0][0]                
__________________________________________________________________________________________________
activation_53 (Activation)      (None, 28, 28, 44)   0           adjust_bn_2[0][0]                
__________________________________________________________________________________________________
activation_55 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_2[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_2 (None, 28, 28, 44)   3036        activation_47[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 28, 28, 44)   2332        activation_49[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_2 (None, 28, 28, 44)   3036        activation_51[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 28, 28, 44)   2332        activation_53[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left5_2 (None, 28, 28, 44)   2332        activation_55[0][0]              
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left1_2[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right1_2[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left2_2[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right2_2[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left5_2[0
__________________________________________________________________________________________________
activation_48 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_50 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_52 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_54 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_56 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_2 (None, 28, 28, 44)   3036        activation_48[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 28, 28, 44)   2332        activation_50[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_2 (None, 28, 28, 44)   3036        activation_52[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 28, 28, 44)   2332        activation_54[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left5_2 (None, 28, 28, 44)   2332        activation_56[0][0]              
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left1_2[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right1_2[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left2_2[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right2_2[
__________________________________________________________________________________________________
normal_left3_2 (AveragePooling2 (None, 28, 28, 44)   0           normal_bn_1_2[0][0]              
__________________________________________________________________________________________________
normal_left4_2 (AveragePooling2 (None, 28, 28, 44)   0           adjust_bn_2[0][0]                
__________________________________________________________________________________________________
normal_right4_2 (AveragePooling (None, 28, 28, 44)   0           adjust_bn_2[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left5_2[0
__________________________________________________________________________________________________
normal_add_1_2 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_2 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_2 (Add)            (None, 28, 28, 44)   0           normal_left3_2[0][0]             
                                                                 adjust_bn_2[0][0]                
__________________________________________________________________________________________________
normal_add_4_2 (Add)            (None, 28, 28, 44)   0           normal_left4_2[0][0]             
                                                                 normal_right4_2[0][0]            
__________________________________________________________________________________________________
normal_add_5_2 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_2[0][0]              
__________________________________________________________________________________________________
normal_concat_2 (Concatenate)   (None, 28, 28, 264)  0           adjust_bn_2[0][0]                
                                                                 normal_add_1_2[0][0]             
                                                                 normal_add_2_2[0][0]             
                                                                 normal_add_3_2[0][0]             
                                                                 normal_add_4_2[0][0]             
                                                                 normal_add_5_2[0][0]             
__________________________________________________________________________________________________
activation_57 (Activation)      (None, 28, 28, 264)  0           normal_concat_1[0][0]            
__________________________________________________________________________________________________
activation_58 (Activation)      (None, 28, 28, 264)  0           normal_concat_2[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_3 (Conv2 (None, 28, 28, 44)   11616       activation_57[0][0]              
__________________________________________________________________________________________________
normal_conv_1_3 (Conv2D)        (None, 28, 28, 44)   11616       activation_58[0][0]              
__________________________________________________________________________________________________
adjust_bn_3 (BatchNormalization (None, 28, 28, 44)   176         adjust_conv_projection_3[0][0]   
__________________________________________________________________________________________________
normal_bn_1_3 (BatchNormalizati (None, 28, 28, 44)   176         normal_conv_1_3[0][0]            
__________________________________________________________________________________________________
activation_59 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_3[0][0]              
__________________________________________________________________________________________________
activation_61 (Activation)      (None, 28, 28, 44)   0           adjust_bn_3[0][0]                
__________________________________________________________________________________________________
activation_63 (Activation)      (None, 28, 28, 44)   0           adjust_bn_3[0][0]                
__________________________________________________________________________________________________
activation_65 (Activation)      (None, 28, 28, 44)   0           adjust_bn_3[0][0]                
__________________________________________________________________________________________________
activation_67 (Activation)      (None, 28, 28, 44)   0           normal_bn_1_3[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_3 (None, 28, 28, 44)   3036        activation_59[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 28, 28, 44)   2332        activation_61[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_3 (None, 28, 28, 44)   3036        activation_63[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 28, 28, 44)   2332        activation_65[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left5_3 (None, 28, 28, 44)   2332        activation_67[0][0]              
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left1_3[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right1_3[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left2_3[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_1_normal_right2_3[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 28, 28, 44)   176         separable_conv_1_normal_left5_3[0
__________________________________________________________________________________________________
activation_60 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_62 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_64 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_66 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_68 (Activation)      (None, 28, 28, 44)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_3 (None, 28, 28, 44)   3036        activation_60[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 28, 28, 44)   2332        activation_62[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_3 (None, 28, 28, 44)   3036        activation_64[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 28, 28, 44)   2332        activation_66[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left5_3 (None, 28, 28, 44)   2332        activation_68[0][0]              
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left1_3[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right1_3[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left2_3[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 28, 28, 44)   176         separable_conv_2_normal_right2_3[
__________________________________________________________________________________________________
normal_left3_3 (AveragePooling2 (None, 28, 28, 44)   0           normal_bn_1_3[0][0]              
__________________________________________________________________________________________________
normal_left4_3 (AveragePooling2 (None, 28, 28, 44)   0           adjust_bn_3[0][0]                
__________________________________________________________________________________________________
normal_right4_3 (AveragePooling (None, 28, 28, 44)   0           adjust_bn_3[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 28, 28, 44)   176         separable_conv_2_normal_left5_3[0
__________________________________________________________________________________________________
normal_add_1_3 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_3 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_3 (Add)            (None, 28, 28, 44)   0           normal_left3_3[0][0]             
                                                                 adjust_bn_3[0][0]                
__________________________________________________________________________________________________
normal_add_4_3 (Add)            (None, 28, 28, 44)   0           normal_left4_3[0][0]             
                                                                 normal_right4_3[0][0]            
__________________________________________________________________________________________________
normal_add_5_3 (Add)            (None, 28, 28, 44)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_3[0][0]              
__________________________________________________________________________________________________
normal_concat_3 (Concatenate)   (None, 28, 28, 264)  0           adjust_bn_3[0][0]                
                                                                 normal_add_1_3[0][0]             
                                                                 normal_add_2_3[0][0]             
                                                                 normal_add_3_3[0][0]             
                                                                 normal_add_4_3[0][0]             
                                                                 normal_add_5_3[0][0]             
__________________________________________________________________________________________________
activation_70 (Activation)      (None, 28, 28, 264)  0           normal_concat_3[0][0]            
__________________________________________________________________________________________________
activation_69 (Activation)      (None, 28, 28, 264)  0           normal_concat_2[0][0]            
__________________________________________________________________________________________________
reduction_conv_1_reduce_4 (Conv (None, 28, 28, 88)   23232       activation_70[0][0]              
__________________________________________________________________________________________________
adjust_conv_projection_reduce_4 (None, 28, 28, 88)   23232       activation_69[0][0]              
__________________________________________________________________________________________________
reduction_bn_1_reduce_4 (BatchN (None, 28, 28, 88)   352         reduction_conv_1_reduce_4[0][0]  
__________________________________________________________________________________________________
adjust_bn_reduce_4 (BatchNormal (None, 28, 28, 88)   352         adjust_conv_projection_reduce_4[0
__________________________________________________________________________________________________
activation_71 (Activation)      (None, 28, 28, 88)   0           reduction_bn_1_reduce_4[0][0]    
__________________________________________________________________________________________________
activation_73 (Activation)      (None, 28, 28, 88)   0           adjust_bn_reduce_4[0][0]         
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 31, 31, 88)   0           activation_71[0][0]              
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 33, 33, 88)   0           activation_73[0][0]              
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 14, 14, 88)   9944        separable_conv_1_pad_reduction_le
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 14, 14, 88)   12056       separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 14, 14, 88)   352         separable_conv_1_reduction_left1_
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_1_reduction_right1
__________________________________________________________________________________________________
activation_72 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
activation_74 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 14, 14, 88)   9944        activation_72[0][0]              
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 14, 14, 88)   12056       activation_74[0][0]              
__________________________________________________________________________________________________
activation_75 (Activation)      (None, 28, 28, 88)   0           adjust_bn_reduce_4[0][0]         
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 14, 14, 88)   352         separable_conv_2_reduction_left1_
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_2_reduction_right1
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 33, 33, 88)   0           activation_75[0][0]              
__________________________________________________________________________________________________
activation_77 (Activation)      (None, 28, 28, 88)   0           adjust_bn_reduce_4[0][0]         
__________________________________________________________________________________________________
reduction_add_1_reduce_4 (Add)  (None, 14, 14, 88)   0           separable_conv_2_bn_reduction_lef
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 14, 14, 88)   12056       separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 31, 31, 88)   0           activation_77[0][0]              
__________________________________________________________________________________________________
activation_79 (Activation)      (None, 14, 14, 88)   0           reduction_add_1_reduce_4[0][0]   
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_1_reduction_right2
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 14, 14, 88)   9944        separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 14, 14, 88)   8536        activation_79[0][0]              
__________________________________________________________________________________________________
activation_76 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_1_reduction_right3
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 14, 14, 88)   352         separable_conv_1_reduction_left4_
__________________________________________________________________________________________________
reduction_pad_1_reduce_4 (ZeroP (None, 29, 29, 88)   0           reduction_bn_1_reduce_4[0][0]    
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 14, 14, 88)   12056       activation_76[0][0]              
__________________________________________________________________________________________________
activation_78 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
activation_80 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
reduction_left2_reduce_4 (MaxPo (None, 14, 14, 88)   0           reduction_pad_1_reduce_4[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_2_reduction_right2
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 14, 14, 88)   9944        activation_78[0][0]              
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 14, 14, 88)   8536        activation_80[0][0]              
__________________________________________________________________________________________________
adjust_relu_1_5 (Activation)    (None, 28, 28, 264)  0           normal_concat_3[0][0]            
__________________________________________________________________________________________________
reduction_add_2_reduce_4 (Add)  (None, 14, 14, 88)   0           reduction_left2_reduce_4[0][0]   
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
reduction_left3_reduce_4 (Avera (None, 14, 14, 88)   0           reduction_pad_1_reduce_4[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 14, 14, 88)   352         separable_conv_2_reduction_right3
__________________________________________________________________________________________________
reduction_left4_reduce_4 (Avera (None, 14, 14, 88)   0           reduction_add_1_reduce_4[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 14, 14, 88)   352         separable_conv_2_reduction_left4_
__________________________________________________________________________________________________
reduction_right5_reduce_4 (MaxP (None, 14, 14, 88)   0           reduction_pad_1_reduce_4[0][0]   
__________________________________________________________________________________________________
zero_padding2d_2 (ZeroPadding2D (None, 29, 29, 264)  0           adjust_relu_1_5[0][0]            
__________________________________________________________________________________________________
reduction_add3_reduce_4 (Add)   (None, 14, 14, 88)   0           reduction_left3_reduce_4[0][0]   
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
add_2 (Add)                     (None, 14, 14, 88)   0           reduction_add_2_reduce_4[0][0]   
                                                                 reduction_left4_reduce_4[0][0]   
__________________________________________________________________________________________________
reduction_add4_reduce_4 (Add)   (None, 14, 14, 88)   0           separable_conv_2_bn_reduction_lef
                                                                 reduction_right5_reduce_4[0][0]  
__________________________________________________________________________________________________
cropping2d_2 (Cropping2D)       (None, 28, 28, 264)  0           zero_padding2d_2[0][0]           
__________________________________________________________________________________________________
reduction_concat_reduce_4 (Conc (None, 14, 14, 352)  0           reduction_add_2_reduce_4[0][0]   
                                                                 reduction_add3_reduce_4[0][0]    
                                                                 add_2[0][0]                      
                                                                 reduction_add4_reduce_4[0][0]    
__________________________________________________________________________________________________
adjust_avg_pool_1_5 (AveragePoo (None, 14, 14, 264)  0           adjust_relu_1_5[0][0]            
__________________________________________________________________________________________________
adjust_avg_pool_2_5 (AveragePoo (None, 14, 14, 264)  0           cropping2d_2[0][0]               
__________________________________________________________________________________________________
adjust_conv_1_5 (Conv2D)        (None, 14, 14, 44)   11616       adjust_avg_pool_1_5[0][0]        
__________________________________________________________________________________________________
adjust_conv_2_5 (Conv2D)        (None, 14, 14, 44)   11616       adjust_avg_pool_2_5[0][0]        
__________________________________________________________________________________________________
activation_81 (Activation)      (None, 14, 14, 352)  0           reduction_concat_reduce_4[0][0]  
__________________________________________________________________________________________________
concatenate_2 (Concatenate)     (None, 14, 14, 88)   0           adjust_conv_1_5[0][0]            
                                                                 adjust_conv_2_5[0][0]            
__________________________________________________________________________________________________
normal_conv_1_5 (Conv2D)        (None, 14, 14, 88)   30976       activation_81[0][0]              
__________________________________________________________________________________________________
adjust_bn_5 (BatchNormalization (None, 14, 14, 88)   352         concatenate_2[0][0]              
__________________________________________________________________________________________________
normal_bn_1_5 (BatchNormalizati (None, 14, 14, 88)   352         normal_conv_1_5[0][0]            
__________________________________________________________________________________________________
activation_82 (Activation)      (None, 14, 14, 88)   0           normal_bn_1_5[0][0]              
__________________________________________________________________________________________________
activation_84 (Activation)      (None, 14, 14, 88)   0           adjust_bn_5[0][0]                
__________________________________________________________________________________________________
activation_86 (Activation)      (None, 14, 14, 88)   0           adjust_bn_5[0][0]                
__________________________________________________________________________________________________
activation_88 (Activation)      (None, 14, 14, 88)   0           adjust_bn_5[0][0]                
__________________________________________________________________________________________________
activation_90 (Activation)      (None, 14, 14, 88)   0           normal_bn_1_5[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_5 (None, 14, 14, 88)   9944        activation_82[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 14, 14, 88)   8536        activation_84[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_5 (None, 14, 14, 88)   9944        activation_86[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 14, 14, 88)   8536        activation_88[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left5_5 (None, 14, 14, 88)   8536        activation_90[0][0]              
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left1_5[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right1_5[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left2_5[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right2_5[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left5_5[0
__________________________________________________________________________________________________
activation_83 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_85 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_87 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_89 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_91 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_5 (None, 14, 14, 88)   9944        activation_83[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 14, 14, 88)   8536        activation_85[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_5 (None, 14, 14, 88)   9944        activation_87[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 14, 14, 88)   8536        activation_89[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left5_5 (None, 14, 14, 88)   8536        activation_91[0][0]              
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left1_5[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right1_5[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left2_5[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right2_5[
__________________________________________________________________________________________________
normal_left3_5 (AveragePooling2 (None, 14, 14, 88)   0           normal_bn_1_5[0][0]              
__________________________________________________________________________________________________
normal_left4_5 (AveragePooling2 (None, 14, 14, 88)   0           adjust_bn_5[0][0]                
__________________________________________________________________________________________________
normal_right4_5 (AveragePooling (None, 14, 14, 88)   0           adjust_bn_5[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left5_5[0
__________________________________________________________________________________________________
normal_add_1_5 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_5 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_5 (Add)            (None, 14, 14, 88)   0           normal_left3_5[0][0]             
                                                                 adjust_bn_5[0][0]                
__________________________________________________________________________________________________
normal_add_4_5 (Add)            (None, 14, 14, 88)   0           normal_left4_5[0][0]             
                                                                 normal_right4_5[0][0]            
__________________________________________________________________________________________________
normal_add_5_5 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_5[0][0]              
__________________________________________________________________________________________________
normal_concat_5 (Concatenate)   (None, 14, 14, 528)  0           adjust_bn_5[0][0]                
                                                                 normal_add_1_5[0][0]             
                                                                 normal_add_2_5[0][0]             
                                                                 normal_add_3_5[0][0]             
                                                                 normal_add_4_5[0][0]             
                                                                 normal_add_5_5[0][0]             
__________________________________________________________________________________________________
activation_92 (Activation)      (None, 14, 14, 352)  0           reduction_concat_reduce_4[0][0]  
__________________________________________________________________________________________________
activation_93 (Activation)      (None, 14, 14, 528)  0           normal_concat_5[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_6 (Conv2 (None, 14, 14, 88)   30976       activation_92[0][0]              
__________________________________________________________________________________________________
normal_conv_1_6 (Conv2D)        (None, 14, 14, 88)   46464       activation_93[0][0]              
__________________________________________________________________________________________________
adjust_bn_6 (BatchNormalization (None, 14, 14, 88)   352         adjust_conv_projection_6[0][0]   
__________________________________________________________________________________________________
normal_bn_1_6 (BatchNormalizati (None, 14, 14, 88)   352         normal_conv_1_6[0][0]            
__________________________________________________________________________________________________
activation_94 (Activation)      (None, 14, 14, 88)   0           normal_bn_1_6[0][0]              
__________________________________________________________________________________________________
activation_96 (Activation)      (None, 14, 14, 88)   0           adjust_bn_6[0][0]                
__________________________________________________________________________________________________
activation_98 (Activation)      (None, 14, 14, 88)   0           adjust_bn_6[0][0]                
__________________________________________________________________________________________________
activation_100 (Activation)     (None, 14, 14, 88)   0           adjust_bn_6[0][0]                
__________________________________________________________________________________________________
activation_102 (Activation)     (None, 14, 14, 88)   0           normal_bn_1_6[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_6 (None, 14, 14, 88)   9944        activation_94[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 14, 14, 88)   8536        activation_96[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left2_6 (None, 14, 14, 88)   9944        activation_98[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 14, 14, 88)   8536        activation_100[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_6 (None, 14, 14, 88)   8536        activation_102[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left1_6[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right1_6[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left2_6[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right2_6[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left5_6[0
__________________________________________________________________________________________________
activation_95 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_97 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_99 (Activation)      (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_101 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_103 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_6 (None, 14, 14, 88)   9944        activation_95[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 14, 14, 88)   8536        activation_97[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_left2_6 (None, 14, 14, 88)   9944        activation_99[0][0]              
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 14, 14, 88)   8536        activation_101[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_6 (None, 14, 14, 88)   8536        activation_103[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left1_6[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right1_6[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left2_6[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right2_6[
__________________________________________________________________________________________________
normal_left3_6 (AveragePooling2 (None, 14, 14, 88)   0           normal_bn_1_6[0][0]              
__________________________________________________________________________________________________
normal_left4_6 (AveragePooling2 (None, 14, 14, 88)   0           adjust_bn_6[0][0]                
__________________________________________________________________________________________________
normal_right4_6 (AveragePooling (None, 14, 14, 88)   0           adjust_bn_6[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left5_6[0
__________________________________________________________________________________________________
normal_add_1_6 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_6 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_6 (Add)            (None, 14, 14, 88)   0           normal_left3_6[0][0]             
                                                                 adjust_bn_6[0][0]                
__________________________________________________________________________________________________
normal_add_4_6 (Add)            (None, 14, 14, 88)   0           normal_left4_6[0][0]             
                                                                 normal_right4_6[0][0]            
__________________________________________________________________________________________________
normal_add_5_6 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_6[0][0]              
__________________________________________________________________________________________________
normal_concat_6 (Concatenate)   (None, 14, 14, 528)  0           adjust_bn_6[0][0]                
                                                                 normal_add_1_6[0][0]             
                                                                 normal_add_2_6[0][0]             
                                                                 normal_add_3_6[0][0]             
                                                                 normal_add_4_6[0][0]             
                                                                 normal_add_5_6[0][0]             
__________________________________________________________________________________________________
activation_104 (Activation)     (None, 14, 14, 528)  0           normal_concat_5[0][0]            
__________________________________________________________________________________________________
activation_105 (Activation)     (None, 14, 14, 528)  0           normal_concat_6[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_7 (Conv2 (None, 14, 14, 88)   46464       activation_104[0][0]             
__________________________________________________________________________________________________
normal_conv_1_7 (Conv2D)        (None, 14, 14, 88)   46464       activation_105[0][0]             
__________________________________________________________________________________________________
adjust_bn_7 (BatchNormalization (None, 14, 14, 88)   352         adjust_conv_projection_7[0][0]   
__________________________________________________________________________________________________
normal_bn_1_7 (BatchNormalizati (None, 14, 14, 88)   352         normal_conv_1_7[0][0]            
__________________________________________________________________________________________________
activation_106 (Activation)     (None, 14, 14, 88)   0           normal_bn_1_7[0][0]              
__________________________________________________________________________________________________
activation_108 (Activation)     (None, 14, 14, 88)   0           adjust_bn_7[0][0]                
__________________________________________________________________________________________________
activation_110 (Activation)     (None, 14, 14, 88)   0           adjust_bn_7[0][0]                
__________________________________________________________________________________________________
activation_112 (Activation)     (None, 14, 14, 88)   0           adjust_bn_7[0][0]                
__________________________________________________________________________________________________
activation_114 (Activation)     (None, 14, 14, 88)   0           normal_bn_1_7[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_7 (None, 14, 14, 88)   9944        activation_106[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 14, 14, 88)   8536        activation_108[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_7 (None, 14, 14, 88)   9944        activation_110[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 14, 14, 88)   8536        activation_112[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_7 (None, 14, 14, 88)   8536        activation_114[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left1_7[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right1_7[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left2_7[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right2_7[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left5_7[0
__________________________________________________________________________________________________
activation_107 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_109 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_111 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_113 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_115 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_7 (None, 14, 14, 88)   9944        activation_107[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 14, 14, 88)   8536        activation_109[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_7 (None, 14, 14, 88)   9944        activation_111[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 14, 14, 88)   8536        activation_113[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_7 (None, 14, 14, 88)   8536        activation_115[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left1_7[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right1_7[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left2_7[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right2_7[
__________________________________________________________________________________________________
normal_left3_7 (AveragePooling2 (None, 14, 14, 88)   0           normal_bn_1_7[0][0]              
__________________________________________________________________________________________________
normal_left4_7 (AveragePooling2 (None, 14, 14, 88)   0           adjust_bn_7[0][0]                
__________________________________________________________________________________________________
normal_right4_7 (AveragePooling (None, 14, 14, 88)   0           adjust_bn_7[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left5_7[0
__________________________________________________________________________________________________
normal_add_1_7 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_7 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_7 (Add)            (None, 14, 14, 88)   0           normal_left3_7[0][0]             
                                                                 adjust_bn_7[0][0]                
__________________________________________________________________________________________________
normal_add_4_7 (Add)            (None, 14, 14, 88)   0           normal_left4_7[0][0]             
                                                                 normal_right4_7[0][0]            
__________________________________________________________________________________________________
normal_add_5_7 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_7[0][0]              
__________________________________________________________________________________________________
normal_concat_7 (Concatenate)   (None, 14, 14, 528)  0           adjust_bn_7[0][0]                
                                                                 normal_add_1_7[0][0]             
                                                                 normal_add_2_7[0][0]             
                                                                 normal_add_3_7[0][0]             
                                                                 normal_add_4_7[0][0]             
                                                                 normal_add_5_7[0][0]             
__________________________________________________________________________________________________
activation_116 (Activation)     (None, 14, 14, 528)  0           normal_concat_6[0][0]            
__________________________________________________________________________________________________
activation_117 (Activation)     (None, 14, 14, 528)  0           normal_concat_7[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_8 (Conv2 (None, 14, 14, 88)   46464       activation_116[0][0]             
__________________________________________________________________________________________________
normal_conv_1_8 (Conv2D)        (None, 14, 14, 88)   46464       activation_117[0][0]             
__________________________________________________________________________________________________
adjust_bn_8 (BatchNormalization (None, 14, 14, 88)   352         adjust_conv_projection_8[0][0]   
__________________________________________________________________________________________________
normal_bn_1_8 (BatchNormalizati (None, 14, 14, 88)   352         normal_conv_1_8[0][0]            
__________________________________________________________________________________________________
activation_118 (Activation)     (None, 14, 14, 88)   0           normal_bn_1_8[0][0]              
__________________________________________________________________________________________________
activation_120 (Activation)     (None, 14, 14, 88)   0           adjust_bn_8[0][0]                
__________________________________________________________________________________________________
activation_122 (Activation)     (None, 14, 14, 88)   0           adjust_bn_8[0][0]                
__________________________________________________________________________________________________
activation_124 (Activation)     (None, 14, 14, 88)   0           adjust_bn_8[0][0]                
__________________________________________________________________________________________________
activation_126 (Activation)     (None, 14, 14, 88)   0           normal_bn_1_8[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_8 (None, 14, 14, 88)   9944        activation_118[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 14, 14, 88)   8536        activation_120[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_8 (None, 14, 14, 88)   9944        activation_122[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 14, 14, 88)   8536        activation_124[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_8 (None, 14, 14, 88)   8536        activation_126[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left1_8[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right1_8[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left2_8[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_1_normal_right2_8[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 14, 14, 88)   352         separable_conv_1_normal_left5_8[0
__________________________________________________________________________________________________
activation_119 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_121 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_123 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_125 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_127 (Activation)     (None, 14, 14, 88)   0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_8 (None, 14, 14, 88)   9944        activation_119[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 14, 14, 88)   8536        activation_121[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_8 (None, 14, 14, 88)   9944        activation_123[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 14, 14, 88)   8536        activation_125[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_8 (None, 14, 14, 88)   8536        activation_127[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left1_8[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right1_8[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left2_8[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 14, 14, 88)   352         separable_conv_2_normal_right2_8[
__________________________________________________________________________________________________
normal_left3_8 (AveragePooling2 (None, 14, 14, 88)   0           normal_bn_1_8[0][0]              
__________________________________________________________________________________________________
normal_left4_8 (AveragePooling2 (None, 14, 14, 88)   0           adjust_bn_8[0][0]                
__________________________________________________________________________________________________
normal_right4_8 (AveragePooling (None, 14, 14, 88)   0           adjust_bn_8[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 14, 14, 88)   352         separable_conv_2_normal_left5_8[0
__________________________________________________________________________________________________
normal_add_1_8 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_8 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_8 (Add)            (None, 14, 14, 88)   0           normal_left3_8[0][0]             
                                                                 adjust_bn_8[0][0]                
__________________________________________________________________________________________________
normal_add_4_8 (Add)            (None, 14, 14, 88)   0           normal_left4_8[0][0]             
                                                                 normal_right4_8[0][0]            
__________________________________________________________________________________________________
normal_add_5_8 (Add)            (None, 14, 14, 88)   0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_8[0][0]              
__________________________________________________________________________________________________
normal_concat_8 (Concatenate)   (None, 14, 14, 528)  0           adjust_bn_8[0][0]                
                                                                 normal_add_1_8[0][0]             
                                                                 normal_add_2_8[0][0]             
                                                                 normal_add_3_8[0][0]             
                                                                 normal_add_4_8[0][0]             
                                                                 normal_add_5_8[0][0]             
__________________________________________________________________________________________________
activation_129 (Activation)     (None, 14, 14, 528)  0           normal_concat_8[0][0]            
__________________________________________________________________________________________________
activation_128 (Activation)     (None, 14, 14, 528)  0           normal_concat_7[0][0]            
__________________________________________________________________________________________________
reduction_conv_1_reduce_8 (Conv (None, 14, 14, 176)  92928       activation_129[0][0]             
__________________________________________________________________________________________________
adjust_conv_projection_reduce_8 (None, 14, 14, 176)  92928       activation_128[0][0]             
__________________________________________________________________________________________________
reduction_bn_1_reduce_8 (BatchN (None, 14, 14, 176)  704         reduction_conv_1_reduce_8[0][0]  
__________________________________________________________________________________________________
adjust_bn_reduce_8 (BatchNormal (None, 14, 14, 176)  704         adjust_conv_projection_reduce_8[0
__________________________________________________________________________________________________
activation_130 (Activation)     (None, 14, 14, 176)  0           reduction_bn_1_reduce_8[0][0]    
__________________________________________________________________________________________________
activation_132 (Activation)     (None, 14, 14, 176)  0           adjust_bn_reduce_8[0][0]         
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 17, 17, 176)  0           activation_130[0][0]             
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 19, 19, 176)  0           activation_132[0][0]             
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 7, 7, 176)    35376       separable_conv_1_pad_reduction_le
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 7, 7, 176)    39600       separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 7, 7, 176)    704         separable_conv_1_reduction_left1_
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_1_reduction_right1
__________________________________________________________________________________________________
activation_131 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
activation_133 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 7, 7, 176)    35376       activation_131[0][0]             
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 7, 7, 176)    39600       activation_133[0][0]             
__________________________________________________________________________________________________
activation_134 (Activation)     (None, 14, 14, 176)  0           adjust_bn_reduce_8[0][0]         
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 7, 7, 176)    704         separable_conv_2_reduction_left1_
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_2_reduction_right1
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 19, 19, 176)  0           activation_134[0][0]             
__________________________________________________________________________________________________
activation_136 (Activation)     (None, 14, 14, 176)  0           adjust_bn_reduce_8[0][0]         
__________________________________________________________________________________________________
reduction_add_1_reduce_8 (Add)  (None, 7, 7, 176)    0           separable_conv_2_bn_reduction_lef
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 7, 7, 176)    39600       separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_pad_reduction_ (None, 17, 17, 176)  0           activation_136[0][0]             
__________________________________________________________________________________________________
activation_138 (Activation)     (None, 7, 7, 176)    0           reduction_add_1_reduce_8[0][0]   
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_1_reduction_right2
__________________________________________________________________________________________________
separable_conv_1_reduction_righ (None, 7, 7, 176)    35376       separable_conv_1_pad_reduction_ri
__________________________________________________________________________________________________
separable_conv_1_reduction_left (None, 7, 7, 176)    32560       activation_138[0][0]             
__________________________________________________________________________________________________
activation_135 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_1_reduction_right3
__________________________________________________________________________________________________
separable_conv_1_bn_reduction_l (None, 7, 7, 176)    704         separable_conv_1_reduction_left4_
__________________________________________________________________________________________________
reduction_pad_1_reduce_8 (ZeroP (None, 15, 15, 176)  0           reduction_bn_1_reduce_8[0][0]    
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 7, 7, 176)    39600       activation_135[0][0]             
__________________________________________________________________________________________________
activation_137 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_reduction_rig
__________________________________________________________________________________________________
activation_139 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_reduction_lef
__________________________________________________________________________________________________
reduction_left2_reduce_8 (MaxPo (None, 7, 7, 176)    0           reduction_pad_1_reduce_8[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_2_reduction_right2
__________________________________________________________________________________________________
separable_conv_2_reduction_righ (None, 7, 7, 176)    35376       activation_137[0][0]             
__________________________________________________________________________________________________
separable_conv_2_reduction_left (None, 7, 7, 176)    32560       activation_139[0][0]             
__________________________________________________________________________________________________
adjust_relu_1_9 (Activation)    (None, 14, 14, 528)  0           normal_concat_8[0][0]            
__________________________________________________________________________________________________
reduction_add_2_reduce_8 (Add)  (None, 7, 7, 176)    0           reduction_left2_reduce_8[0][0]   
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
reduction_left3_reduce_8 (Avera (None, 7, 7, 176)    0           reduction_pad_1_reduce_8[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_r (None, 7, 7, 176)    704         separable_conv_2_reduction_right3
__________________________________________________________________________________________________
reduction_left4_reduce_8 (Avera (None, 7, 7, 176)    0           reduction_add_1_reduce_8[0][0]   
__________________________________________________________________________________________________
separable_conv_2_bn_reduction_l (None, 7, 7, 176)    704         separable_conv_2_reduction_left4_
__________________________________________________________________________________________________
reduction_right5_reduce_8 (MaxP (None, 7, 7, 176)    0           reduction_pad_1_reduce_8[0][0]   
__________________________________________________________________________________________________
zero_padding2d_3 (ZeroPadding2D (None, 15, 15, 528)  0           adjust_relu_1_9[0][0]            
__________________________________________________________________________________________________
reduction_add3_reduce_8 (Add)   (None, 7, 7, 176)    0           reduction_left3_reduce_8[0][0]   
                                                                 separable_conv_2_bn_reduction_rig
__________________________________________________________________________________________________
add_3 (Add)                     (None, 7, 7, 176)    0           reduction_add_2_reduce_8[0][0]   
                                                                 reduction_left4_reduce_8[0][0]   
__________________________________________________________________________________________________
reduction_add4_reduce_8 (Add)   (None, 7, 7, 176)    0           separable_conv_2_bn_reduction_lef
                                                                 reduction_right5_reduce_8[0][0]  
__________________________________________________________________________________________________
cropping2d_3 (Cropping2D)       (None, 14, 14, 528)  0           zero_padding2d_3[0][0]           
__________________________________________________________________________________________________
reduction_concat_reduce_8 (Conc (None, 7, 7, 704)    0           reduction_add_2_reduce_8[0][0]   
                                                                 reduction_add3_reduce_8[0][0]    
                                                                 add_3[0][0]                      
                                                                 reduction_add4_reduce_8[0][0]    
__________________________________________________________________________________________________
adjust_avg_pool_1_9 (AveragePoo (None, 7, 7, 528)    0           adjust_relu_1_9[0][0]            
__________________________________________________________________________________________________
adjust_avg_pool_2_9 (AveragePoo (None, 7, 7, 528)    0           cropping2d_3[0][0]               
__________________________________________________________________________________________________
adjust_conv_1_9 (Conv2D)        (None, 7, 7, 88)     46464       adjust_avg_pool_1_9[0][0]        
__________________________________________________________________________________________________
adjust_conv_2_9 (Conv2D)        (None, 7, 7, 88)     46464       adjust_avg_pool_2_9[0][0]        
__________________________________________________________________________________________________
activation_140 (Activation)     (None, 7, 7, 704)    0           reduction_concat_reduce_8[0][0]  
__________________________________________________________________________________________________
concatenate_3 (Concatenate)     (None, 7, 7, 176)    0           adjust_conv_1_9[0][0]            
                                                                 adjust_conv_2_9[0][0]            
__________________________________________________________________________________________________
normal_conv_1_9 (Conv2D)        (None, 7, 7, 176)    123904      activation_140[0][0]             
__________________________________________________________________________________________________
adjust_bn_9 (BatchNormalization (None, 7, 7, 176)    704         concatenate_3[0][0]              
__________________________________________________________________________________________________
normal_bn_1_9 (BatchNormalizati (None, 7, 7, 176)    704         normal_conv_1_9[0][0]            
__________________________________________________________________________________________________
activation_141 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_9[0][0]              
__________________________________________________________________________________________________
activation_143 (Activation)     (None, 7, 7, 176)    0           adjust_bn_9[0][0]                
__________________________________________________________________________________________________
activation_145 (Activation)     (None, 7, 7, 176)    0           adjust_bn_9[0][0]                
__________________________________________________________________________________________________
activation_147 (Activation)     (None, 7, 7, 176)    0           adjust_bn_9[0][0]                
__________________________________________________________________________________________________
activation_149 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_9[0][0]              
__________________________________________________________________________________________________
separable_conv_1_normal_left1_9 (None, 7, 7, 176)    35376       activation_141[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 7, 7, 176)    32560       activation_143[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_9 (None, 7, 7, 176)    35376       activation_145[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 7, 7, 176)    32560       activation_147[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_9 (None, 7, 7, 176)    32560       activation_149[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left1_9[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right1_9[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left2_9[0
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right2_9[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left5_9[0
__________________________________________________________________________________________________
activation_142 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_144 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_146 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_148 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_150 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_9 (None, 7, 7, 176)    35376       activation_142[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 7, 7, 176)    32560       activation_144[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_9 (None, 7, 7, 176)    35376       activation_146[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 7, 7, 176)    32560       activation_148[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_9 (None, 7, 7, 176)    32560       activation_150[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left1_9[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right1_9[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left2_9[0
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right2_9[
__________________________________________________________________________________________________
normal_left3_9 (AveragePooling2 (None, 7, 7, 176)    0           normal_bn_1_9[0][0]              
__________________________________________________________________________________________________
normal_left4_9 (AveragePooling2 (None, 7, 7, 176)    0           adjust_bn_9[0][0]                
__________________________________________________________________________________________________
normal_right4_9 (AveragePooling (None, 7, 7, 176)    0           adjust_bn_9[0][0]                
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left5_9[0
__________________________________________________________________________________________________
normal_add_1_9 (Add)            (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_9 (Add)            (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_9 (Add)            (None, 7, 7, 176)    0           normal_left3_9[0][0]             
                                                                 adjust_bn_9[0][0]                
__________________________________________________________________________________________________
normal_add_4_9 (Add)            (None, 7, 7, 176)    0           normal_left4_9[0][0]             
                                                                 normal_right4_9[0][0]            
__________________________________________________________________________________________________
normal_add_5_9 (Add)            (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_9[0][0]              
__________________________________________________________________________________________________
normal_concat_9 (Concatenate)   (None, 7, 7, 1056)   0           adjust_bn_9[0][0]                
                                                                 normal_add_1_9[0][0]             
                                                                 normal_add_2_9[0][0]             
                                                                 normal_add_3_9[0][0]             
                                                                 normal_add_4_9[0][0]             
                                                                 normal_add_5_9[0][0]             
__________________________________________________________________________________________________
activation_151 (Activation)     (None, 7, 7, 704)    0           reduction_concat_reduce_8[0][0]  
__________________________________________________________________________________________________
activation_152 (Activation)     (None, 7, 7, 1056)   0           normal_concat_9[0][0]            
__________________________________________________________________________________________________
adjust_conv_projection_10 (Conv (None, 7, 7, 176)    123904      activation_151[0][0]             
__________________________________________________________________________________________________
normal_conv_1_10 (Conv2D)       (None, 7, 7, 176)    185856      activation_152[0][0]             
__________________________________________________________________________________________________
adjust_bn_10 (BatchNormalizatio (None, 7, 7, 176)    704         adjust_conv_projection_10[0][0]  
__________________________________________________________________________________________________
normal_bn_1_10 (BatchNormalizat (None, 7, 7, 176)    704         normal_conv_1_10[0][0]           
__________________________________________________________________________________________________
activation_153 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_10[0][0]             
__________________________________________________________________________________________________
activation_155 (Activation)     (None, 7, 7, 176)    0           adjust_bn_10[0][0]               
__________________________________________________________________________________________________
activation_157 (Activation)     (None, 7, 7, 176)    0           adjust_bn_10[0][0]               
__________________________________________________________________________________________________
activation_159 (Activation)     (None, 7, 7, 176)    0           adjust_bn_10[0][0]               
__________________________________________________________________________________________________
activation_161 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_10[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left1_1 (None, 7, 7, 176)    35376       activation_153[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 7, 7, 176)    32560       activation_155[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_1 (None, 7, 7, 176)    35376       activation_157[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 7, 7, 176)    32560       activation_159[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_1 (None, 7, 7, 176)    32560       activation_161[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left1_10[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right1_10
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left2_10[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right2_10
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left5_10[
__________________________________________________________________________________________________
activation_154 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_156 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_158 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_160 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_162 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_1 (None, 7, 7, 176)    35376       activation_154[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 7, 7, 176)    32560       activation_156[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_1 (None, 7, 7, 176)    35376       activation_158[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 7, 7, 176)    32560       activation_160[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_1 (None, 7, 7, 176)    32560       activation_162[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left1_10[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right1_10
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left2_10[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right2_10
__________________________________________________________________________________________________
normal_left3_10 (AveragePooling (None, 7, 7, 176)    0           normal_bn_1_10[0][0]             
__________________________________________________________________________________________________
normal_left4_10 (AveragePooling (None, 7, 7, 176)    0           adjust_bn_10[0][0]               
__________________________________________________________________________________________________
normal_right4_10 (AveragePoolin (None, 7, 7, 176)    0           adjust_bn_10[0][0]               
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left5_10[
__________________________________________________________________________________________________
normal_add_1_10 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_10 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_10 (Add)           (None, 7, 7, 176)    0           normal_left3_10[0][0]            
                                                                 adjust_bn_10[0][0]               
__________________________________________________________________________________________________
normal_add_4_10 (Add)           (None, 7, 7, 176)    0           normal_left4_10[0][0]            
                                                                 normal_right4_10[0][0]           
__________________________________________________________________________________________________
normal_add_5_10 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_10[0][0]             
__________________________________________________________________________________________________
normal_concat_10 (Concatenate)  (None, 7, 7, 1056)   0           adjust_bn_10[0][0]               
                                                                 normal_add_1_10[0][0]            
                                                                 normal_add_2_10[0][0]            
                                                                 normal_add_3_10[0][0]            
                                                                 normal_add_4_10[0][0]            
                                                                 normal_add_5_10[0][0]            
__________________________________________________________________________________________________
activation_163 (Activation)     (None, 7, 7, 1056)   0           normal_concat_9[0][0]            
__________________________________________________________________________________________________
activation_164 (Activation)     (None, 7, 7, 1056)   0           normal_concat_10[0][0]           
__________________________________________________________________________________________________
adjust_conv_projection_11 (Conv (None, 7, 7, 176)    185856      activation_163[0][0]             
__________________________________________________________________________________________________
normal_conv_1_11 (Conv2D)       (None, 7, 7, 176)    185856      activation_164[0][0]             
__________________________________________________________________________________________________
adjust_bn_11 (BatchNormalizatio (None, 7, 7, 176)    704         adjust_conv_projection_11[0][0]  
__________________________________________________________________________________________________
normal_bn_1_11 (BatchNormalizat (None, 7, 7, 176)    704         normal_conv_1_11[0][0]           
__________________________________________________________________________________________________
activation_165 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_11[0][0]             
__________________________________________________________________________________________________
activation_167 (Activation)     (None, 7, 7, 176)    0           adjust_bn_11[0][0]               
__________________________________________________________________________________________________
activation_169 (Activation)     (None, 7, 7, 176)    0           adjust_bn_11[0][0]               
__________________________________________________________________________________________________
activation_171 (Activation)     (None, 7, 7, 176)    0           adjust_bn_11[0][0]               
__________________________________________________________________________________________________
activation_173 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_11[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left1_1 (None, 7, 7, 176)    35376       activation_165[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 7, 7, 176)    32560       activation_167[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_1 (None, 7, 7, 176)    35376       activation_169[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 7, 7, 176)    32560       activation_171[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_1 (None, 7, 7, 176)    32560       activation_173[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left1_11[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right1_11
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left2_11[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right2_11
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left5_11[
__________________________________________________________________________________________________
activation_166 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_168 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_170 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_172 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_174 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_1 (None, 7, 7, 176)    35376       activation_166[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 7, 7, 176)    32560       activation_168[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_1 (None, 7, 7, 176)    35376       activation_170[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 7, 7, 176)    32560       activation_172[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_1 (None, 7, 7, 176)    32560       activation_174[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left1_11[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right1_11
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left2_11[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right2_11
__________________________________________________________________________________________________
normal_left3_11 (AveragePooling (None, 7, 7, 176)    0           normal_bn_1_11[0][0]             
__________________________________________________________________________________________________
normal_left4_11 (AveragePooling (None, 7, 7, 176)    0           adjust_bn_11[0][0]               
__________________________________________________________________________________________________
normal_right4_11 (AveragePoolin (None, 7, 7, 176)    0           adjust_bn_11[0][0]               
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left5_11[
__________________________________________________________________________________________________
normal_add_1_11 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_11 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_11 (Add)           (None, 7, 7, 176)    0           normal_left3_11[0][0]            
                                                                 adjust_bn_11[0][0]               
__________________________________________________________________________________________________
normal_add_4_11 (Add)           (None, 7, 7, 176)    0           normal_left4_11[0][0]            
                                                                 normal_right4_11[0][0]           
__________________________________________________________________________________________________
normal_add_5_11 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_11[0][0]             
__________________________________________________________________________________________________
normal_concat_11 (Concatenate)  (None, 7, 7, 1056)   0           adjust_bn_11[0][0]               
                                                                 normal_add_1_11[0][0]            
                                                                 normal_add_2_11[0][0]            
                                                                 normal_add_3_11[0][0]            
                                                                 normal_add_4_11[0][0]            
                                                                 normal_add_5_11[0][0]            
__________________________________________________________________________________________________
activation_175 (Activation)     (None, 7, 7, 1056)   0           normal_concat_10[0][0]           
__________________________________________________________________________________________________
activation_176 (Activation)     (None, 7, 7, 1056)   0           normal_concat_11[0][0]           
__________________________________________________________________________________________________
adjust_conv_projection_12 (Conv (None, 7, 7, 176)    185856      activation_175[0][0]             
__________________________________________________________________________________________________
normal_conv_1_12 (Conv2D)       (None, 7, 7, 176)    185856      activation_176[0][0]             
__________________________________________________________________________________________________
adjust_bn_12 (BatchNormalizatio (None, 7, 7, 176)    704         adjust_conv_projection_12[0][0]  
__________________________________________________________________________________________________
normal_bn_1_12 (BatchNormalizat (None, 7, 7, 176)    704         normal_conv_1_12[0][0]           
__________________________________________________________________________________________________
activation_177 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_12[0][0]             
__________________________________________________________________________________________________
activation_179 (Activation)     (None, 7, 7, 176)    0           adjust_bn_12[0][0]               
__________________________________________________________________________________________________
activation_181 (Activation)     (None, 7, 7, 176)    0           adjust_bn_12[0][0]               
__________________________________________________________________________________________________
activation_183 (Activation)     (None, 7, 7, 176)    0           adjust_bn_12[0][0]               
__________________________________________________________________________________________________
activation_185 (Activation)     (None, 7, 7, 176)    0           normal_bn_1_12[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left1_1 (None, 7, 7, 176)    35376       activation_177[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right1_ (None, 7, 7, 176)    32560       activation_179[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left2_1 (None, 7, 7, 176)    35376       activation_181[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_right2_ (None, 7, 7, 176)    32560       activation_183[0][0]             
__________________________________________________________________________________________________
separable_conv_1_normal_left5_1 (None, 7, 7, 176)    32560       activation_185[0][0]             
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left1_12[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right1_12
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left2_12[
__________________________________________________________________________________________________
separable_conv_1_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_1_normal_right2_12
__________________________________________________________________________________________________
separable_conv_1_bn_normal_left (None, 7, 7, 176)    704         separable_conv_1_normal_left5_12[
__________________________________________________________________________________________________
activation_178 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left1_
__________________________________________________________________________________________________
activation_180 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right1
__________________________________________________________________________________________________
activation_182 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left2_
__________________________________________________________________________________________________
activation_184 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_right2
__________________________________________________________________________________________________
activation_186 (Activation)     (None, 7, 7, 176)    0           separable_conv_1_bn_normal_left5_
__________________________________________________________________________________________________
separable_conv_2_normal_left1_1 (None, 7, 7, 176)    35376       activation_178[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right1_ (None, 7, 7, 176)    32560       activation_180[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left2_1 (None, 7, 7, 176)    35376       activation_182[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_right2_ (None, 7, 7, 176)    32560       activation_184[0][0]             
__________________________________________________________________________________________________
separable_conv_2_normal_left5_1 (None, 7, 7, 176)    32560       activation_186[0][0]             
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left1_12[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right1_12
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left2_12[
__________________________________________________________________________________________________
separable_conv_2_bn_normal_righ (None, 7, 7, 176)    704         separable_conv_2_normal_right2_12
__________________________________________________________________________________________________
normal_left3_12 (AveragePooling (None, 7, 7, 176)    0           normal_bn_1_12[0][0]             
__________________________________________________________________________________________________
normal_left4_12 (AveragePooling (None, 7, 7, 176)    0           adjust_bn_12[0][0]               
__________________________________________________________________________________________________
normal_right4_12 (AveragePoolin (None, 7, 7, 176)    0           adjust_bn_12[0][0]               
__________________________________________________________________________________________________
separable_conv_2_bn_normal_left (None, 7, 7, 176)    704         separable_conv_2_normal_left5_12[
__________________________________________________________________________________________________
normal_add_1_12 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left1_
                                                                 separable_conv_2_bn_normal_right1
__________________________________________________________________________________________________
normal_add_2_12 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left2_
                                                                 separable_conv_2_bn_normal_right2
__________________________________________________________________________________________________
normal_add_3_12 (Add)           (None, 7, 7, 176)    0           normal_left3_12[0][0]            
                                                                 adjust_bn_12[0][0]               
__________________________________________________________________________________________________
normal_add_4_12 (Add)           (None, 7, 7, 176)    0           normal_left4_12[0][0]            
                                                                 normal_right4_12[0][0]           
__________________________________________________________________________________________________
normal_add_5_12 (Add)           (None, 7, 7, 176)    0           separable_conv_2_bn_normal_left5_
                                                                 normal_bn_1_12[0][0]             
__________________________________________________________________________________________________
normal_concat_12 (Concatenate)  (None, 7, 7, 1056)   0           adjust_bn_12[0][0]               
                                                                 normal_add_1_12[0][0]            
                                                                 normal_add_2_12[0][0]            
                                                                 normal_add_3_12[0][0]            
                                                                 normal_add_4_12[0][0]            
                                                                 normal_add_5_12[0][0]            
__________________________________________________________________________________________________
activation_187 (Activation)     (None, 7, 7, 1056)   0           normal_concat_12[0][0]           
__________________________________________________________________________________________________
global_average_pooling2d (Globa (None, 1056)         0           activation_187[0][0]             
__________________________________________________________________________________________________
dense (Dense)                   (None, 755)          798035      global_average_pooling2d[0][0]   
==================================================================================================
Total params: 5,067,751
Trainable params: 5,031,013
Non-trainable params: 36,738
__________________________________________________________________________________________________
2021-02-06 09:09:44.147725: I tensorflow/core/profiler/lib/profiler_session.cc:136] Profiler session initializing.
2021-02-06 09:09:44.147755: I tensorflow/core/profiler/lib/profiler_session.cc:155] Profiler session started.
2021-02-06 09:09:44.147793: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1365] Profiler found 1 GPUs
2021-02-06 09:09:44.147989: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library 'libcupti.so.11.0'; dlerror: libcupti.so.11.0: cannot open shared object file: No such file or directory
2021-02-06 09:09:44.148647: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcupti.so
2021-02-06 09:09:44.149868: I tensorflow/core/profiler/lib/profiler_session.cc:172] Profiler session tear down.
2021-02-06 09:09:44.149943: I tensorflow/core/profiler/internal/gpu/cupti_tracer.cc:1487] CUPTI activity buffer flushed
/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/training.py:1844: UserWarning: `Model.fit_generator` is deprecated and will be removed in a future version. Please use `Model.fit`, which supports generators.
  warnings.warn('`Model.fit_generator` is deprecated and '
Traceback (most recent call last):
  File "train.py", line 180, in <module>
    setup_training(config_file=args.config)
  File "train.py", line 165, in setup_training
    return(train_from_config(config, dirname))
  File "train.py", line 90, in train_from_config
    model_layers, model_path = classifier.train(config['train']['train_image_folder'],
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/axelerate/networks/classifier/frontend_classifier.py", line 89, in train
    model_layers, model_path = train(self._network,'categorical_crossentropy',train_generator,validation_generator,learning_rate, nb_epoch, project_folder,first_trainable_layer, self, metrics)
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/axelerate/networks/common_utils/fit.py", line 120, in train
    model.fit_generator(generator = train_batch_gen,
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/training.py", line 1847, in fit_generator
    return self.fit(
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/training.py", line 1050, in fit
    data_handler = data_adapter.DataHandler(
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/data_adapter.py", line 1100, in __init__
    self._adapter = adapter_cls(
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/data_adapter.py", line 902, in __init__
    super(KerasSequenceAdapter, self).__init__(
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/data_adapter.py", line 779, in __init__
    peek, x = self._peek_and_restore(x)
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/tensorflow/python/keras/engine/data_adapter.py", line 913, in _peek_and_restore
    return x[0], x
  File "/home/spstrademark/ProgramFiles/anaconda3/envs/yolo/lib/python3.8/site-packages/axelerate/networks/classifier/iterator.py", line 55, in __getitem__
    raise ValueError('Asked to retrieve element {idx}, '
ValueError: Asked to retrieve element 0, but the Sequence has length 0
AIWintermuteAI commented 3 years ago

I don't think you have training/validation folders specified properly in the config file

You can see these two lines at the beginning of the output:

Found 0 images belonging to 0 classes. Found 0 images belonging to 0 classes.

AIWintermuteAI commented 3 years ago 
    "train_image_folder":   "/mnt/0d2701de-7997-4d53-99fb-0c9de0a116c9/K210_tools/data/fire_dataset/cat_imaages",
    "train_times":          1,
    "valid_image_folder":   "/mnt/0d2701de-7997-4d53-99fb-0c9de0a116c9/K210_tools/data/fire_dataset/non_cat_images",

Yes, this is not the right folder structure. Please download one of the sample datasets for classification and check the proper format for dataset. In short it is supposed to be training folder -class one -class two validation folder -class one -class two

spstrademark commented 3 years ago

Hello, With the provided structure of folders it worked! Thank you for your time

AIWintermuteAI commented 3 years ago

Okay, great! I actually knew something is wrong with folder structure when you wrote to me on LinkedIn, I just decided it's better to have it on GitHub issues in case someone else encounters similar problem :) Closing the issue.