ermubuzhiming
commented
3 years ago Hi every one,
I am trying to train my yolo model in TensorFlow. For now I have succeeded to convert my darknet model to a TensorFlow model. I also have run the
detect.pyscript to check if the predictions are the same between the two models and they are. Nevertheless, when I'm trying to train my model with the basicyolov4.weightsI have a strange console output. My model loads well, then I have a message sayingRestoring weights from: /yolov4.weights ...Even if I want to train the model from scratch (by not giving a value to the weights flag), the model wants to load the default value at lign 14 intrain.py(I don't know why there is a default value). And most of all, I do not understand why it is needed to have a.weightsfile to train on tensorflow as we have convert the darknet format to tensorflow format.Here is my output :
2021-03-16 14:17:39.525915: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 2021-03-16 14:17:40.832267: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set 2021-03-16 14:17:40.833203: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1 2021-03-16 14:17:40.841239: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: pciBusID: 0000:9e:00.0 name: Quadro RTX 8000 computeCapability: 7.5 coreClock: 1.77GHz coreCount: 72 deviceMemorySize: 47.46GiB deviceMemoryBandwidth: 625.94GiB/s 2021-03-16 14:17:40.841263: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 2021-03-16 14:17:40.844085: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 2021-03-16 14:17:40.844127: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 2021-03-16 14:17:40.845280: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 2021-03-16 14:17:40.845502: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 2021-03-16 14:17:40.848788: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10 2021-03-16 14:17:40.849457: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 2021-03-16 14:17:40.849590: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 2021-03-16 14:17:40.850588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0 2021-03-16 14:17:40.850918: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 AVX512F FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2021-03-16 14:17:40.854532: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set 2021-03-16 14:17:40.855070: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties: pciBusID: 0000:9e:00.0 name: Quadro RTX 8000 computeCapability: 7.5 coreClock: 1.77GHz coreCount: 72 deviceMemorySize: 47.46GiB deviceMemoryBandwidth: 625.94GiB/s 2021-03-16 14:17:40.855092: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 2021-03-16 14:17:40.855115: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11 2021-03-16 14:17:40.855129: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11 2021-03-16 14:17:40.855143: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10 2021-03-16 14:17:40.855157: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10 2021-03-16 14:17:40.855170: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10 2021-03-16 14:17:40.855184: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11 2021-03-16 14:17:40.855198: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8 2021-03-16 14:17:40.856059: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0 2021-03-16 14:17:40.856091: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0 2021-03-16 14:17:41.461438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1261] Device interconnect StreamExecutor with strength 1 edge matrix: 2021-03-16 14:17:41.461477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1267] 0 2021-03-16 14:17:41.461484: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1280] 0: N 2021-03-16 14:17:41.463007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1761 MB memory) -> physical GPU (device: 0, name: Quadro RTX 8000, pci bus id: 0000:9e:00.0, compute capability: 7.5) Model: "model" __________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_1 (InputLayer) [(None, 768, 768, 3) 0 __________________________________________________________________________________________________ conv2d (Conv2D) (None, 768, 768, 32) 864 input_1[0][0] __________________________________________________________________________________________________ batch_normalization (BatchNorma (None, 768, 768, 32) 128 conv2d[0][0] __________________________________________________________________________________________________ tf.math.softplus (TFOpLambda) (None, 768, 768, 32) 0 batch_normalization[0][0] __________________________________________________________________________________________________ tf.math.tanh (TFOpLambda) (None, 768, 768, 32) 0 tf.math.softplus[0][0] __________________________________________________________________________________________________ tf.math.multiply (TFOpLambda) (None, 768, 768, 32) 0 batch_normalization[0][0] tf.math.tanh[0][0] __________________________________________________________________________________________________ zero_padding2d (ZeroPadding2D) (None, 769, 769, 32) 0 tf.math.multiply[0][0] __________________________________________________________________________________________________ conv2d_1 (Conv2D) (None, 384, 384, 64) 18432 zero_padding2d[0][0] __________________________________________________________________________________________________ batch_normalization_1 (BatchNor (None, 384, 384, 64) 256 conv2d_1[0][0] __________________________________________________________________________________________________ tf.math.softplus_1 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_1[0][0] __________________________________________________________________________________________________ tf.math.tanh_1 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_1[0][0] __________________________________________________________________________________________________ tf.math.multiply_1 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_1[0][0] tf.math.tanh_1[0][0] __________________________________________________________________________________________________ conv2d_3 (Conv2D) (None, 384, 384, 64) 4096 tf.math.multiply_1[0][0] __________________________________________________________________________________________________ batch_normalization_3 (BatchNor (None, 384, 384, 64) 256 conv2d_3[0][0] __________________________________________________________________________________________________ tf.math.softplus_3 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_3[0][0] __________________________________________________________________________________________________ tf.math.tanh_3 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_3[0][0] __________________________________________________________________________________________________ tf.math.multiply_3 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_3[0][0] tf.math.tanh_3[0][0] __________________________________________________________________________________________________ conv2d_4 (Conv2D) (None, 384, 384, 32) 2048 tf.math.multiply_3[0][0] __________________________________________________________________________________________________ batch_normalization_4 (BatchNor (None, 384, 384, 32) 128 conv2d_4[0][0] __________________________________________________________________________________________________ tf.math.softplus_4 (TFOpLambda) (None, 384, 384, 32) 0 batch_normalization_4[0][0] __________________________________________________________________________________________________ tf.math.tanh_4 (TFOpLambda) (None, 384, 384, 32) 0 tf.math.softplus_4[0][0] __________________________________________________________________________________________________ tf.math.multiply_4 (TFOpLambda) (None, 384, 384, 32) 0 batch_normalization_4[0][0] tf.math.tanh_4[0][0] __________________________________________________________________________________________________ conv2d_5 (Conv2D) (None, 384, 384, 64) 18432 tf.math.multiply_4[0][0] __________________________________________________________________________________________________ batch_normalization_5 (BatchNor (None, 384, 384, 64) 256 conv2d_5[0][0] __________________________________________________________________________________________________ tf.math.softplus_5 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_5[0][0] __________________________________________________________________________________________________ tf.math.tanh_5 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_5[0][0] __________________________________________________________________________________________________ tf.math.multiply_5 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_5[0][0] tf.math.tanh_5[0][0] __________________________________________________________________________________________________ tf.__operators__.add (TFOpLambd (None, 384, 384, 64) 0 tf.math.multiply_3[0][0] tf.math.multiply_5[0][0] __________________________________________________________________________________________________ conv2d_6 (Conv2D) (None, 384, 384, 64) 4096 tf.__operators__.add[0][0] __________________________________________________________________________________________________ conv2d_2 (Conv2D) (None, 384, 384, 64) 4096 tf.math.multiply_1[0][0] __________________________________________________________________________________________________ batch_normalization_6 (BatchNor (None, 384, 384, 64) 256 conv2d_6[0][0] __________________________________________________________________________________________________ batch_normalization_2 (BatchNor (None, 384, 384, 64) 256 conv2d_2[0][0] __________________________________________________________________________________________________ tf.math.softplus_6 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_6[0][0] __________________________________________________________________________________________________ tf.math.softplus_2 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_2[0][0] __________________________________________________________________________________________________ tf.math.tanh_6 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_6[0][0] __________________________________________________________________________________________________ tf.math.tanh_2 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_2[0][0] __________________________________________________________________________________________________ tf.math.multiply_6 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_6[0][0] tf.math.tanh_6[0][0] __________________________________________________________________________________________________ tf.math.multiply_2 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_2[0][0] tf.math.tanh_2[0][0] __________________________________________________________________________________________________ tf.concat (TFOpLambda) (None, 384, 384, 128 0 tf.math.multiply_6[0][0] tf.math.multiply_2[0][0] __________________________________________________________________________________________________ conv2d_7 (Conv2D) (None, 384, 384, 64) 8192 tf.concat[0][0] __________________________________________________________________________________________________ batch_normalization_7 (BatchNor (None, 384, 384, 64) 256 conv2d_7[0][0] __________________________________________________________________________________________________ tf.math.softplus_7 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_7[0][0] __________________________________________________________________________________________________ tf.math.tanh_7 (TFOpLambda) (None, 384, 384, 64) 0 tf.math.softplus_7[0][0] __________________________________________________________________________________________________ tf.math.multiply_7 (TFOpLambda) (None, 384, 384, 64) 0 batch_normalization_7[0][0] tf.math.tanh_7[0][0] __________________________________________________________________________________________________ zero_padding2d_1 (ZeroPadding2D (None, 385, 385, 64) 0 tf.math.multiply_7[0][0] __________________________________________________________________________________________________ conv2d_8 (Conv2D) (None, 192, 192, 128 73728 zero_padding2d_1[0][0] __________________________________________________________________________________________________ batch_normalization_8 (BatchNor (None, 192, 192, 128 512 conv2d_8[0][0] __________________________________________________________________________________________________ tf.math.softplus_8 (TFOpLambda) (None, 192, 192, 128 0 batch_normalization_8[0][0] __________________________________________________________________________________________________ tf.math.tanh_8 (TFOpLambda) (None, 192, 192, 128 0 tf.math.softplus_8[0][0] __________________________________________________________________________________________________ tf.math.multiply_8 (TFOpLambda) (None, 192, 192, 128 0 batch_normalization_8[0][0] tf.math.tanh_8[0][0] __________________________________________________________________________________________________ conv2d_10 (Conv2D) (None, 192, 192, 64) 8192 tf.math.multiply_8[0][0] __________________________________________________________________________________________________ batch_normalization_10 (BatchNo (None, 192, 192, 64) 256 conv2d_10[0][0] __________________________________________________________________________________________________ tf.math.softplus_10 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_10[0][0] __________________________________________________________________________________________________ tf.math.tanh_10 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_10[0][0] __________________________________________________________________________________________________ tf.math.multiply_10 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_10[0][0] tf.math.tanh_10[0][0] __________________________________________________________________________________________________ conv2d_11 (Conv2D) (None, 192, 192, 64) 4096 tf.math.multiply_10[0][0] __________________________________________________________________________________________________ batch_normalization_11 (BatchNo (None, 192, 192, 64) 256 conv2d_11[0][0] __________________________________________________________________________________________________ tf.math.softplus_11 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_11[0][0] __________________________________________________________________________________________________ tf.math.tanh_11 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_11[0][0] __________________________________________________________________________________________________ tf.math.multiply_11 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_11[0][0] tf.math.tanh_11[0][0] __________________________________________________________________________________________________ conv2d_12 (Conv2D) (None, 192, 192, 64) 36864 tf.math.multiply_11[0][0] __________________________________________________________________________________________________ batch_normalization_12 (BatchNo (None, 192, 192, 64) 256 conv2d_12[0][0] __________________________________________________________________________________________________ tf.math.softplus_12 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_12[0][0] __________________________________________________________________________________________________ tf.math.tanh_12 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_12[0][0] __________________________________________________________________________________________________ tf.math.multiply_12 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_12[0][0] tf.math.tanh_12[0][0] __________________________________________________________________________________________________ tf.__operators__.add_1 (TFOpLam (None, 192, 192, 64) 0 tf.math.multiply_10[0][0] tf.math.multiply_12[0][0] __________________________________________________________________________________________________ conv2d_13 (Conv2D) (None, 192, 192, 64) 4096 tf.__operators__.add_1[0][0] __________________________________________________________________________________________________ batch_normalization_13 (BatchNo (None, 192, 192, 64) 256 conv2d_13[0][0] __________________________________________________________________________________________________ tf.math.softplus_13 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_13[0][0] __________________________________________________________________________________________________ tf.math.tanh_13 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_13[0][0] __________________________________________________________________________________________________ tf.math.multiply_13 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_13[0][0] tf.math.tanh_13[0][0] __________________________________________________________________________________________________ conv2d_14 (Conv2D) (None, 192, 192, 64) 36864 tf.math.multiply_13[0][0] __________________________________________________________________________________________________ batch_normalization_14 (BatchNo (None, 192, 192, 64) 256 conv2d_14[0][0] __________________________________________________________________________________________________ tf.math.softplus_14 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_14[0][0] __________________________________________________________________________________________________ tf.math.tanh_14 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_14[0][0] __________________________________________________________________________________________________ tf.math.multiply_14 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_14[0][0] tf.math.tanh_14[0][0] __________________________________________________________________________________________________ tf.__operators__.add_2 (TFOpLam (None, 192, 192, 64) 0 tf.__operators__.add_1[0][0] tf.math.multiply_14[0][0] __________________________________________________________________________________________________ conv2d_15 (Conv2D) (None, 192, 192, 64) 4096 tf.__operators__.add_2[0][0] __________________________________________________________________________________________________ conv2d_9 (Conv2D) (None, 192, 192, 64) 8192 tf.math.multiply_8[0][0] __________________________________________________________________________________________________ batch_normalization_15 (BatchNo (None, 192, 192, 64) 256 conv2d_15[0][0] __________________________________________________________________________________________________ batch_normalization_9 (BatchNor (None, 192, 192, 64) 256 conv2d_9[0][0] __________________________________________________________________________________________________ tf.math.softplus_15 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_15[0][0] __________________________________________________________________________________________________ tf.math.softplus_9 (TFOpLambda) (None, 192, 192, 64) 0 batch_normalization_9[0][0] __________________________________________________________________________________________________ tf.math.tanh_15 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_15[0][0] __________________________________________________________________________________________________ tf.math.tanh_9 (TFOpLambda) (None, 192, 192, 64) 0 tf.math.softplus_9[0][0] __________________________________________________________________________________________________ tf.math.multiply_15 (TFOpLambda (None, 192, 192, 64) 0 batch_normalization_15[0][0] tf.math.tanh_15[0][0] __________________________________________________________________________________________________ tf.math.multiply_9 (TFOpLambda) (None, 192, 192, 64) 0 batch_normalization_9[0][0] tf.math.tanh_9[0][0] __________________________________________________________________________________________________ tf.concat_1 (TFOpLambda) (None, 192, 192, 128 0 tf.math.multiply_15[0][0] tf.math.multiply_9[0][0] __________________________________________________________________________________________________ conv2d_16 (Conv2D) (None, 192, 192, 128 16384 tf.concat_1[0][0] __________________________________________________________________________________________________ batch_normalization_16 (BatchNo (None, 192, 192, 128 512 conv2d_16[0][0] __________________________________________________________________________________________________ tf.math.softplus_16 (TFOpLambda (None, 192, 192, 128 0 batch_normalization_16[0][0] __________________________________________________________________________________________________ tf.math.tanh_16 (TFOpLambda) (None, 192, 192, 128 0 tf.math.softplus_16[0][0] __________________________________________________________________________________________________ tf.math.multiply_16 (TFOpLambda (None, 192, 192, 128 0 batch_normalization_16[0][0] tf.math.tanh_16[0][0] __________________________________________________________________________________________________ zero_padding2d_2 (ZeroPadding2D (None, 193, 193, 128 0 tf.math.multiply_16[0][0] __________________________________________________________________________________________________ conv2d_17 (Conv2D) (None, 96, 96, 256) 294912 zero_padding2d_2[0][0] __________________________________________________________________________________________________ batch_normalization_17 (BatchNo (None, 96, 96, 256) 1024 conv2d_17[0][0] __________________________________________________________________________________________________ tf.math.softplus_17 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_17[0][0] __________________________________________________________________________________________________ tf.math.tanh_17 (TFOpLambda) (None, 96, 96, 256) 0 tf.math.softplus_17[0][0] __________________________________________________________________________________________________ tf.math.multiply_17 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_17[0][0] tf.math.tanh_17[0][0] __________________________________________________________________________________________________ conv2d_19 (Conv2D) (None, 96, 96, 128) 32768 tf.math.multiply_17[0][0] __________________________________________________________________________________________________ batch_normalization_19 (BatchNo (None, 96, 96, 128) 512 conv2d_19[0][0] __________________________________________________________________________________________________ tf.math.softplus_19 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_19[0][0] __________________________________________________________________________________________________ tf.math.tanh_19 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_19[0][0] __________________________________________________________________________________________________ tf.math.multiply_19 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_19[0][0] tf.math.tanh_19[0][0] __________________________________________________________________________________________________ conv2d_20 (Conv2D) (None, 96, 96, 128) 16384 tf.math.multiply_19[0][0] __________________________________________________________________________________________________ batch_normalization_20 (BatchNo (None, 96, 96, 128) 512 conv2d_20[0][0] __________________________________________________________________________________________________ tf.math.softplus_20 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_20[0][0] __________________________________________________________________________________________________ tf.math.tanh_20 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_20[0][0] __________________________________________________________________________________________________ tf.math.multiply_20 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_20[0][0] tf.math.tanh_20[0][0] __________________________________________________________________________________________________ conv2d_21 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_20[0][0] __________________________________________________________________________________________________ batch_normalization_21 (BatchNo (None, 96, 96, 128) 512 conv2d_21[0][0] __________________________________________________________________________________________________ tf.math.softplus_21 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_21[0][0] __________________________________________________________________________________________________ tf.math.tanh_21 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_21[0][0] __________________________________________________________________________________________________ tf.math.multiply_21 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_21[0][0] tf.math.tanh_21[0][0] __________________________________________________________________________________________________ tf.__operators__.add_3 (TFOpLam (None, 96, 96, 128) 0 tf.math.multiply_19[0][0] tf.math.multiply_21[0][0] __________________________________________________________________________________________________ conv2d_22 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_3[0][0] __________________________________________________________________________________________________ batch_normalization_22 (BatchNo (None, 96, 96, 128) 512 conv2d_22[0][0] __________________________________________________________________________________________________ tf.math.softplus_22 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_22[0][0] __________________________________________________________________________________________________ tf.math.tanh_22 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_22[0][0] __________________________________________________________________________________________________ tf.math.multiply_22 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_22[0][0] tf.math.tanh_22[0][0] __________________________________________________________________________________________________ conv2d_23 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_22[0][0] __________________________________________________________________________________________________ batch_normalization_23 (BatchNo (None, 96, 96, 128) 512 conv2d_23[0][0] __________________________________________________________________________________________________ tf.math.softplus_23 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_23[0][0] __________________________________________________________________________________________________ tf.math.tanh_23 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_23[0][0] __________________________________________________________________________________________________ tf.math.multiply_23 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_23[0][0] tf.math.tanh_23[0][0] __________________________________________________________________________________________________ tf.__operators__.add_4 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_3[0][0] tf.math.multiply_23[0][0] __________________________________________________________________________________________________ conv2d_24 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_4[0][0] __________________________________________________________________________________________________ batch_normalization_24 (BatchNo (None, 96, 96, 128) 512 conv2d_24[0][0] __________________________________________________________________________________________________ tf.math.softplus_24 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_24[0][0] __________________________________________________________________________________________________ tf.math.tanh_24 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_24[0][0] __________________________________________________________________________________________________ tf.math.multiply_24 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_24[0][0] tf.math.tanh_24[0][0] __________________________________________________________________________________________________ conv2d_25 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_24[0][0] __________________________________________________________________________________________________ batch_normalization_25 (BatchNo (None, 96, 96, 128) 512 conv2d_25[0][0] __________________________________________________________________________________________________ tf.math.softplus_25 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_25[0][0] __________________________________________________________________________________________________ tf.math.tanh_25 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_25[0][0] __________________________________________________________________________________________________ tf.math.multiply_25 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_25[0][0] tf.math.tanh_25[0][0] __________________________________________________________________________________________________ tf.__operators__.add_5 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_4[0][0] tf.math.multiply_25[0][0] __________________________________________________________________________________________________ conv2d_26 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_5[0][0] __________________________________________________________________________________________________ batch_normalization_26 (BatchNo (None, 96, 96, 128) 512 conv2d_26[0][0] __________________________________________________________________________________________________ tf.math.softplus_26 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_26[0][0] __________________________________________________________________________________________________ tf.math.tanh_26 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_26[0][0] __________________________________________________________________________________________________ tf.math.multiply_26 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_26[0][0] tf.math.tanh_26[0][0] __________________________________________________________________________________________________ conv2d_27 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_26[0][0] __________________________________________________________________________________________________ batch_normalization_27 (BatchNo (None, 96, 96, 128) 512 conv2d_27[0][0] __________________________________________________________________________________________________ tf.math.softplus_27 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_27[0][0] __________________________________________________________________________________________________ tf.math.tanh_27 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_27[0][0] __________________________________________________________________________________________________ tf.math.multiply_27 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_27[0][0] tf.math.tanh_27[0][0] __________________________________________________________________________________________________ tf.__operators__.add_6 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_5[0][0] tf.math.multiply_27[0][0] __________________________________________________________________________________________________ conv2d_28 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_6[0][0] __________________________________________________________________________________________________ batch_normalization_28 (BatchNo (None, 96, 96, 128) 512 conv2d_28[0][0] __________________________________________________________________________________________________ tf.math.softplus_28 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_28[0][0] __________________________________________________________________________________________________ tf.math.tanh_28 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_28[0][0] __________________________________________________________________________________________________ tf.math.multiply_28 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_28[0][0] tf.math.tanh_28[0][0] __________________________________________________________________________________________________ conv2d_29 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_28[0][0] __________________________________________________________________________________________________ batch_normalization_29 (BatchNo (None, 96, 96, 128) 512 conv2d_29[0][0] __________________________________________________________________________________________________ tf.math.softplus_29 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_29[0][0] __________________________________________________________________________________________________ tf.math.tanh_29 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_29[0][0] __________________________________________________________________________________________________ tf.math.multiply_29 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_29[0][0] tf.math.tanh_29[0][0] __________________________________________________________________________________________________ tf.__operators__.add_7 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_6[0][0] tf.math.multiply_29[0][0] __________________________________________________________________________________________________ conv2d_30 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_7[0][0] __________________________________________________________________________________________________ batch_normalization_30 (BatchNo (None, 96, 96, 128) 512 conv2d_30[0][0] __________________________________________________________________________________________________ tf.math.softplus_30 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_30[0][0] __________________________________________________________________________________________________ tf.math.tanh_30 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_30[0][0] __________________________________________________________________________________________________ tf.math.multiply_30 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_30[0][0] tf.math.tanh_30[0][0] __________________________________________________________________________________________________ conv2d_31 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_30[0][0] __________________________________________________________________________________________________ batch_normalization_31 (BatchNo (None, 96, 96, 128) 512 conv2d_31[0][0] __________________________________________________________________________________________________ tf.math.softplus_31 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_31[0][0] __________________________________________________________________________________________________ tf.math.tanh_31 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_31[0][0] __________________________________________________________________________________________________ tf.math.multiply_31 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_31[0][0] tf.math.tanh_31[0][0] __________________________________________________________________________________________________ tf.__operators__.add_8 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_7[0][0] tf.math.multiply_31[0][0] __________________________________________________________________________________________________ conv2d_32 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_8[0][0] __________________________________________________________________________________________________ batch_normalization_32 (BatchNo (None, 96, 96, 128) 512 conv2d_32[0][0] __________________________________________________________________________________________________ tf.math.softplus_32 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_32[0][0] __________________________________________________________________________________________________ tf.math.tanh_32 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_32[0][0] __________________________________________________________________________________________________ tf.math.multiply_32 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_32[0][0] tf.math.tanh_32[0][0] __________________________________________________________________________________________________ conv2d_33 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_32[0][0] __________________________________________________________________________________________________ batch_normalization_33 (BatchNo (None, 96, 96, 128) 512 conv2d_33[0][0] __________________________________________________________________________________________________ tf.math.softplus_33 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_33[0][0] __________________________________________________________________________________________________ tf.math.tanh_33 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_33[0][0] __________________________________________________________________________________________________ tf.math.multiply_33 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_33[0][0] tf.math.tanh_33[0][0] __________________________________________________________________________________________________ tf.__operators__.add_9 (TFOpLam (None, 96, 96, 128) 0 tf.__operators__.add_8[0][0] tf.math.multiply_33[0][0] __________________________________________________________________________________________________ conv2d_34 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_9[0][0] __________________________________________________________________________________________________ batch_normalization_34 (BatchNo (None, 96, 96, 128) 512 conv2d_34[0][0] __________________________________________________________________________________________________ tf.math.softplus_34 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_34[0][0] __________________________________________________________________________________________________ tf.math.tanh_34 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_34[0][0] __________________________________________________________________________________________________ tf.math.multiply_34 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_34[0][0] tf.math.tanh_34[0][0] __________________________________________________________________________________________________ conv2d_35 (Conv2D) (None, 96, 96, 128) 147456 tf.math.multiply_34[0][0] __________________________________________________________________________________________________ batch_normalization_35 (BatchNo (None, 96, 96, 128) 512 conv2d_35[0][0] __________________________________________________________________________________________________ tf.math.softplus_35 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_35[0][0] __________________________________________________________________________________________________ tf.math.tanh_35 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_35[0][0] __________________________________________________________________________________________________ tf.math.multiply_35 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_35[0][0] tf.math.tanh_35[0][0] __________________________________________________________________________________________________ tf.__operators__.add_10 (TFOpLa (None, 96, 96, 128) 0 tf.__operators__.add_9[0][0] tf.math.multiply_35[0][0] __________________________________________________________________________________________________ conv2d_36 (Conv2D) (None, 96, 96, 128) 16384 tf.__operators__.add_10[0][0] __________________________________________________________________________________________________ conv2d_18 (Conv2D) (None, 96, 96, 128) 32768 tf.math.multiply_17[0][0] __________________________________________________________________________________________________ batch_normalization_36 (BatchNo (None, 96, 96, 128) 512 conv2d_36[0][0] __________________________________________________________________________________________________ batch_normalization_18 (BatchNo (None, 96, 96, 128) 512 conv2d_18[0][0] __________________________________________________________________________________________________ tf.math.softplus_36 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_36[0][0] __________________________________________________________________________________________________ tf.math.softplus_18 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_18[0][0] __________________________________________________________________________________________________ tf.math.tanh_36 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_36[0][0] __________________________________________________________________________________________________ tf.math.tanh_18 (TFOpLambda) (None, 96, 96, 128) 0 tf.math.softplus_18[0][0] __________________________________________________________________________________________________ tf.math.multiply_36 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_36[0][0] tf.math.tanh_36[0][0] __________________________________________________________________________________________________ tf.math.multiply_18 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_18[0][0] tf.math.tanh_18[0][0] __________________________________________________________________________________________________ tf.concat_2 (TFOpLambda) (None, 96, 96, 256) 0 tf.math.multiply_36[0][0] tf.math.multiply_18[0][0] __________________________________________________________________________________________________ conv2d_37 (Conv2D) (None, 96, 96, 256) 65536 tf.concat_2[0][0] __________________________________________________________________________________________________ batch_normalization_37 (BatchNo (None, 96, 96, 256) 1024 conv2d_37[0][0] __________________________________________________________________________________________________ tf.math.softplus_37 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_37[0][0] __________________________________________________________________________________________________ tf.math.tanh_37 (TFOpLambda) (None, 96, 96, 256) 0 tf.math.softplus_37[0][0] __________________________________________________________________________________________________ tf.math.multiply_37 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_37[0][0] tf.math.tanh_37[0][0] __________________________________________________________________________________________________ zero_padding2d_3 (ZeroPadding2D (None, 97, 97, 256) 0 tf.math.multiply_37[0][0] __________________________________________________________________________________________________ conv2d_38 (Conv2D) (None, 48, 48, 512) 1179648 zero_padding2d_3[0][0] __________________________________________________________________________________________________ batch_normalization_38 (BatchNo (None, 48, 48, 512) 2048 conv2d_38[0][0] __________________________________________________________________________________________________ tf.math.softplus_38 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_38[0][0] __________________________________________________________________________________________________ tf.math.tanh_38 (TFOpLambda) (None, 48, 48, 512) 0 tf.math.softplus_38[0][0] __________________________________________________________________________________________________ tf.math.multiply_38 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_38[0][0] tf.math.tanh_38[0][0] __________________________________________________________________________________________________ conv2d_40 (Conv2D) (None, 48, 48, 256) 131072 tf.math.multiply_38[0][0] __________________________________________________________________________________________________ batch_normalization_40 (BatchNo (None, 48, 48, 256) 1024 conv2d_40[0][0] __________________________________________________________________________________________________ tf.math.softplus_40 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_40[0][0] __________________________________________________________________________________________________ tf.math.tanh_40 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_40[0][0] __________________________________________________________________________________________________ tf.math.multiply_40 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_40[0][0] tf.math.tanh_40[0][0] __________________________________________________________________________________________________ conv2d_41 (Conv2D) (None, 48, 48, 256) 65536 tf.math.multiply_40[0][0] __________________________________________________________________________________________________ batch_normalization_41 (BatchNo (None, 48, 48, 256) 1024 conv2d_41[0][0] __________________________________________________________________________________________________ tf.math.softplus_41 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_41[0][0] __________________________________________________________________________________________________ tf.math.tanh_41 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_41[0][0] __________________________________________________________________________________________________ tf.math.multiply_41 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_41[0][0] tf.math.tanh_41[0][0] __________________________________________________________________________________________________ conv2d_42 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_41[0][0] __________________________________________________________________________________________________ batch_normalization_42 (BatchNo (None, 48, 48, 256) 1024 conv2d_42[0][0] __________________________________________________________________________________________________ tf.math.softplus_42 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_42[0][0] __________________________________________________________________________________________________ tf.math.tanh_42 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_42[0][0] __________________________________________________________________________________________________ tf.math.multiply_42 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_42[0][0] tf.math.tanh_42[0][0] __________________________________________________________________________________________________ tf.__operators__.add_11 (TFOpLa (None, 48, 48, 256) 0 tf.math.multiply_40[0][0] tf.math.multiply_42[0][0] __________________________________________________________________________________________________ conv2d_43 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_11[0][0] __________________________________________________________________________________________________ batch_normalization_43 (BatchNo (None, 48, 48, 256) 1024 conv2d_43[0][0] __________________________________________________________________________________________________ tf.math.softplus_43 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_43[0][0] __________________________________________________________________________________________________ tf.math.tanh_43 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_43[0][0] __________________________________________________________________________________________________ tf.math.multiply_43 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_43[0][0] tf.math.tanh_43[0][0] __________________________________________________________________________________________________ conv2d_44 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_43[0][0] __________________________________________________________________________________________________ batch_normalization_44 (BatchNo (None, 48, 48, 256) 1024 conv2d_44[0][0] __________________________________________________________________________________________________ tf.math.softplus_44 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_44[0][0] __________________________________________________________________________________________________ tf.math.tanh_44 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_44[0][0] __________________________________________________________________________________________________ tf.math.multiply_44 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_44[0][0] tf.math.tanh_44[0][0] __________________________________________________________________________________________________ tf.__operators__.add_12 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_11[0][0] tf.math.multiply_44[0][0] __________________________________________________________________________________________________ conv2d_45 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_12[0][0] __________________________________________________________________________________________________ batch_normalization_45 (BatchNo (None, 48, 48, 256) 1024 conv2d_45[0][0] __________________________________________________________________________________________________ tf.math.softplus_45 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_45[0][0] __________________________________________________________________________________________________ tf.math.tanh_45 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_45[0][0] __________________________________________________________________________________________________ tf.math.multiply_45 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_45[0][0] tf.math.tanh_45[0][0] __________________________________________________________________________________________________ conv2d_46 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_45[0][0] __________________________________________________________________________________________________ batch_normalization_46 (BatchNo (None, 48, 48, 256) 1024 conv2d_46[0][0] __________________________________________________________________________________________________ tf.math.softplus_46 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_46[0][0] __________________________________________________________________________________________________ tf.math.tanh_46 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_46[0][0] __________________________________________________________________________________________________ tf.math.multiply_46 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_46[0][0] tf.math.tanh_46[0][0] __________________________________________________________________________________________________ tf.__operators__.add_13 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_12[0][0] tf.math.multiply_46[0][0] __________________________________________________________________________________________________ conv2d_47 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_13[0][0] __________________________________________________________________________________________________ batch_normalization_47 (BatchNo (None, 48, 48, 256) 1024 conv2d_47[0][0] __________________________________________________________________________________________________ tf.math.softplus_47 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_47[0][0] __________________________________________________________________________________________________ tf.math.tanh_47 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_47[0][0] __________________________________________________________________________________________________ tf.math.multiply_47 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_47[0][0] tf.math.tanh_47[0][0] __________________________________________________________________________________________________ conv2d_48 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_47[0][0] __________________________________________________________________________________________________ batch_normalization_48 (BatchNo (None, 48, 48, 256) 1024 conv2d_48[0][0] __________________________________________________________________________________________________ tf.math.softplus_48 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_48[0][0] __________________________________________________________________________________________________ tf.math.tanh_48 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_48[0][0] __________________________________________________________________________________________________ tf.math.multiply_48 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_48[0][0] tf.math.tanh_48[0][0] __________________________________________________________________________________________________ tf.__operators__.add_14 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_13[0][0] tf.math.multiply_48[0][0] __________________________________________________________________________________________________ conv2d_49 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_14[0][0] __________________________________________________________________________________________________ batch_normalization_49 (BatchNo (None, 48, 48, 256) 1024 conv2d_49[0][0] __________________________________________________________________________________________________ tf.math.softplus_49 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_49[0][0] __________________________________________________________________________________________________ tf.math.tanh_49 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_49[0][0] __________________________________________________________________________________________________ tf.math.multiply_49 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_49[0][0] tf.math.tanh_49[0][0] __________________________________________________________________________________________________ conv2d_50 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_49[0][0] __________________________________________________________________________________________________ batch_normalization_50 (BatchNo (None, 48, 48, 256) 1024 conv2d_50[0][0] __________________________________________________________________________________________________ tf.math.softplus_50 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_50[0][0] __________________________________________________________________________________________________ tf.math.tanh_50 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_50[0][0] __________________________________________________________________________________________________ tf.math.multiply_50 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_50[0][0] tf.math.tanh_50[0][0] __________________________________________________________________________________________________ tf.__operators__.add_15 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_14[0][0] tf.math.multiply_50[0][0] __________________________________________________________________________________________________ conv2d_51 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_15[0][0] __________________________________________________________________________________________________ batch_normalization_51 (BatchNo (None, 48, 48, 256) 1024 conv2d_51[0][0] __________________________________________________________________________________________________ tf.math.softplus_51 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_51[0][0] __________________________________________________________________________________________________ tf.math.tanh_51 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_51[0][0] __________________________________________________________________________________________________ tf.math.multiply_51 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_51[0][0] tf.math.tanh_51[0][0] __________________________________________________________________________________________________ conv2d_52 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_51[0][0] __________________________________________________________________________________________________ batch_normalization_52 (BatchNo (None, 48, 48, 256) 1024 conv2d_52[0][0] __________________________________________________________________________________________________ tf.math.softplus_52 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_52[0][0] __________________________________________________________________________________________________ tf.math.tanh_52 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_52[0][0] __________________________________________________________________________________________________ tf.math.multiply_52 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_52[0][0] tf.math.tanh_52[0][0] __________________________________________________________________________________________________ tf.__operators__.add_16 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_15[0][0] tf.math.multiply_52[0][0] __________________________________________________________________________________________________ conv2d_53 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_16[0][0] __________________________________________________________________________________________________ batch_normalization_53 (BatchNo (None, 48, 48, 256) 1024 conv2d_53[0][0] __________________________________________________________________________________________________ tf.math.softplus_53 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_53[0][0] __________________________________________________________________________________________________ tf.math.tanh_53 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_53[0][0] __________________________________________________________________________________________________ tf.math.multiply_53 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_53[0][0] tf.math.tanh_53[0][0] __________________________________________________________________________________________________ conv2d_54 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_53[0][0] __________________________________________________________________________________________________ batch_normalization_54 (BatchNo (None, 48, 48, 256) 1024 conv2d_54[0][0] __________________________________________________________________________________________________ tf.math.softplus_54 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_54[0][0] __________________________________________________________________________________________________ tf.math.tanh_54 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_54[0][0] __________________________________________________________________________________________________ tf.math.multiply_54 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_54[0][0] tf.math.tanh_54[0][0] __________________________________________________________________________________________________ tf.__operators__.add_17 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_16[0][0] tf.math.multiply_54[0][0] __________________________________________________________________________________________________ conv2d_55 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_17[0][0] __________________________________________________________________________________________________ batch_normalization_55 (BatchNo (None, 48, 48, 256) 1024 conv2d_55[0][0] __________________________________________________________________________________________________ tf.math.softplus_55 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_55[0][0] __________________________________________________________________________________________________ tf.math.tanh_55 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_55[0][0] __________________________________________________________________________________________________ tf.math.multiply_55 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_55[0][0] tf.math.tanh_55[0][0] __________________________________________________________________________________________________ conv2d_56 (Conv2D) (None, 48, 48, 256) 589824 tf.math.multiply_55[0][0] __________________________________________________________________________________________________ batch_normalization_56 (BatchNo (None, 48, 48, 256) 1024 conv2d_56[0][0] __________________________________________________________________________________________________ tf.math.softplus_56 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_56[0][0] __________________________________________________________________________________________________ tf.math.tanh_56 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_56[0][0] __________________________________________________________________________________________________ tf.math.multiply_56 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_56[0][0] tf.math.tanh_56[0][0] __________________________________________________________________________________________________ tf.__operators__.add_18 (TFOpLa (None, 48, 48, 256) 0 tf.__operators__.add_17[0][0] tf.math.multiply_56[0][0] __________________________________________________________________________________________________ conv2d_57 (Conv2D) (None, 48, 48, 256) 65536 tf.__operators__.add_18[0][0] __________________________________________________________________________________________________ conv2d_39 (Conv2D) (None, 48, 48, 256) 131072 tf.math.multiply_38[0][0] __________________________________________________________________________________________________ batch_normalization_57 (BatchNo (None, 48, 48, 256) 1024 conv2d_57[0][0] __________________________________________________________________________________________________ batch_normalization_39 (BatchNo (None, 48, 48, 256) 1024 conv2d_39[0][0] __________________________________________________________________________________________________ tf.math.softplus_57 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_57[0][0] __________________________________________________________________________________________________ tf.math.softplus_39 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_39[0][0] __________________________________________________________________________________________________ tf.math.tanh_57 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_57[0][0] __________________________________________________________________________________________________ tf.math.tanh_39 (TFOpLambda) (None, 48, 48, 256) 0 tf.math.softplus_39[0][0] __________________________________________________________________________________________________ tf.math.multiply_57 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_57[0][0] tf.math.tanh_57[0][0] __________________________________________________________________________________________________ tf.math.multiply_39 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_39[0][0] tf.math.tanh_39[0][0] __________________________________________________________________________________________________ tf.concat_3 (TFOpLambda) (None, 48, 48, 512) 0 tf.math.multiply_57[0][0] tf.math.multiply_39[0][0] __________________________________________________________________________________________________ conv2d_58 (Conv2D) (None, 48, 48, 512) 262144 tf.concat_3[0][0] __________________________________________________________________________________________________ batch_normalization_58 (BatchNo (None, 48, 48, 512) 2048 conv2d_58[0][0] __________________________________________________________________________________________________ tf.math.softplus_58 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_58[0][0] __________________________________________________________________________________________________ tf.math.tanh_58 (TFOpLambda) (None, 48, 48, 512) 0 tf.math.softplus_58[0][0] __________________________________________________________________________________________________ tf.math.multiply_58 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_58[0][0] tf.math.tanh_58[0][0] __________________________________________________________________________________________________ zero_padding2d_4 (ZeroPadding2D (None, 49, 49, 512) 0 tf.math.multiply_58[0][0] __________________________________________________________________________________________________ conv2d_59 (Conv2D) (None, 24, 24, 1024) 4718592 zero_padding2d_4[0][0] __________________________________________________________________________________________________ batch_normalization_59 (BatchNo (None, 24, 24, 1024) 4096 conv2d_59[0][0] __________________________________________________________________________________________________ tf.math.softplus_59 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_59[0][0] __________________________________________________________________________________________________ tf.math.tanh_59 (TFOpLambda) (None, 24, 24, 1024) 0 tf.math.softplus_59[0][0] __________________________________________________________________________________________________ tf.math.multiply_59 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_59[0][0] tf.math.tanh_59[0][0] __________________________________________________________________________________________________ conv2d_61 (Conv2D) (None, 24, 24, 512) 524288 tf.math.multiply_59[0][0] __________________________________________________________________________________________________ batch_normalization_61 (BatchNo (None, 24, 24, 512) 2048 conv2d_61[0][0] __________________________________________________________________________________________________ tf.math.softplus_61 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_61[0][0] __________________________________________________________________________________________________ tf.math.tanh_61 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_61[0][0] __________________________________________________________________________________________________ tf.math.multiply_61 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_61[0][0] tf.math.tanh_61[0][0] __________________________________________________________________________________________________ conv2d_62 (Conv2D) (None, 24, 24, 512) 262144 tf.math.multiply_61[0][0] __________________________________________________________________________________________________ batch_normalization_62 (BatchNo (None, 24, 24, 512) 2048 conv2d_62[0][0] __________________________________________________________________________________________________ tf.math.softplus_62 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_62[0][0] __________________________________________________________________________________________________ tf.math.tanh_62 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_62[0][0] __________________________________________________________________________________________________ tf.math.multiply_62 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_62[0][0] tf.math.tanh_62[0][0] __________________________________________________________________________________________________ conv2d_63 (Conv2D) (None, 24, 24, 512) 2359296 tf.math.multiply_62[0][0] __________________________________________________________________________________________________ batch_normalization_63 (BatchNo (None, 24, 24, 512) 2048 conv2d_63[0][0] __________________________________________________________________________________________________ tf.math.softplus_63 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_63[0][0] __________________________________________________________________________________________________ tf.math.tanh_63 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_63[0][0] __________________________________________________________________________________________________ tf.math.multiply_63 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_63[0][0] tf.math.tanh_63[0][0] __________________________________________________________________________________________________ tf.__operators__.add_19 (TFOpLa (None, 24, 24, 512) 0 tf.math.multiply_61[0][0] tf.math.multiply_63[0][0] __________________________________________________________________________________________________ conv2d_64 (Conv2D) (None, 24, 24, 512) 262144 tf.__operators__.add_19[0][0] __________________________________________________________________________________________________ batch_normalization_64 (BatchNo (None, 24, 24, 512) 2048 conv2d_64[0][0] __________________________________________________________________________________________________ tf.math.softplus_64 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_64[0][0] __________________________________________________________________________________________________ tf.math.tanh_64 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_64[0][0] __________________________________________________________________________________________________ tf.math.multiply_64 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_64[0][0] tf.math.tanh_64[0][0] __________________________________________________________________________________________________ conv2d_65 (Conv2D) (None, 24, 24, 512) 2359296 tf.math.multiply_64[0][0] __________________________________________________________________________________________________ batch_normalization_65 (BatchNo (None, 24, 24, 512) 2048 conv2d_65[0][0] __________________________________________________________________________________________________ tf.math.softplus_65 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_65[0][0] __________________________________________________________________________________________________ tf.math.tanh_65 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_65[0][0] __________________________________________________________________________________________________ tf.math.multiply_65 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_65[0][0] tf.math.tanh_65[0][0] __________________________________________________________________________________________________ tf.__operators__.add_20 (TFOpLa (None, 24, 24, 512) 0 tf.__operators__.add_19[0][0] tf.math.multiply_65[0][0] __________________________________________________________________________________________________ conv2d_66 (Conv2D) (None, 24, 24, 512) 262144 tf.__operators__.add_20[0][0] __________________________________________________________________________________________________ batch_normalization_66 (BatchNo (None, 24, 24, 512) 2048 conv2d_66[0][0] __________________________________________________________________________________________________ tf.math.softplus_66 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_66[0][0] __________________________________________________________________________________________________ tf.math.tanh_66 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_66[0][0] __________________________________________________________________________________________________ tf.math.multiply_66 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_66[0][0] tf.math.tanh_66[0][0] __________________________________________________________________________________________________ conv2d_67 (Conv2D) (None, 24, 24, 512) 2359296 tf.math.multiply_66[0][0] __________________________________________________________________________________________________ batch_normalization_67 (BatchNo (None, 24, 24, 512) 2048 conv2d_67[0][0] __________________________________________________________________________________________________ tf.math.softplus_67 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_67[0][0] __________________________________________________________________________________________________ tf.math.tanh_67 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_67[0][0] __________________________________________________________________________________________________ tf.math.multiply_67 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_67[0][0] tf.math.tanh_67[0][0] __________________________________________________________________________________________________ tf.__operators__.add_21 (TFOpLa (None, 24, 24, 512) 0 tf.__operators__.add_20[0][0] tf.math.multiply_67[0][0] __________________________________________________________________________________________________ conv2d_68 (Conv2D) (None, 24, 24, 512) 262144 tf.__operators__.add_21[0][0] __________________________________________________________________________________________________ batch_normalization_68 (BatchNo (None, 24, 24, 512) 2048 conv2d_68[0][0] __________________________________________________________________________________________________ tf.math.softplus_68 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_68[0][0] __________________________________________________________________________________________________ tf.math.tanh_68 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_68[0][0] __________________________________________________________________________________________________ tf.math.multiply_68 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_68[0][0] tf.math.tanh_68[0][0] __________________________________________________________________________________________________ conv2d_69 (Conv2D) (None, 24, 24, 512) 2359296 tf.math.multiply_68[0][0] __________________________________________________________________________________________________ batch_normalization_69 (BatchNo (None, 24, 24, 512) 2048 conv2d_69[0][0] __________________________________________________________________________________________________ tf.math.softplus_69 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_69[0][0] __________________________________________________________________________________________________ tf.math.tanh_69 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_69[0][0] __________________________________________________________________________________________________ tf.math.multiply_69 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_69[0][0] tf.math.tanh_69[0][0] __________________________________________________________________________________________________ tf.__operators__.add_22 (TFOpLa (None, 24, 24, 512) 0 tf.__operators__.add_21[0][0] tf.math.multiply_69[0][0] __________________________________________________________________________________________________ conv2d_70 (Conv2D) (None, 24, 24, 512) 262144 tf.__operators__.add_22[0][0] __________________________________________________________________________________________________ conv2d_60 (Conv2D) (None, 24, 24, 512) 524288 tf.math.multiply_59[0][0] __________________________________________________________________________________________________ batch_normalization_70 (BatchNo (None, 24, 24, 512) 2048 conv2d_70[0][0] __________________________________________________________________________________________________ batch_normalization_60 (BatchNo (None, 24, 24, 512) 2048 conv2d_60[0][0] __________________________________________________________________________________________________ tf.math.softplus_70 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_70[0][0] __________________________________________________________________________________________________ tf.math.softplus_60 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_60[0][0] __________________________________________________________________________________________________ tf.math.tanh_70 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_70[0][0] __________________________________________________________________________________________________ tf.math.tanh_60 (TFOpLambda) (None, 24, 24, 512) 0 tf.math.softplus_60[0][0] __________________________________________________________________________________________________ tf.math.multiply_70 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_70[0][0] tf.math.tanh_70[0][0] __________________________________________________________________________________________________ tf.math.multiply_60 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_60[0][0] tf.math.tanh_60[0][0] __________________________________________________________________________________________________ tf.concat_4 (TFOpLambda) (None, 24, 24, 1024) 0 tf.math.multiply_70[0][0] tf.math.multiply_60[0][0] __________________________________________________________________________________________________ conv2d_71 (Conv2D) (None, 24, 24, 1024) 1048576 tf.concat_4[0][0] __________________________________________________________________________________________________ batch_normalization_71 (BatchNo (None, 24, 24, 1024) 4096 conv2d_71[0][0] __________________________________________________________________________________________________ tf.math.softplus_71 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_71[0][0] __________________________________________________________________________________________________ tf.math.tanh_71 (TFOpLambda) (None, 24, 24, 1024) 0 tf.math.softplus_71[0][0] __________________________________________________________________________________________________ tf.math.multiply_71 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_71[0][0] tf.math.tanh_71[0][0] __________________________________________________________________________________________________ conv2d_72 (Conv2D) (None, 24, 24, 512) 524288 tf.math.multiply_71[0][0] __________________________________________________________________________________________________ batch_normalization_72 (BatchNo (None, 24, 24, 512) 2048 conv2d_72[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu (TFOpLambda) (None, 24, 24, 512) 0 batch_normalization_72[0][0] __________________________________________________________________________________________________ conv2d_73 (Conv2D) (None, 24, 24, 1024) 4718592 tf.nn.leaky_relu[0][0] __________________________________________________________________________________________________ batch_normalization_73 (BatchNo (None, 24, 24, 1024) 4096 conv2d_73[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_1 (TFOpLambda) (None, 24, 24, 1024) 0 batch_normalization_73[0][0] __________________________________________________________________________________________________ conv2d_74 (Conv2D) (None, 24, 24, 512) 524288 tf.nn.leaky_relu_1[0][0] __________________________________________________________________________________________________ batch_normalization_74 (BatchNo (None, 24, 24, 512) 2048 conv2d_74[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_2 (TFOpLambda) (None, 24, 24, 512) 0 batch_normalization_74[0][0] __________________________________________________________________________________________________ tf.nn.max_pool2d (TFOpLambda) (None, 24, 24, 512) 0 tf.nn.leaky_relu_2[0][0] __________________________________________________________________________________________________ tf.nn.max_pool2d_1 (TFOpLambda) (None, 24, 24, 512) 0 tf.nn.leaky_relu_2[0][0] __________________________________________________________________________________________________ tf.nn.max_pool2d_2 (TFOpLambda) (None, 24, 24, 512) 0 tf.nn.leaky_relu_2[0][0] __________________________________________________________________________________________________ tf.concat_5 (TFOpLambda) (None, 24, 24, 2048) 0 tf.nn.max_pool2d[0][0] tf.nn.max_pool2d_1[0][0] tf.nn.max_pool2d_2[0][0] tf.nn.leaky_relu_2[0][0] __________________________________________________________________________________________________ conv2d_75 (Conv2D) (None, 24, 24, 512) 1048576 tf.concat_5[0][0] __________________________________________________________________________________________________ batch_normalization_75 (BatchNo (None, 24, 24, 512) 2048 conv2d_75[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_3 (TFOpLambda) (None, 24, 24, 512) 0 batch_normalization_75[0][0] __________________________________________________________________________________________________ conv2d_76 (Conv2D) (None, 24, 24, 1024) 4718592 tf.nn.leaky_relu_3[0][0] __________________________________________________________________________________________________ batch_normalization_76 (BatchNo (None, 24, 24, 1024) 4096 conv2d_76[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_4 (TFOpLambda) (None, 24, 24, 1024) 0 batch_normalization_76[0][0] __________________________________________________________________________________________________ conv2d_77 (Conv2D) (None, 24, 24, 512) 524288 tf.nn.leaky_relu_4[0][0] __________________________________________________________________________________________________ batch_normalization_77 (BatchNo (None, 24, 24, 512) 2048 conv2d_77[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_5 (TFOpLambda) (None, 24, 24, 512) 0 batch_normalization_77[0][0] __________________________________________________________________________________________________ conv2d_78 (Conv2D) (None, 24, 24, 256) 131072 tf.nn.leaky_relu_5[0][0] __________________________________________________________________________________________________ conv2d_79 (Conv2D) (None, 48, 48, 256) 131072 tf.math.multiply_58[0][0] __________________________________________________________________________________________________ batch_normalization_78 (BatchNo (None, 24, 24, 256) 1024 conv2d_78[0][0] __________________________________________________________________________________________________ batch_normalization_79 (BatchNo (None, 48, 48, 256) 1024 conv2d_79[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_6 (TFOpLambda) (None, 24, 24, 256) 0 batch_normalization_78[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_7 (TFOpLambda) (None, 48, 48, 256) 0 batch_normalization_79[0][0] __________________________________________________________________________________________________ tf.image.resize (TFOpLambda) (None, 48, 48, 256) 0 tf.nn.leaky_relu_6[0][0] __________________________________________________________________________________________________ tf.concat_6 (TFOpLambda) (None, 48, 48, 512) 0 tf.nn.leaky_relu_7[0][0] tf.image.resize[0][0] __________________________________________________________________________________________________ conv2d_80 (Conv2D) (None, 48, 48, 256) 131072 tf.concat_6[0][0] __________________________________________________________________________________________________ batch_normalization_80 (BatchNo (None, 48, 48, 256) 1024 conv2d_80[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_8 (TFOpLambda) (None, 48, 48, 256) 0 batch_normalization_80[0][0] __________________________________________________________________________________________________ conv2d_81 (Conv2D) (None, 48, 48, 512) 1179648 tf.nn.leaky_relu_8[0][0] __________________________________________________________________________________________________ batch_normalization_81 (BatchNo (None, 48, 48, 512) 2048 conv2d_81[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_9 (TFOpLambda) (None, 48, 48, 512) 0 batch_normalization_81[0][0] __________________________________________________________________________________________________ conv2d_82 (Conv2D) (None, 48, 48, 256) 131072 tf.nn.leaky_relu_9[0][0] __________________________________________________________________________________________________ batch_normalization_82 (BatchNo (None, 48, 48, 256) 1024 conv2d_82[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_10 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_82[0][0] __________________________________________________________________________________________________ conv2d_83 (Conv2D) (None, 48, 48, 512) 1179648 tf.nn.leaky_relu_10[0][0] __________________________________________________________________________________________________ batch_normalization_83 (BatchNo (None, 48, 48, 512) 2048 conv2d_83[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_11 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_83[0][0] __________________________________________________________________________________________________ conv2d_84 (Conv2D) (None, 48, 48, 256) 131072 tf.nn.leaky_relu_11[0][0] __________________________________________________________________________________________________ batch_normalization_84 (BatchNo (None, 48, 48, 256) 1024 conv2d_84[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_12 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_84[0][0] __________________________________________________________________________________________________ conv2d_85 (Conv2D) (None, 48, 48, 128) 32768 tf.nn.leaky_relu_12[0][0] __________________________________________________________________________________________________ conv2d_86 (Conv2D) (None, 96, 96, 128) 32768 tf.math.multiply_37[0][0] __________________________________________________________________________________________________ batch_normalization_85 (BatchNo (None, 48, 48, 128) 512 conv2d_85[0][0] __________________________________________________________________________________________________ batch_normalization_86 (BatchNo (None, 96, 96, 128) 512 conv2d_86[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_13 (TFOpLambda (None, 48, 48, 128) 0 batch_normalization_85[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_14 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_86[0][0] __________________________________________________________________________________________________ tf.image.resize_1 (TFOpLambda) (None, 96, 96, 128) 0 tf.nn.leaky_relu_13[0][0] __________________________________________________________________________________________________ tf.concat_7 (TFOpLambda) (None, 96, 96, 256) 0 tf.nn.leaky_relu_14[0][0] tf.image.resize_1[0][0] __________________________________________________________________________________________________ conv2d_87 (Conv2D) (None, 96, 96, 128) 32768 tf.concat_7[0][0] __________________________________________________________________________________________________ batch_normalization_87 (BatchNo (None, 96, 96, 128) 512 conv2d_87[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_15 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_87[0][0] __________________________________________________________________________________________________ conv2d_88 (Conv2D) (None, 96, 96, 256) 294912 tf.nn.leaky_relu_15[0][0] __________________________________________________________________________________________________ batch_normalization_88 (BatchNo (None, 96, 96, 256) 1024 conv2d_88[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_16 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_88[0][0] __________________________________________________________________________________________________ conv2d_89 (Conv2D) (None, 96, 96, 128) 32768 tf.nn.leaky_relu_16[0][0] __________________________________________________________________________________________________ batch_normalization_89 (BatchNo (None, 96, 96, 128) 512 conv2d_89[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_17 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_89[0][0] __________________________________________________________________________________________________ conv2d_90 (Conv2D) (None, 96, 96, 256) 294912 tf.nn.leaky_relu_17[0][0] __________________________________________________________________________________________________ batch_normalization_90 (BatchNo (None, 96, 96, 256) 1024 conv2d_90[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_18 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_90[0][0] __________________________________________________________________________________________________ conv2d_91 (Conv2D) (None, 96, 96, 128) 32768 tf.nn.leaky_relu_18[0][0] __________________________________________________________________________________________________ batch_normalization_91 (BatchNo (None, 96, 96, 128) 512 conv2d_91[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_19 (TFOpLambda (None, 96, 96, 128) 0 batch_normalization_91[0][0] __________________________________________________________________________________________________ zero_padding2d_5 (ZeroPadding2D (None, 97, 97, 128) 0 tf.nn.leaky_relu_19[0][0] __________________________________________________________________________________________________ conv2d_94 (Conv2D) (None, 48, 48, 256) 294912 zero_padding2d_5[0][0] __________________________________________________________________________________________________ batch_normalization_93 (BatchNo (None, 48, 48, 256) 1024 conv2d_94[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_21 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_93[0][0] __________________________________________________________________________________________________ tf.concat_8 (TFOpLambda) (None, 48, 48, 512) 0 tf.nn.leaky_relu_21[0][0] tf.nn.leaky_relu_12[0][0] __________________________________________________________________________________________________ conv2d_95 (Conv2D) (None, 48, 48, 256) 131072 tf.concat_8[0][0] __________________________________________________________________________________________________ batch_normalization_94 (BatchNo (None, 48, 48, 256) 1024 conv2d_95[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_22 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_94[0][0] __________________________________________________________________________________________________ conv2d_96 (Conv2D) (None, 48, 48, 512) 1179648 tf.nn.leaky_relu_22[0][0] __________________________________________________________________________________________________ batch_normalization_95 (BatchNo (None, 48, 48, 512) 2048 conv2d_96[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_23 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_95[0][0] __________________________________________________________________________________________________ conv2d_97 (Conv2D) (None, 48, 48, 256) 131072 tf.nn.leaky_relu_23[0][0] __________________________________________________________________________________________________ batch_normalization_96 (BatchNo (None, 48, 48, 256) 1024 conv2d_97[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_24 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_96[0][0] __________________________________________________________________________________________________ conv2d_98 (Conv2D) (None, 48, 48, 512) 1179648 tf.nn.leaky_relu_24[0][0] __________________________________________________________________________________________________ batch_normalization_97 (BatchNo (None, 48, 48, 512) 2048 conv2d_98[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_25 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_97[0][0] __________________________________________________________________________________________________ conv2d_99 (Conv2D) (None, 48, 48, 256) 131072 tf.nn.leaky_relu_25[0][0] __________________________________________________________________________________________________ batch_normalization_98 (BatchNo (None, 48, 48, 256) 1024 conv2d_99[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_26 (TFOpLambda (None, 48, 48, 256) 0 batch_normalization_98[0][0] __________________________________________________________________________________________________ zero_padding2d_6 (ZeroPadding2D (None, 49, 49, 256) 0 tf.nn.leaky_relu_26[0][0] __________________________________________________________________________________________________ conv2d_102 (Conv2D) (None, 24, 24, 512) 1179648 zero_padding2d_6[0][0] __________________________________________________________________________________________________ batch_normalization_100 (BatchN (None, 24, 24, 512) 2048 conv2d_102[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_28 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_100[0][0] __________________________________________________________________________________________________ tf.concat_9 (TFOpLambda) (None, 24, 24, 1024) 0 tf.nn.leaky_relu_28[0][0] tf.nn.leaky_relu_5[0][0] __________________________________________________________________________________________________ conv2d_103 (Conv2D) (None, 24, 24, 512) 524288 tf.concat_9[0][0] __________________________________________________________________________________________________ batch_normalization_101 (BatchN (None, 24, 24, 512) 2048 conv2d_103[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_29 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_101[0][0] __________________________________________________________________________________________________ conv2d_104 (Conv2D) (None, 24, 24, 1024) 4718592 tf.nn.leaky_relu_29[0][0] __________________________________________________________________________________________________ batch_normalization_102 (BatchN (None, 24, 24, 1024) 4096 conv2d_104[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_30 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_102[0][0] __________________________________________________________________________________________________ conv2d_105 (Conv2D) (None, 24, 24, 512) 524288 tf.nn.leaky_relu_30[0][0] __________________________________________________________________________________________________ batch_normalization_103 (BatchN (None, 24, 24, 512) 2048 conv2d_105[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_31 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_103[0][0] __________________________________________________________________________________________________ conv2d_106 (Conv2D) (None, 24, 24, 1024) 4718592 tf.nn.leaky_relu_31[0][0] __________________________________________________________________________________________________ batch_normalization_104 (BatchN (None, 24, 24, 1024) 4096 conv2d_106[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_32 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_104[0][0] __________________________________________________________________________________________________ conv2d_107 (Conv2D) (None, 24, 24, 512) 524288 tf.nn.leaky_relu_32[0][0] __________________________________________________________________________________________________ batch_normalization_105 (BatchN (None, 24, 24, 512) 2048 conv2d_107[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_33 (TFOpLambda (None, 24, 24, 512) 0 batch_normalization_105[0][0] __________________________________________________________________________________________________ conv2d_92 (Conv2D) (None, 96, 96, 256) 294912 tf.nn.leaky_relu_19[0][0] __________________________________________________________________________________________________ conv2d_100 (Conv2D) (None, 48, 48, 512) 1179648 tf.nn.leaky_relu_26[0][0] __________________________________________________________________________________________________ conv2d_108 (Conv2D) (None, 24, 24, 1024) 4718592 tf.nn.leaky_relu_33[0][0] __________________________________________________________________________________________________ batch_normalization_92 (BatchNo (None, 96, 96, 256) 1024 conv2d_92[0][0] __________________________________________________________________________________________________ batch_normalization_99 (BatchNo (None, 48, 48, 512) 2048 conv2d_100[0][0] __________________________________________________________________________________________________ batch_normalization_106 (BatchN (None, 24, 24, 1024) 4096 conv2d_108[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_20 (TFOpLambda (None, 96, 96, 256) 0 batch_normalization_92[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_27 (TFOpLambda (None, 48, 48, 512) 0 batch_normalization_99[0][0] __________________________________________________________________________________________________ tf.nn.leaky_relu_34 (TFOpLambda (None, 24, 24, 1024) 0 batch_normalization_106[0][0] __________________________________________________________________________________________________ conv2d_93 (Conv2D) (None, 96, 96, 18) 4626 tf.nn.leaky_relu_20[0][0] __________________________________________________________________________________________________ conv2d_101 (Conv2D) (None, 48, 48, 18) 9234 tf.nn.leaky_relu_27[0][0] __________________________________________________________________________________________________ conv2d_109 (Conv2D) (None, 24, 24, 18) 18450 tf.nn.leaky_relu_34[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape (TFOpLambda) (4,) 0 conv2d_93[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape_2 (TFOpLambd (4,) 0 conv2d_101[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape_4 (TFOpLambd (4,) 0 conv2d_109[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem (Slici () 0 tf.compat.v1.shape[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem_2 (Sli () 0 tf.compat.v1.shape_2[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem_4 (Sli () 0 tf.compat.v1.shape_4[0][0] __________________________________________________________________________________________________ tf.reshape (TFOpLambda) (None, 96, 96, 3, 6) 0 conv2d_93[0][0] tf.__operators__.getitem[0][0] __________________________________________________________________________________________________ tf.reshape_1 (TFOpLambda) (None, 48, 48, 3, 6) 0 conv2d_101[0][0] tf.__operators__.getitem_2[0][0] __________________________________________________________________________________________________ tf.reshape_2 (TFOpLambda) (None, 24, 24, 3, 6) 0 conv2d_109[0][0] tf.__operators__.getitem_4[0][0] __________________________________________________________________________________________________ tf.split (TFOpLambda) [(None, 96, 96, 3, 2 0 tf.reshape[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape_1 (TFOpLambd (5,) 0 tf.reshape[0][0] __________________________________________________________________________________________________ tf.split_1 (TFOpLambda) [(None, 48, 48, 3, 2 0 tf.reshape_1[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape_3 (TFOpLambd (5,) 0 tf.reshape_1[0][0] __________________________________________________________________________________________________ tf.split_2 (TFOpLambda) [(None, 24, 24, 3, 2 0 tf.reshape_2[0][0] __________________________________________________________________________________________________ tf.compat.v1.shape_5 (TFOpLambd (5,) 0 tf.reshape_2[0][0] __________________________________________________________________________________________________ tf.math.sigmoid (TFOpLambda) (None, 96, 96, 3, 2) 0 tf.split[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem_1 (Sli () 0 tf.compat.v1.shape_1[0][0] __________________________________________________________________________________________________ tf.math.sigmoid_3 (TFOpLambda) (None, 48, 48, 3, 2) 0 tf.split_1[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem_3 (Sli () 0 tf.compat.v1.shape_3[0][0] __________________________________________________________________________________________________ tf.math.sigmoid_6 (TFOpLambda) (None, 24, 24, 3, 2) 0 tf.split_2[0][0] __________________________________________________________________________________________________ tf.__operators__.getitem_5 (Sli () 0 tf.compat.v1.shape_5[0][0] __________________________________________________________________________________________________ tf.math.multiply_72 (TFOpLambda (None, 96, 96, 3, 2) 0 tf.math.sigmoid[0][0] __________________________________________________________________________________________________ tf.tile (TFOpLambda) (None, 96, 96, 3, 2) 0 tf.__operators__.getitem_1[0][0] __________________________________________________________________________________________________ tf.math.multiply_75 (TFOpLambda (None, 48, 48, 3, 2) 0 tf.math.sigmoid_3[0][0] __________________________________________________________________________________________________ tf.tile_1 (TFOpLambda) (None, 48, 48, 3, 2) 0 tf.__operators__.getitem_3[0][0] __________________________________________________________________________________________________ tf.math.multiply_78 (TFOpLambda (None, 24, 24, 3, 2) 0 tf.math.sigmoid_6[0][0] __________________________________________________________________________________________________ tf.tile_2 (TFOpLambda) (None, 24, 24, 3, 2) 0 tf.__operators__.getitem_5[0][0] __________________________________________________________________________________________________ tf.math.subtract (TFOpLambda) (None, 96, 96, 3, 2) 0 tf.math.multiply_72[0][0] __________________________________________________________________________________________________ tf.cast (TFOpLambda) (None, 96, 96, 3, 2) 0 tf.tile[0][0] __________________________________________________________________________________________________ tf.math.subtract_1 (TFOpLambda) (None, 48, 48, 3, 2) 0 tf.math.multiply_75[0][0] __________________________________________________________________________________________________ tf.cast_1 (TFOpLambda) (None, 48, 48, 3, 2) 0 tf.tile_1[0][0] __________________________________________________________________________________________________ tf.math.subtract_2 (TFOpLambda) (None, 24, 24, 3, 2) 0 tf.math.multiply_78[0][0] __________________________________________________________________________________________________ tf.cast_2 (TFOpLambda) (None, 24, 24, 3, 2) 0 tf.tile_2[0][0] __________________________________________________________________________________________________ tf.__operators__.add_23 (TFOpLa (None, 96, 96, 3, 2) 0 tf.math.subtract[0][0] tf.cast[0][0] __________________________________________________________________________________________________ tf.math.exp (TFOpLambda) (None, 96, 96, 3, 2) 0 tf.split[0][1] __________________________________________________________________________________________________ tf.__operators__.add_24 (TFOpLa (None, 48, 48, 3, 2) 0 tf.math.subtract_1[0][0] tf.cast_1[0][0] __________________________________________________________________________________________________ tf.math.exp_1 (TFOpLambda) (None, 48, 48, 3, 2) 0 tf.split_1[0][1] __________________________________________________________________________________________________ tf.__operators__.add_25 (TFOpLa (None, 24, 24, 3, 2) 0 tf.math.subtract_2[0][0] tf.cast_2[0][0] __________________________________________________________________________________________________ tf.math.exp_2 (TFOpLambda) (None, 24, 24, 3, 2) 0 tf.split_2[0][1] __________________________________________________________________________________________________ tf.math.multiply_73 (TFOpLambda (None, 96, 96, 3, 2) 0 tf.__operators__.add_23[0][0] __________________________________________________________________________________________________ tf.math.multiply_74 (TFOpLambda (None, 96, 96, 3, 2) 0 tf.math.exp[0][0] __________________________________________________________________________________________________ tf.math.multiply_76 (TFOpLambda (None, 48, 48, 3, 2) 0 tf.__operators__.add_24[0][0] __________________________________________________________________________________________________ tf.math.multiply_77 (TFOpLambda (None, 48, 48, 3, 2) 0 tf.math.exp_1[0][0] __________________________________________________________________________________________________ tf.math.multiply_79 (TFOpLambda (None, 24, 24, 3, 2) 0 tf.__operators__.add_25[0][0] __________________________________________________________________________________________________ tf.math.multiply_80 (TFOpLambda (None, 24, 24, 3, 2) 0 tf.math.exp_2[0][0] __________________________________________________________________________________________________ tf.concat_10 (TFOpLambda) (None, 96, 96, 3, 4) 0 tf.math.multiply_73[0][0] tf.math.multiply_74[0][0] __________________________________________________________________________________________________ tf.math.sigmoid_1 (TFOpLambda) (None, 96, 96, 3, 1) 0 tf.split[0][2] __________________________________________________________________________________________________ tf.math.sigmoid_2 (TFOpLambda) (None, 96, 96, 3, 1) 0 tf.split[0][3] __________________________________________________________________________________________________ tf.concat_12 (TFOpLambda) (None, 48, 48, 3, 4) 0 tf.math.multiply_76[0][0] tf.math.multiply_77[0][0] __________________________________________________________________________________________________ tf.math.sigmoid_4 (TFOpLambda) (None, 48, 48, 3, 1) 0 tf.split_1[0][2] __________________________________________________________________________________________________ tf.math.sigmoid_5 (TFOpLambda) (None, 48, 48, 3, 1) 0 tf.split_1[0][3] __________________________________________________________________________________________________ tf.concat_14 (TFOpLambda) (None, 24, 24, 3, 4) 0 tf.math.multiply_79[0][0] tf.math.multiply_80[0][0] __________________________________________________________________________________________________ tf.math.sigmoid_7 (TFOpLambda) (None, 24, 24, 3, 1) 0 tf.split_2[0][2] __________________________________________________________________________________________________ tf.math.sigmoid_8 (TFOpLambda) (None, 24, 24, 3, 1) 0 tf.split_2[0][3] __________________________________________________________________________________________________ tf.concat_11 (TFOpLambda) (None, 96, 96, 3, 6) 0 tf.concat_10[0][0] tf.math.sigmoid_1[0][0] tf.math.sigmoid_2[0][0] __________________________________________________________________________________________________ tf.concat_13 (TFOpLambda) (None, 48, 48, 3, 6) 0 tf.concat_12[0][0] tf.math.sigmoid_4[0][0] tf.math.sigmoid_5[0][0] __________________________________________________________________________________________________ tf.concat_15 (TFOpLambda) (None, 24, 24, 3, 6) 0 tf.concat_14[0][0] tf.math.sigmoid_7[0][0] tf.math.sigmoid_8[0][0] ================================================================================================== Total params: 64,003,990 Trainable params: 63,937,686 Non-trainable params: 66,304 __________________________________________________________________________________________________ Restoring weights from: /yolov4-forum-darknet_500000.weights ...
I think you need to check the work relating to the dataset you need. including .cfg file and .txt file and so on. Just the same error I met ,but not sure if it works to you.
dalhorde
Hi every one,
I am trying to train my yolo model in TensorFlow. For now I have succeeded to convert my darknet model to a TensorFlow model. I also have run the
detect.pyscript to check if the predictions are the same between the two models and they are. Nevertheless, when I'm trying to train my model with the basicyolov4.weightsI have a strange console output. My model loads well, then I have a message sayingRestoring weights from: /yolov4.weights ...Even if I want to train the model from scratch (by not giving a value to the weights flag), the model wants to load the default value at lign 14 intrain.py(I don't know why there is a default value).And most of all, I do not understand why it is needed to have a
.weightsfile to train on tensorflow as we have convert the darknet format to tensorflow format.Here is my output :