DwangoMediaVillage / keras_compressor

Model Compression CLI Tool for Keras.
https://nico-opendata.jp/ja/casestudy/model_compression/index.html
157 stars 39 forks source link

The model.outputs does not changed in svd compressor #18

Closed rafikg closed 5 years ago

rafikg commented 5 years ago

Model: "model_1" 'Discrepancy between trainable weights and collected trainable'


Layer (type) Output Shape Param #

input_1 (InputLayer) (None, 32, 32, 3) 0


conv2d_1 (Conv2D) (None, 32, 32, 64) 1792


batch_normalization_1 (Batch (None, 32, 32, 64) 256


dropout_1 (Dropout) (None, 32, 32, 64) 0


conv2d_2 (Conv2D) (None, 32, 32, 64) 36928


batch_normalization_2 (Batch (None, 32, 32, 64) 256


max_pooling2d_1 (MaxPooling2 (None, 16, 16, 64) 0


conv2d_3 (Conv2D) (None, 16, 16, 128) 73856


batch_normalization_3 (Batch (None, 16, 16, 128) 512


dropout_2 (Dropout) (None, 16, 16, 128) 0


conv2d_4 (Conv2D) (None, 16, 16, 128) 147584


batch_normalization_4 (Batch (None, 16, 16, 128) 512


max_pooling2d_2 (MaxPooling2 (None, 8, 8, 128) 0


conv2d_5 (Conv2D) (None, 8, 8, 256) 295168


batch_normalization_5 (Batch (None, 8, 8, 256) 1024


dropout_3 (Dropout) (None, 8, 8, 256) 0


conv2d_6 (Conv2D) (None, 8, 8, 256) 590080


batch_normalization_6 (Batch (None, 8, 8, 256) 1024


dropout_4 (Dropout) (None, 8, 8, 256) 0


conv2d_7 (Conv2D) (None, 8, 8, 256) 590080


batch_normalization_7 (Batch (None, 8, 8, 256) 1024


max_pooling2d_3 (MaxPooling2 (None, 4, 4, 256) 0


conv2d_8 (Conv2D) (None, 4, 4, 512) 1180160


batch_normalization_8 (Batch (None, 4, 4, 512) 2048


dropout_5 (Dropout) (None, 4, 4, 512) 0


conv2d_9 (Conv2D) (None, 4, 4, 512) 2359808


batch_normalization_9 (Batch (None, 4, 4, 512) 2048


dropout_6 (Dropout) (None, 4, 4, 512) 0


conv2d_10 (Conv2D) (None, 4, 4, 512) 2359808


batch_normalization_10 (Batc (None, 4, 4, 512) 2048


max_pooling2d_4 (MaxPooling2 (None, 2, 2, 512) 0


conv2d_11 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_11 (Batc (None, 2, 2, 512) 2048


dropout_7 (Dropout) (None, 2, 2, 512) 0


conv2d_12 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_12 (Batc (None, 2, 2, 512) 2048


dropout_8 (Dropout) (None, 2, 2, 512) 0


conv2d_13 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_13 (Batc (None, 2, 2, 512) 2048


max_pooling2d_5 (MaxPooling2 (None, 1, 1, 512) 0


flatten_1 (Flatten) (None, 512) 0


dropout_9 (Dropout) (None, 512) 0


dense_1 (FactorizedDense) (None, 512) 193024


batch_normalization_14 (Batc (None, 512) 2048


dropout_10 (Dropout) (None, 512) 0


dense_2 (FactorizedDense) (None, 10) 4186

Total params: 15,001,418 Trainable params: 14,991,946 Non-trainable params: 9,472


Model: "model_1"


Layer (type) Output Shape Param #

input_1 (InputLayer) (None, 32, 32, 3) 0


conv2d_1 (Conv2D) (None, 32, 32, 64) 1792


batch_normalization_1 (Batch (None, 32, 32, 64) 256


dropout_1 (Dropout) (None, 32, 32, 64) 0


conv2d_2 (Conv2D) (None, 32, 32, 64) 36928


batch_normalization_2 (Batch (None, 32, 32, 64) 256


max_pooling2d_1 (MaxPooling2 (None, 16, 16, 64) 0


conv2d_3 (Conv2D) (None, 16, 16, 128) 73856


batch_normalization_3 (Batch (None, 16, 16, 128) 512


dropout_2 (Dropout) (None, 16, 16, 128) 0


conv2d_4 (Conv2D) (None, 16, 16, 128) 147584


batch_normalization_4 (Batch (None, 16, 16, 128) 512


max_pooling2d_2 (MaxPooling2 (None, 8, 8, 128) 0


conv2d_5 (Conv2D) (None, 8, 8, 256) 295168


batch_normalization_5 (Batch (None, 8, 8, 256) 1024


dropout_3 (Dropout) (None, 8, 8, 256) 0


conv2d_6 (Conv2D) (None, 8, 8, 256) 590080


batch_normalization_6 (Batch (None, 8, 8, 256) 1024


dropout_4 (Dropout) (None, 8, 8, 256) 0


conv2d_7 (Conv2D) (None, 8, 8, 256) 590080


batch_normalization_7 (Batch (None, 8, 8, 256) 1024


max_pooling2d_3 (MaxPooling2 (None, 4, 4, 256) 0


conv2d_8 (Conv2D) (None, 4, 4, 512) 1180160


batch_normalization_8 (Batch (None, 4, 4, 512) 2048


dropout_5 (Dropout) (None, 4, 4, 512) 0


conv2d_9 (Conv2D) (None, 4, 4, 512) 2359808


batch_normalization_9 (Batch (None, 4, 4, 512) 2048


dropout_6 (Dropout) (None, 4, 4, 512) 0


conv2d_10 (Conv2D) (None, 4, 4, 512) 2359808


batch_normalization_10 (Batc (None, 4, 4, 512) 2048


max_pooling2d_4 (MaxPooling2 (None, 2, 2, 512) 0


conv2d_11 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_11 (Batc (None, 2, 2, 512) 2048


dropout_7 (Dropout) (None, 2, 2, 512) 0


conv2d_12 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_12 (Batc (None, 2, 2, 512) 2048


dropout_8 (Dropout) (None, 2, 2, 512) 0


conv2d_13 (Conv2D) (None, 2, 2, 512) 2359808


batch_normalization_13 (Batc (None, 2, 2, 512) 2048


max_pooling2d_5 (MaxPooling2 (None, 1, 1, 512) 0


flatten_1 (Flatten) (None, 512) 0


dropout_9 (Dropout) (None, 512) 0


dense_1 (FactorizedDense) (None, 512) 193024


batch_normalization_14 (Batc (None, 512) 2048


dropout_10 (Dropout) (None, 512) 0


dense_2 (Dense) (None, 10) 5130

Total params: 14,931,786 Trainable params: 14,922,314 Non-trainable params: 9,472