add total params to logging

[xwli-chelsea]

Description

Add total trainable params count to logging file network_structure.txt

Fixes # (issue)

Type of change

Please delete options that are not relevant.

• [x] New feature (non-breaking change which adds functionality)

List all changes

Please list all changes in the commit.

• Added the total params count to logging

Testing

local test: network_structure.txt for toy example run:

# Trainable variables
  w_pretrained_embedding:0, (14, 32), /device:CPU:0
  cnn/query_cnn_3/kernel:0, (3, 32, 1, 50), /device:CPU:0
  cnn/query_cnn_3/bias:0, (50,), /device:CPU:0
  cnn/doc_cnn_0_3/kernel:0, (3, 32, 1, 50), /device:CPU:0
  cnn/doc_cnn_0_3/bias:0, (50,), /device:CPU:0
  wide_ftr_norm_w:0, (10,), /device:CPU:0
  wide_ftr_norm_b:0, (10,), /device:CPU:0
  hidden_projection_0/kernel:0, (11, 100), /device:CPU:0
  hidden_projection_0/bias:0, (100,), /device:CPU:0
  scoring/kernel:0, (100, 1), /device:CPU:0
  scoring/bias:0, (1,), /device:CPU:0

# Total trainable params: 11469
# Out of the total trainable params, the total cnn parameters: 9700

Test Configuration:

• Firmware version:
• Hardware:
• Toolchain:
• SDK:

Checklist

• [ ] My code follows the style guidelines of this project
• [ ] I have performed a self-review of my own code
• [ ] I have commented my code, particularly in hard-to-understand areas
• [ ] I have made corresponding changes to the documentation
• [ ] My changes generate no new warnings
• [ ] I have added tests that prove my fix is effective or that my feature works
• [ ] New and existing unit tests pass locally with my changes
• [ ] Any dependent changes have been merged and published in downstream modules

[StarWang]

LGTM. Thanks!