search

tensorflow / lucid

A collection of infrastructure and tools for research in neural network interpretability.
Apache License 2.0
4.67k stars 655 forks source link

How to visualize CLIP neurons using Lucid? #284

Closed Tylersuard closed 3 years ago

Tylersuard commented 3 years ago

Hello, I've gotten some great results using Lucid to visualize other neural networks like InceptionV1. I usually use the name of the layer and the number of the neuron I want to visualize. You list CLIP as a model option, but it has no layers in the script... how do I visualize CLIP?

Thank you

colah commented 3 years ago

Some lucid models have metadata like layers associated. That metadata isn't necessary to visualize them. You can just enter layer names as strings.

With that said, you might find it easier to just use the code OpenAI provides: https://github.com/openai/CLIP-featurevis

hgw3lls commented 3 years ago

[u'Variable', u'Variable/read', u'Variable_1', u'Variable_1/read', u'Variable_2', u'Variable_2/read', u'Variable_3', u'Variable_3/read', u'Variable_4', u'Variable_4/read', u'Variable_5', u'Variable_5/read', u'Variable_6', u'Variable_6/read', u'Variable_7', u'Variable_7/read', u'Variable_8', u'Variable_8/read', u'Variable_9', u'Variable_9/read', u'Variable_10', u'Variable_10/read', u'Variable_11', u'Variable_11/read', u'Variable_12', u'Variable_12/read', u'Variable_13', u'Variable_13/read', u'Variable_14', u'Variable_14/read', u'Variable_15', u'Variable_15/read', u'Variable_16', u'Variable_16/read', u'Variable_17', u'Variable_17/read', u'Variable_18', u'Variable_18/read', u'Variable_19', u'Variable_19/read', u'Variable_20', u'Variable_20/read', u'Variable_21', u'Variable_21/read', u'Variable_22', u'Variable_22/read', u'Variable_23', u'Variable_23/read', u'Variable_24', u'Variable_24/read', u'Variable_25', u'Variable_25/read', u'Variable_26', u'Variable_26/read', u'Variable_27', u'Variable_27/read', u'Variable_28', u'Variable_28/read', u'Variable_29', u'Variable_29/read', u'Variable_30', u'Variable_30/read', u'Variable_31', u'Variable_31/read', u'Variable_32', u'Variable_32/read', u'Variable_33', u'Variable_33/read', u'Variable_34', u'Variable_34/read', u'Variable_35', u'Variable_35/read', u'Variable_36', u'Variable_36/read', u'Variable_37', u'Variable_37/read', u'Variable_38', u'Variable_38/read', u'Variable_39', u'Variable_39/read', u'Variable_40', u'Variable_40/read', u'Variable_41', u'Variable_41/read', u'Variable_42', u'Variable_42/read', u'Variable_43', u'Variable_43/read', u'Variable_44', u'Variable_44/read', u'Variable_45', u'Variable_45/read', u'Variable_46', u'Variable_46/read', u'Variable_47', u'Variable_47/read', u'Variable_48', u'Variable_48/read', u'Variable_49', u'Variable_49/read', u'Variable_50', u'Variable_50/read', u'Variable_51', u'Variable_51/read', u'Variable_52', u'Variable_52/read', u'Variable_53', u'Variable_53/read', u'Variable_54', u'Variable_54/read', u'Variable_55', u'Variable_55/read', u'Variable_56', u'Variable_56/read', u'Variable_57', u'Variable_57/read', u'Variable_58', u'Variable_58/read', u'Variable_59', u'Variable_59/read', u'Variable_60', u'Variable_60/read', u'Variable_61', u'Variable_61/read', u'Variable_62', u'Variable_62/read', u'Variable_63', u'Variable_63/read', u'Variable_64', u'Variable_64/read', u'Variable_65', u'Variable_65/read', u'Variable_66', u'Variable_66/read', u'Variable_67', u'Variable_67/read', u'Variable_68', u'Variable_68/read', u'Variable_69', u'Variable_69/read', u'Variable_70', u'Variable_70/read', u'Variable_71', u'Variable_71/read', u'Variable_72', u'Variable_72/read', u'Variable_73', u'Variable_73/read', u'Variable_74', u'Variable_74/read', u'Variable_75', u'Variable_75/read', u'Variable_76', u'Variable_76/read', u'Variable_77', u'Variable_77/read', u'Variable_78', u'Variable_78/read', u'Variable_79', u'Variable_79/read', u'Variable_80', u'Variable_80/read', u'Variable_81', u'Variable_81/read', u'Variable_82', u'Variable_82/read', u'Variable_83', u'Variable_83/read', u'Variable_84', u'Variable_84/read', u'Variable_85', u'Variable_85/read', u'Variable_86', u'Variable_86/read', u'Variable_87', u'Variable_87/read', u'Variable_88', u'Variable_88/read', u'Variable_89', u'Variable_89/read', u'Variable_90', u'Variable_90/read', u'Variable_91', u'Variable_91/read', u'Variable_92', u'Variable_92/read', u'Variable_93', u'Variable_93/read', u'Variable_94', u'Variable_94/read', u'Variable_95', u'Variable_95/read', u'Variable_96', u'Variable_96/read', u'Variable_97', u'Variable_97/read', u'Variable_98', u'Variable_98/read', u'Variable_99', u'Variable_99/read', u'Variable_100', u'Variable_100/read', u'Variable_101', u'Variable_101/read', u'Variable_102', u'Variable_102/read', u'Variable_103', u'Variable_103/read', u'Variable_104', u'Variable_104/read', u'Variable_105', u'Variable_105/read', u'Variable_106', u'Variable_106/read', u'Variable_107', u'Variable_107/read', u'Variable_108', u'Variable_108/read', u'Variable_109', u'Variable_109/read', u'Variable_110', u'Variable_110/read', u'Variable_111', u'Variable_111/read', u'Variable_112', u'Variable_112/read', u'Variable_113', u'Variable_113/read', u'Variable_114', u'Variable_114/read', u'Variable_115', u'Variable_115/read', u'Variable_116', u'Variable_116/read', u'Variable_117', u'Variable_117/read', u'Variable_118', u'Variable_118/read', u'Variable_119', u'Variable_119/read', u'Variable_120', u'Variable_120/read', u'Variable_121', u'Variable_121/read', u'Variable_122', u'Variable_122/read', u'Variable_123', u'Variable_123/read', u'Variable_124', u'Variable_124/read', u'Variable_125', u'Variable_125/read', u'Variable_126', u'Variable_126/read', u'Variable_127', u'Variable_127/read', u'Variable_128', u'Variable_128/read', u'Variable_129', u'Variable_129/read', u'Variable_130', u'Variable_130/read', u'Variable_131', u'Variable_131/read', u'Variable_132', u'Variable_132/read', u'Variable_133', u'Variable_133/read', u'Variable_134', u'Variable_134/read', u'Variable_135', u'Variable_135/read', u'Variable_136', u'Variable_136/read', u'Variable_137', u'Variable_137/read', u'Variable_138', u'Variable_138/read', u'Variable_139', u'Variable_139/read', u'Variable_140', u'Variable_140/read', u'Variable_141', u'Variable_141/read', u'Variable_142', u'Variable_142/read', u'Variable_143', u'Variable_143/read', u'Variable_144', u'Variable_144/read', u'Variable_145', u'Variable_145/read', u'Variable_146', u'Variable_146/read', u'Variable_147', u'Variable_147/read', u'Variable_148', u'Variable_148/read', u'Variable_149', u'Variable_149/read', u'Variable_150', u'Variable_150/read', u'Variable_151', u'Variable_151/read', u'Variable_152', u'Variable_152/read', u'Variable_153', u'Variable_153/read', u'Variable_154', u'Variable_154/read', u'Variable_155', u'Variable_155/read', u'Variable_156', u'Variable_156/read', u'Variable_157', u'Variable_157/read', u'Variable_158', u'Variable_158/read', u'Variable_159', u'Variable_159/read', u'Variable_160', u'Variable_160/read', u'Variable_161', u'Variable_161/read', u'Variable_162', u'Variable_162/read', u'Variable_163', u'Variable_163/read', u'Variable_164', u'Variable_164/read', u'Variable_165', u'Variable_165/read', u'Variable_166', u'Variable_166/read', u'Variable_167', u'Variable_167/read', u'Variable_168', u'Variable_168/read', u'Variable_169', u'Variable_169/read', u'input_image', u'transpose/perm', u'transpose', u'Variable_170', u'Variable_170/read', u'Variable_171', u'Variable_171/read', u'Reshape/shape', u'Reshape', u'Reshape_1/shape', u'Reshape_1', u'sub_2', u'truediv_1', u'image_pre/c1/w', u'image_pre/c1/w/read', u'image_pre/c1/Pad/paddings', u'image_pre/c1/Pad', u'image_pre/c1/Conv2D', u'image_pre/bn1/g', u'image_pre/bn1/g/read', u'image_pre/bn1/b', u'image_pre/bn1/b/read', u'image_pre/Reshape/shape', u'image_pre/Reshape', u'image_pre/Reshape_1/shape', u'image_pre/Reshape_1', u'image_pre/Reshape_2/shape', u'image_pre/Reshape_2', u'image_pre/Reshape_3/shape', u'image_pre/Reshape_3', u'image_pre/sub', u'image_pre/add/y', u'image_pre/add', u'image_pre/Rsqrt', u'image_pre/mul', u'image_pre/mul_1', u'image_pre/add_1', u'image_pre/Relu', u'image_pre/c2/w', u'image_pre/c2/w/read', u'image_pre/c2/Conv2D', u'image_pre/bn2/g', u'image_pre/bn2/g/read', u'image_pre/bn2/b', u'image_pre/bn2/b/read', u'image_pre/Reshape_4/shape', u'image_pre/Reshape_4', u'image_pre/Reshape_5/shape', u'image_pre/Reshape_5', u'image_pre/Reshape_6/shape', u'image_pre/Reshape_6', u'image_pre/Reshape_7/shape', u'image_pre/Reshape_7', u'image_pre/sub_1', u'image_pre/add_2/y', u'image_pre/add_2', u'image_pre/Rsqrt_1', u'image_pre/mul_2', u'image_pre/mul_3', u'image_pre/add_3', u'image_pre/Relu_1', u'image_pre/c3/w', u'image_pre/c3/w/read', u'image_pre/c3/Conv2D', u'image_pre/bn3/g', u'image_pre/bn3/g/read', u'image_pre/bn3/b', u'image_pre/bn3/b/read', u'image_pre/Reshape_8/shape', u'image_pre/Reshape_8', u'image_pre/Reshape_9/shape', u'image_pre/Reshape_9', u'image_pre/Reshape_10/shape', u'image_pre/Reshape_10', u'image_pre/Reshape_11/shape', u'image_pre/Reshape_11', u'image_pre/sub_2', u'image_pre/add_4/y', u'image_pre/add_4', u'image_pre/Rsqrt_2', u'image_pre/mul_4', u'image_pre/mul_5', u'image_pre/add_5', u'image_pre/Relu_2', u'image_pre/AvgPool', u'image_block_1/0/c1/w', u'image_block_1/0/c1/w/read', u'image_block_1/0/c1/Conv2D', u'image_block_1/0/bn1/g', u'image_block_1/0/bn1/g/read', u'image_block_1/0/bn1/b', u'image_block_1/0/bn1/b/read', u'image_block_1/0/Reshape/shape', u'image_block_1/0/Reshape', u'image_block_1/0/Reshape_1/shape', u'image_block_1/0/Reshape_1', u'image_block_1/0/Reshape_2/shape', u'image_block_1/0/Reshape_2', u'image_block_1/0/Reshape_3/shape', u'image_block_1/0/Reshape_3', u'image_block_1/0/sub', u'image_block_1/0/add/y', u'image_block_1/0/add', u'image_block_1/0/Rsqrt', u'image_block_1/0/mul', u'image_block_1/0/mul_1', u'image_block_1/0/add_1', u'image_block_1/0/Relu', u'image_block_1/0/c2/w', u'image_block_1/0/c2/w/read', u'image_block_1/0/c2/Conv2D', u'image_block_1/0/bn2/g', u'image_block_1/0/bn2/g/read', u'image_block_1/0/bn2/b', u'image_block_1/0/bn2/b/read', u'image_block_1/0/Reshape_4/shape', u'image_block_1/0/Reshape_4', u'image_block_1/0/Reshape_5/shape', u'image_block_1/0/Reshape_5', u'image_block_1/0/Reshape_6/shape', u'image_block_1/0/Reshape_6', u'image_block_1/0/Reshape_7/shape', u'image_block_1/0/Reshape_7', u'image_block_1/0/sub_1', u'image_block_1/0/add_2/y', u'image_block_1/0/add_2', u'image_block_1/0/Rsqrt_1', u'image_block_1/0/mul_2', u'image_block_1/0/mul_3', u'image_block_1/0/add_3', u'image_block_1/0/Relu_1', u'image_block_1/0/c3/w', u'image_block_1/0/c3/w/read', u'image_block_1/0/c3/Conv2D', u'image_block_1/0/bn3/g', u'image_block_1/0/bn3/g/read', u'image_block_1/0/bn3/b', u'image_block_1/0/bn3/b/read', u'image_block_1/0/Reshape_8/shape', u'image_block_1/0/Reshape_8', u'image_block_1/0/Reshape_9/shape', u'image_block_1/0/Reshape_9', u'image_block_1/0/Reshape_10/shape', u'image_block_1/0/Reshape_10', u'image_block_1/0/Reshape_11/shape', u'image_block_1/0/Reshape_11', u'image_block_1/0/sub_2', u'image_block_1/0/add_4/y', u'image_block_1/0/add_4', u'image_block_1/0/Rsqrt_2', u'image_block_1/0/mul_4', u'image_block_1/0/mul_5', u'image_block_1/0/add_5', u'image_block_1/0/proj_c1/w', u'image_block_1/0/proj_c1/w/read', u'image_block_1/0/proj_c1/Conv2D', u'image_block_1/0/proj_bn1/g', u'image_block_1/0/proj_bn1/g/read', u'image_block_1/0/proj_bn1/b', u'image_block_1/0/proj_bn1/b/read', u'image_block_1/0/Reshape_12/shape', u'image_block_1/0/Reshape_12', u'image_block_1/0/Reshape_13/shape', u'image_block_1/0/Reshape_13', u'image_block_1/0/Reshape_14/shape', u'image_block_1/0/Reshape_14', u'image_block_1/0/Reshape_15/shape', u'image_block_1/0/Reshape_15', u'image_block_1/0/sub_3', u'image_block_1/0/add_6/y', u'image_block_1/0/add_6', u'image_block_1/0/Rsqrt_3', u'image_block_1/0/mul_6', u'image_block_1/0/mul_7', u'image_block_1/0/add_7', u'image_block_1/0/add_8', u'image_block_1/0/Relu_2', u'image_block_1/1/c1/w', u'image_block_1/1/c1/w/read', u'image_block_1/1/c1/Conv2D', u'image_block_1/1/bn1/g', u'image_block_1/1/bn1/g/read', u'image_block_1/1/bn1/b', u'image_block_1/1/bn1/b/read', u'image_block_1/1/Reshape/shape', u'image_block_1/1/Reshape', u'image_block_1/1/Reshape_1/shape', u'image_block_1/1/Reshape_1', u'image_block_1/1/Reshape_2/shape', u'image_block_1/1/Reshape_2', u'image_block_1/1/Reshape_3/shape', u'image_block_1/1/Reshape_3', u'image_block_1/1/sub', u'image_block_1/1/add/y', u'image_block_1/1/add', u'image_block_1/1/Rsqrt', u'image_block_1/1/mul', u'image_block_1/1/mul_1', u'image_block_1/1/add_1', u'image_block_1/1/Relu', u'image_block_1/1/c2/w', u'image_block_1/1/c2/w/read', u'image_block_1/1/c2/Conv2D', u'image_block_1/1/bn2/g', u'image_block_1/1/bn2/g/read', u'image_block_1/1/bn2/b', u'image_block_1/1/bn2/b/read', u'image_block_1/1/Reshape_4/shape', u'image_block_1/1/Reshape_4', u'image_block_1/1/Reshape_5/shape', u'image_block_1/1/Reshape_5', u'image_block_1/1/Reshape_6/shape', u'image_block_1/1/Reshape_6', u'image_block_1/1/Reshape_7/shape', u'image_block_1/1/Reshape_7', u'image_block_1/1/sub_1', u'image_block_1/1/add_2/y', u'image_block_1/1/add_2', u'image_block_1/1/Rsqrt_1', u'image_block_1/1/mul_2', u'image_block_1/1/mul_3', u'image_block_1/1/add_3', u'image_block_1/1/Relu_1', u'image_block_1/1/c3/w', u'image_block_1/1/c3/w/read', u'image_block_1/1/c3/Conv2D', u'image_block_1/1/bn3/g', u'image_block_1/1/bn3/g/read', u'image_block_1/1/bn3/b', u'image_block_1/1/bn3/b/read', u'image_block_1/1/Reshape_8/shape', u'image_block_1/1/Reshape_8', u'image_block_1/1/Reshape_9/shape', u'image_block_1/1/Reshape_9', u'image_block_1/1/Reshape_10/shape', u'image_block_1/1/Reshape_10', u'image_block_1/1/Reshape_11/shape', u'image_block_1/1/Reshape_11', u'image_block_1/1/sub_2', u'image_block_1/1/add_4/y', u'image_block_1/1/add_4', u'image_block_1/1/Rsqrt_2', u'image_block_1/1/mul_4', u'image_block_1/1/mul_5', u'image_block_1/1/add_5', u'image_block_1/1/add_6', u'image_block_1/1/Relu_2', u'image_block_1/2/c1/w', u'image_block_1/2/c1/w/read', u'image_block_1/2/c1/Conv2D', u'image_block_1/2/bn1/g', u'image_block_1/2/bn1/g/read', u'image_block_1/2/bn1/b', u'image_block_1/2/bn1/b/read', u'image_block_1/2/Reshape/shape', u'image_block_1/2/Reshape', u'image_block_1/2/Reshape_1/shape', u'image_block_1/2/Reshape_1', u'image_block_1/2/Reshape_2/shape', u'image_block_1/2/Reshape_2', u'image_block_1/2/Reshape_3/shape', u'image_block_1/2/Reshape_3', u'image_block_1/2/sub', u'image_block_1/2/add/y', u'image_block_1/2/add', u'image_block_1/2/Rsqrt', u'image_block_1/2/mul', u'image_block_1/2/mul_1', u'image_block_1/2/add_1', u'image_block_1/2/Relu', u'image_block_1/2/c2/w', u'image_block_1/2/c2/w/read', u'image_block_1/2/c2/Conv2D', u'image_block_1/2/bn2/g', u'image_block_1/2/bn2/g/read', u'image_block_1/2/bn2/b', u'image_block_1/2/bn2/b/read', u'image_block_1/2/Reshape_4/shape', u'image_block_1/2/Reshape_4', u'image_block_1/2/Reshape_5/shape', u'image_block_1/2/Reshape_5', u'image_block_1/2/Reshape_6/shape', u'image_block_1/2/Reshape_6', u'image_block_1/2/Reshape_7/shape', u'image_block_1/2/Reshape_7', u'image_block_1/2/sub_1', u'image_block_1/2/add_2/y', u'image_block_1/2/add_2', u'image_block_1/2/Rsqrt_1', u'image_block_1/2/mul_2', u'image_block_1/2/mul_3', u'image_block_1/2/add_3', u'image_block_1/2/Relu_1', u'image_block_1/2/c3/w', u'image_block_1/2/c3/w/read', u'image_block_1/2/c3/Conv2D', u'image_block_1/2/bn3/g', u'image_block_1/2/bn3/g/read', u'image_block_1/2/bn3/b', u'image_block_1/2/bn3/b/read', u'image_block_1/2/Reshape_8/shape', u'image_block_1/2/Reshape_8', u'image_block_1/2/Reshape_9/shape', u'image_block_1/2/Reshape_9', u'image_block_1/2/Reshape_10/shape', u'image_block_1/2/Reshape_10', u'image_block_1/2/Reshape_11/shape', u'image_block_1/2/Reshape_11', u'image_block_1/2/sub_2', u'image_block_1/2/add_4/y', u'image_block_1/2/add_4', u'image_block_1/2/Rsqrt_2', u'image_block_1/2/mul_4', u'image_block_1/2/mul_5', u'image_block_1/2/add_5', u'image_block_1/2/add_6', u'image_block_1/2/Relu_2', u'image_block_1/3/c1/w', u'image_block_1/3/c1/w/read', u'image_block_1/3/c1/Conv2D', u'image_block_1/3/bn1/g', u'image_block_1/3/bn1/g/read', u'image_block_1/3/bn1/b', u'image_block_1/3/bn1/b/read', u'image_block_1/3/Reshape/shape', u'image_block_1/3/Reshape', u'image_block_1/3/Reshape_1/shape', u'image_block_1/3/Reshape_1', u'image_block_1/3/Reshape_2/shape', u'image_block_1/3/Reshape_2', u'image_block_1/3/Reshape_3/shape', u'image_block_1/3/Reshape_3', u'image_block_1/3/sub', u'image_block_1/3/add/y', u'image_block_1/3/add', u'image_block_1/3/Rsqrt', u'image_block_1/3/mul', u'image_block_1/3/mul_1', u'image_block_1/3/add_1', u'image_block_1/3/Relu', u'image_block_1/3/c2/w', u'image_block_1/3/c2/w/read', u'image_block_1/3/c2/Conv2D', u'image_block_1/3/bn2/g', u'image_block_1/3/bn2/g/read', u'image_block_1/3/bn2/b', u'image_block_1/3/bn2/b/read', u'image_block_1/3/Reshape_4/shape', u'image_block_1/3/Reshape_4', u'image_block_1/3/Reshape_5/shape', u'image_block_1/3/Reshape_5', u'image_block_1/3/Reshape_6/shape', u'image_block_1/3/Reshape_6', u'image_block_1/3/Reshape_7/shape', u'image_block_1/3/Reshape_7', u'image_block_1/3/sub_1', u'image_block_1/3/add_2/y', u'image_block_1/3/add_2', u'image_block_1/3/Rsqrt_1', u'image_block_1/3/mul_2', u'image_block_1/3/mul_3', u'image_block_1/3/add_3', u'image_block_1/3/Relu_1', u'image_block_1/3/c3/w', u'image_block_1/3/c3/w/read', u'image_block_1/3/c3/Conv2D', u'image_block_1/3/bn3/g', u'image_block_1/3/bn3/g/read', u'image_block_1/3/bn3/b', u'image_block_1/3/bn3/b/read', u'image_block_1/3/Reshape_8/shape', u'image_block_1/3/Reshape_8', u'image_block_1/3/Reshape_9/shape', u'image_block_1/3/Reshape_9', u'image_block_1/3/Reshape_10/shape', u'image_block_1/3/Reshape_10', u'image_block_1/3/Reshape_11/shape', u'image_block_1/3/Reshape_11', u'image_block_1/3/sub_2', u'image_block_1/3/add_4/y', u'image_block_1/3/add_4', u'image_block_1/3/Rsqrt_2', u'image_block_1/3/mul_4', u'image_block_1/3/mul_5', u'image_block_1/3/add_5', u'image_block_1/3/add_6', u'image_block_1/3/Relu_2', u'image_block_2/0/c1/w', u'image_block_2/0/c1/w/read', u'image_block_2/0/c1/Conv2D', u'image_block_2/0/bn1/g', u'image_block_2/0/bn1/g/read', u'image_block_2/0/bn1/b', u'image_block_2/0/bn1/b/read', u'image_block_2/0/Reshape/shape', u'image_block_2/0/Reshape', u'image_block_2/0/Reshape_1/shape', u'image_block_2/0/Reshape_1', u'image_block_2/0/Reshape_2/shape', u'image_block_2/0/Reshape_2', u'image_block_2/0/Reshape_3/shape', u'image_block_2/0/Reshape_3', u'image_block_2/0/sub', u'image_block_2/0/add/y', u'image_block_2/0/add', u'image_block_2/0/Rsqrt', u'image_block_2/0/mul', u'image_block_2/0/mul_1', u'image_block_2/0/add_1', u'image_block_2/0/Relu', u'image_block_2/0/c2/w', u'image_block_2/0/c2/w/read', u'image_block_2/0/c2/Conv2D', u'image_block_2/0/bn2/g', u'image_block_2/0/bn2/g/read', u'image_block_2/0/bn2/b', u'image_block_2/0/bn2/b/read', u'image_block_2/0/Reshape_4/shape', u'image_block_2/0/Reshape_4', u'image_block_2/0/Reshape_5/shape', u'image_block_2/0/Reshape_5', u'image_block_2/0/Reshape_6/shape', u'image_block_2/0/Reshape_6', u'image_block_2/0/Reshape_7/shape', u'image_block_2/0/Reshape_7', u'image_block_2/0/sub_1', u'image_block_2/0/add_2/y', u'image_block_2/0/add_2', u'image_block_2/0/Rsqrt_1', u'image_block_2/0/mul_2', u'image_block_2/0/mul_3', u'image_block_2/0/add_3', u'image_block_2/0/Relu_1', u'image_block_2/0/AvgPool', u'image_block_2/0/c3/w', u'image_block_2/0/c3/w/read', u'image_block_2/0/c3/Conv2D', u'image_block_2/0/bn3/g', u'image_block_2/0/bn3/g/read', u'image_block_2/0/bn3/b', u'image_block_2/0/bn3/b/read', u'image_block_2/0/Reshape_8/shape', u'image_block_2/0/Reshape_8', u'image_block_2/0/Reshape_9/shape', u'image_block_2/0/Reshape_9', u'image_block_2/0/Reshape_10/shape', u'image_block_2/0/Reshape_10', u'image_block_2/0/Reshape_11/shape', u'image_block_2/0/Reshape_11', u'image_block_2/0/sub_2', u'image_block_2/0/add_4/y', u'image_block_2/0/add_4', u'image_block_2/0/Rsqrt_2', u'image_block_2/0/mul_4', u'image_block_2/0/mul_5', u'image_block_2/0/add_5', u'image_block_2/0/AvgPool_1', u'image_block_2/0/proj_c1/w', u'image_block_2/0/proj_c1/w/read', u'image_block_2/0/proj_c1/Conv2D', u'image_block_2/0/proj_bn1/g', u'image_block_2/0/proj_bn1/g/read', u'image_block_2/0/proj_bn1/b', u'image_block_2/0/proj_bn1/b/read', u'image_block_2/0/Reshape_12/shape', u'image_block_2/0/Reshape_12', u'image_block_2/0/Reshape_13/shape', u'image_block_2/0/Reshape_13', u'image_block_2/0/Reshape_14/shape', u'image_block_2/0/Reshape_14', u'image_block_2/0/Reshape_15/shape', u'image_block_2/0/Reshape_15', u'image_block_2/0/sub_3', u'image_block_2/0/add_6/y', u'image_block_2/0/add_6', u'image_block_2/0/Rsqrt_3', u'image_block_2/0/mul_6', u'image_block_2/0/mul_7', u'image_block_2/0/add_7', u'image_block_2/0/add_8', u'image_block_2/0/Relu_2', u'image_block_2/1/c1/w', u'image_block_2/1/c1/w/read', u'image_block_2/1/c1/Conv2D', u'image_block_2/1/bn1/g', u'image_block_2/1/bn1/g/read', u'image_block_2/1/bn1/b', u'image_block_2/1/bn1/b/read', u'image_block_2/1/Reshape/shape', u'image_block_2/1/Reshape', u'image_block_2/1/Reshape_1/shape', u'image_block_2/1/Reshape_1', u'image_block_2/1/Reshape_2/shape', u'image_block_2/1/Reshape_2', u'image_block_2/1/Reshape_3/shape', u'image_block_2/1/Reshape_3', u'image_block_2/1/sub', u'image_block_2/1/add/y', u'image_block_2/1/add', u'image_block_2/1/Rsqrt', u'image_block_2/1/mul', u'image_block_2/1/mul_1', u'image_block_2/1/add_1', u'image_block_2/1/Relu', u'image_block_2/1/c2/w', u'image_block_2/1/c2/w/read', u'image_block_2/1/c2/Conv2D', u'image_block_2/1/bn2/g', u'image_block_2/1/bn2/g/read', u'image_block_2/1/bn2/b', u'image_block_2/1/bn2/b/read', u'image_block_2/1/Reshape_4/shape', u'image_block_2/1/Reshape_4', u'image_block_2/1/Reshape_5/shape', u'image_block_2/1/Reshape_5', u'image_block_2/1/Reshape_6/shape', u'image_block_2/1/Reshape_6', u'image_block_2/1/Reshape_7/shape', u'image_block_2/1/Reshape_7', u'image_block_2/1/sub_1', u'image_block_2/1/add_2/y', u'image_block_2/1/add_2', u'image_block_2/1/Rsqrt_1', u'image_block_2/1/mul_2', u'image_block_2/1/mul_3', u'image_block_2/1/add_3', u'image_block_2/1/Relu_1', u'image_block_2/1/c3/w', u'image_block_2/1/c3/w/read', u'image_block_2/1/c3/Conv2D', u'image_block_2/1/bn3/g', u'image_block_2/1/bn3/g/read', u'image_block_2/1/bn3/b', u'image_block_2/1/bn3/b/read', u'image_block_2/1/Reshape_8/shape', u'image_block_2/1/Reshape_8', u'image_block_2/1/Reshape_9/shape', u'image_block_2/1/Reshape_9', u'image_block_2/1/Reshape_10/shape', u'image_block_2/1/Reshape_10', u'image_block_2/1/Reshape_11/shape', u'image_block_2/1/Reshape_11', u'image_block_2/1/sub_2', u'image_block_2/1/add_4/y', u'image_block_2/1/add_4', u'image_block_2/1/Rsqrt_2', u'image_block_2/1/mul_4', u'image_block_2/1/mul_5', u'image_block_2/1/add_5', u'image_block_2/1/add_6', u'image_block_2/1/Relu_2', u'image_block_2/2/c1/w', u'image_block_2/2/c1/w/read', u'image_block_2/2/c1/Conv2D', u'image_block_2/2/bn1/g', u'image_block_2/2/bn1/g/read', u'image_block_2/2/bn1/b', u'image_block_2/2/bn1/b/read', u'image_block_2/2/Reshape/shape', u'image_block_2/2/Reshape', u'image_block_2/2/Reshape_1/shape', u'image_block_2/2/Reshape_1', u'image_block_2/2/Reshape_2/shape', u'image_block_2/2/Reshape_2', u'image_block_2/2/Reshape_3/shape', u'image_block_2/2/Reshape_3', u'image_block_2/2/sub', u'image_block_2/2/add/y', u'image_block_2/2/add', u'image_block_2/2/Rsqrt', u'image_block_2/2/mul', u'image_block_2/2/mul_1', u'image_block_2/2/add_1', u'image_block_2/2/Relu', u'image_block_2/2/c2/w', u'image_block_2/2/c2/w/read', u'image_block_2/2/c2/Conv2D', u'image_block_2/2/bn2/g', u'image_block_2/2/bn2/g/read', u'image_block_2/2/bn2/b', u'image_block_2/2/bn2/b/read', u'image_block_2/2/Reshape_4/shape', u'image_block_2/2/Reshape_4', u'image_block_2/2/Reshape_5/shape', u'image_block_2/2/Reshape_5', u'image_block_2/2/Reshape_6/shape', u'image_block_2/2/Reshape_6', u'image_block_2/2/Reshape_7/shape', u'image_block_2/2/Reshape_7', u'image_block_2/2/sub_1', u'image_block_2/2/add_2/y', u'image_block_2/2/add_2', u'image_block_2/2/Rsqrt_1', u'image_block_2/2/mul_2', u'image_block_2/2/mul_3', u'image_block_2/2/add_3', u'image_block_2/2/Relu_1', u'image_block_2/2/c3/w', u'image_block_2/2/c3/w/read', u'image_block_2/2/c3/Conv2D', u'image_block_2/2/bn3/g', u'image_block_2/2/bn3/g/read', u'image_block_2/2/bn3/b', u'image_block_2/2/bn3/b/read', u'image_block_2/2/Reshape_8/shape', u'image_block_2/2/Reshape_8', u'image_block_2/2/Reshape_9/shape', u'image_block_2/2/Reshape_9', u'image_block_2/2/Reshape_10/shape', u'image_block_2/2/Reshape_10', u'image_block_2/2/Reshape_11/shape', u'image_block_2/2/Reshape_11', u'image_block_2/2/sub_2', u'image_block_2/2/add_4/y', u'image_block_2/2/add_4', u'image_block_2/2/Rsqrt_2', u'image_block_2/2/mul_4', u'image_block_2/2/mul_5', u'image_block_2/2/add_5', u'image_block_2/2/add_6', u'image_block_2/2/Relu_2', u'image_block_2/3/c1/w', u'image_block_2/3/c1/w/read', u'image_block_2/3/c1/Conv2D', u'image_block_2/3/bn1/g', u'image_block_2/3/bn1/g/read', u'image_block_2/3/bn1/b', u'image_block_2/3/bn1/b/read', u'image_block_2/3/Reshape/shape', u'image_block_2/3/Reshape', u'image_block_2/3/Reshape_1/shape', u'image_block_2/3/Reshape_1', u'image_block_2/3/Reshape_2/shape', u'image_block_2/3/Reshape_2', u'image_block_2/3/Reshape_3/shape', u'image_block_2/3/Reshape_3', u'image_block_2/3/sub', u'image_block_2/3/add/y', u'image_block_2/3/add', u'image_block_2/3/Rsqrt', u'image_block_2/3/mul', u'image_block_2/3/mul_1', u'image_block_2/3/add_1', u'image_block_2/3/Relu', u'image_block_2/3/c2/w', u'image_block_2/3/c2/w/read', u'image_block_2/3/c2/Conv2D', u'image_block_2/3/bn2/g', u'image_block_2/3/bn2/g/read', u'image_block_2/3/bn2/b', u'image_block_2/3/bn2/b/read', u'image_block_2/3/Reshape_4/shape', u'image_block_2/3/Reshape_4', u'image_block_2/3/Reshape_5/shape', u'image_block_2/3/Reshape_5', u'image_block_2/3/Reshape_6/shape', u'image_block_2/3/Reshape_6', u'image_block_2/3/Reshape_7/shape', u'image_block_2/3/Reshape_7', u'image_block_2/3/sub_1', u'image_block_2/3/add_2/y', u'image_block_2/3/add_2', u'image_block_2/3/Rsqrt_1', u'image_block_2/3/mul_2', u'image_block_2/3/mul_3', u'image_block_2/3/add_3', u'image_block_2/3/Relu_1', u'image_block_2/3/c3/w', u'image_block_2/3/c3/w/read', u'image_block_2/3/c3/Conv2D', u'image_block_2/3/bn3/g', u'image_block_2/3/bn3/g/read', u'image_block_2/3/bn3/b', u'image_block_2/3/bn3/b/read', u'image_block_2/3/Reshape_8/shape', u'image_block_2/3/Reshape_8', u'image_block_2/3/Reshape_9/shape', u'image_block_2/3/Reshape_9', u'image_block_2/3/Reshape_10/shape', u'image_block_2/3/Reshape_10', u'image_block_2/3/Reshape_11/shape', u'image_block_2/3/Reshape_11', u'image_block_2/3/sub_2', u'image_block_2/3/add_4/y', u'image_block_2/3/add_4', u'image_block_2/3/Rsqrt_2', u'image_block_2/3/mul_4', u'image_block_2/3/mul_5', u'image_block_2/3/add_5', u'image_block_2/3/add_6', u'image_block_2/3/Relu_2', u'image_block_2/4/c1/w', u'image_block_2/4/c1/w/read', u'image_block_2/4/c1/Conv2D', u'image_block_2/4/bn1/g', u'image_block_2/4/bn1/g/read', u'image_block_2/4/bn1/b', u'image_block_2/4/bn1/b/read', u'image_block_2/4/Reshape/shape', u'image_block_2/4/Reshape', u'image_block_2/4/Reshape_1/shape', u'image_block_2/4/Reshape_1', u'image_block_2/4/Reshape_2/shape', u'image_block_2/4/Reshape_2', u'image_block_2/4/Reshape_3/shape', u'image_block_2/4/Reshape_3', u'image_block_2/4/sub', u'image_block_2/4/add/y', u'image_block_2/4/add', u'image_block_2/4/Rsqrt', u'image_block_2/4/mul', u'image_block_2/4/mul_1', u'image_block_2/4/add_1', u'image_block_2/4/Relu', u'image_block_2/4/c2/w', u'image_block_2/4/c2/w/read', u'image_block_2/4/c2/Conv2D', u'image_block_2/4/bn2/g', u'image_block_2/4/bn2/g/read', u'image_block_2/4/bn2/b', u'image_block_2/4/bn2/b/read', u'image_block_2/4/Reshape_4/shape', u'image_block_2/4/Reshape_4', u'image_block_2/4/Reshape_5/shape', u'image_block_2/4/Reshape_5', u'image_block_2/4/Reshape_6/shape', u'image_block_2/4/Reshape_6', u'image_block_2/4/Reshape_7/shape', u'image_block_2/4/Reshape_7', u'image_block_2/4/sub_1', u'image_block_2/4/add_2/y', u'image_block_2/4/add_2', u'image_block_2/4/Rsqrt_1', u'image_block_2/4/mul_2', u'image_block_2/4/mul_3', u'image_block_2/4/add_3', u'image_block_2/4/Relu_1', u'image_block_2/4/c3/w', u'image_block_2/4/c3/w/read', u'image_block_2/4/c3/Conv2D', u'image_block_2/4/bn3/g', u'image_block_2/4/bn3/g/read', u'image_block_2/4/bn3/b', u'image_block_2/4/bn3/b/read', u'image_block_2/4/Reshape_8/shape', u'image_block_2/4/Reshape_8', u'image_block_2/4/Reshape_9/shape', u'image_block_2/4/Reshape_9', u'image_block_2/4/Reshape_10/shape', u'image_block_2/4/Reshape_10', u'image_block_2/4/Reshape_11/shape', u'image_block_2/4/Reshape_11', u'image_block_2/4/sub_2', u'image_block_2/4/add_4/y', u'image_block_2/4/add_4', u'image_block_2/4/Rsqrt_2', u'image_block_2/4/mul_4', u'image_block_2/4/mul_5', u'image_block_2/4/add_5', u'image_block_2/4/add_6', u'image_block_2/4/Relu_2', u'image_block_2/5/c1/w', u'image_block_2/5/c1/w/read', u'image_block_2/5/c1/Conv2D', u'image_block_2/5/bn1/g', u'image_block_2/5/bn1/g/read', u'image_block_2/5/bn1/b', u'image_block_2/5/bn1/b/read', u'image_block_2/5/Reshape/shape', u'image_block_2/5/Reshape', u'image_block_2/5/Reshape_1/shape', u'image_block_2/5/Reshape_1', u'image_block_2/5/Reshape_2/shape', u'image_block_2/5/Reshape_2', u'image_block_2/5/Reshape_3/shape', u'image_block_2/5/Reshape_3', u'image_block_2/5/sub', u'image_block_2/5/add/y', u'image_block_2/5/add', u'image_block_2/5/Rsqrt', u'image_block_2/5/mul', u'image_block_2/5/mul_1', u'image_block_2/5/add_1', u'image_block_2/5/Relu', u'image_block_2/5/c2/w', u'image_block_2/5/c2/w/read', u'image_block_2/5/c2/Conv2D', u'image_block_2/5/bn2/g', u'image_block_2/5/bn2/g/read', u'image_block_2/5/bn2/b', u'image_block_2/5/bn2/b/read', u'image_block_2/5/Reshape_4/shape', u'image_block_2/5/Reshape_4', u'image_block_2/5/Reshape_5/shape', u'image_block_2/5/Reshape_5', u'image_block_2/5/Reshape_6/shape', u'image_block_2/5/Reshape_6', u'image_block_2/5/Reshape_7/shape', u'image_block_2/5/Reshape_7', u'image_block_2/5/sub_1', u'image_block_2/5/add_2/y', u'image_block_2/5/add_2', u'image_block_2/5/Rsqrt_1', u'image_block_2/5/mul_2', u'image_block_2/5/mul_3', u'image_block_2/5/add_3', u'image_block_2/5/Relu_1', u'image_block_2/5/c3/w', u'image_block_2/5/c3/w/read', u'image_block_2/5/c3/Conv2D', u'image_block_2/5/bn3/g', u'image_block_2/5/bn3/g/read', u'image_block_2/5/bn3/b', u'image_block_2/5/bn3/b/read', u'image_block_2/5/Reshape_8/shape', u'image_block_2/5/Reshape_8', u'image_block_2/5/Reshape_9/shape', u'image_block_2/5/Reshape_9', u'image_block_2/5/Reshape_10/shape', u'image_block_2/5/Reshape_10', u'image_block_2/5/Reshape_11/shape', u'image_block_2/5/Reshape_11', u'image_block_2/5/sub_2', u'image_block_2/5/add_4/y', u'image_block_2/5/add_4', u'image_block_2/5/Rsqrt_2', u'image_block_2/5/mul_4', u'image_block_2/5/mul_5', u'image_block_2/5/add_5', u'image_block_2/5/add_6', u'image_block_2/5/Relu_2', u'image_block_3/0/c1/w', u'image_block_3/0/c1/w/read', u'image_block_3/0/c1/Conv2D', u'image_block_3/0/bn1/g', u'image_block_3/0/bn1/g/read', u'image_block_3/0/bn1/b', u'image_block_3/0/bn1/b/read', u'image_block_3/0/Reshape/shape', u'image_block_3/0/Reshape', u'image_block_3/0/Reshape_1/shape', u'image_block_3/0/Reshape_1', u'image_block_3/0/Reshape_2/shape', u'image_block_3/0/Reshape_2', u'image_block_3/0/Reshape_3/shape', u'image_block_3/0/Reshape_3', u'image_block_3/0/sub', u'image_block_3/0/add/y', u'image_block_3/0/add', u'image_block_3/0/Rsqrt', u'image_block_3/0/mul', u'image_block_3/0/mul_1', u'image_block_3/0/add_1', u'image_block_3/0/Relu', u'image_block_3/0/c2/w', u'image_block_3/0/c2/w/read', u'image_block_3/0/c2/Conv2D', u'image_block_3/0/bn2/g', u'image_block_3/0/bn2/g/read', u'image_block_3/0/bn2/b', u'image_block_3/0/bn2/b/read', u'image_block_3/0/Reshape_4/shape', u'image_block_3/0/Reshape_4', u'image_block_3/0/Reshape_5/shape', u'image_block_3/0/Reshape_5', u'image_block_3/0/Reshape_6/shape', u'image_block_3/0/Reshape_6', u'image_block_3/0/Reshape_7/shape', u'image_block_3/0/Reshape_7', u'image_block_3/0/sub_1', u'image_block_3/0/add_2/y', u'image_block_3/0/add_2', u'image_block_3/0/Rsqrt_1', u'image_block_3/0/mul_2', u'image_block_3/0/mul_3', u'image_block_3/0/add_3', u'image_block_3/0/Relu_1', u'image_block_3/0/AvgPool', u'image_block_3/0/c3/w', u'image_block_3/0/c3/w/read', u'image_block_3/0/c3/Conv2D', u'image_block_3/0/bn3/g', u'image_block_3/0/bn3/g/read', u'image_block_3/0/bn3/b', u'image_block_3/0/bn3/b/read', u'image_block_3/0/Reshape_8/shape', u'image_block_3/0/Reshape_8', u'image_block_3/0/Reshape_9/shape', u'image_block_3/0/Reshape_9', u'image_block_3/0/Reshape_10/shape', u'image_block_3/0/Reshape_10', u'image_block_3/0/Reshape_11/shape', u'image_block_3/0/Reshape_11', u'image_block_3/0/sub_2', u'image_block_3/0/add_4/y', u'image_block_3/0/add_4', u'image_block_3/0/Rsqrt_2', u'image_block_3/0/mul_4', u'image_block_3/0/mul_5', u'image_block_3/0/add_5', u'image_block_3/0/AvgPool_1', u'image_block_3/0/proj_c1/w', u'image_block_3/0/proj_c1/w/read', u'image_block_3/0/proj_c1/Conv2D', u'image_block_3/0/proj_bn1/g', u'image_block_3/0/proj_bn1/g/read', u'image_block_3/0/proj_bn1/b', u'image_block_3/0/proj_bn1/b/read', u'image_block_3/0/Reshape_12/shape', u'image_block_3/0/Reshape_12', u'image_block_3/0/Reshape_13/shape', u'image_block_3/0/Reshape_13', u'image_block_3/0/Reshape_14/shape', u'image_block_3/0/Reshape_14', u'image_block_3/0/Reshape_15/shape', u'image_block_3/0/Reshape_15', u'image_block_3/0/sub_3', u'image_block_3/0/add_6/y', u'image_block_3/0/add_6', u'image_block_3/0/Rsqrt_3', u'image_block_3/0/mul_6', u'image_block_3/0/mul_7', u'image_block_3/0/add_7', u'image_block_3/0/add_8', u'image_block_3/0/Relu_2', u'image_block_3/1/c1/w', u'image_block_3/1/c1/w/read', u'image_block_3/1/c1/Conv2D', u'image_block_3/1/bn1/g', u'image_block_3/1/bn1/g/read', u'image_block_3/1/bn1/b', u'image_block_3/1/bn1/b/read', u'image_block_3/1/Reshape/shape', u'image_block_3/1/Reshape', u'image_block_3/1/Reshape_1/shape', u'image_block_3/1/Reshape_1', u'image_block_3/1/Reshape_2/shape', u'image_block_3/1/Reshape_2', u'image_block_3/1/Reshape_3/shape', u'image_block_3/1/Reshape_3', u'image_block_3/1/sub', u'image_block_3/1/add/y', u'image_block_3/1/add', u'image_block_3/1/Rsqrt', u'image_block_3/1/mul', u'image_block_3/1/mul_1', u'image_block_3/1/add_1', u'image_block_3/1/Relu', u'image_block_3/1/c2/w', u'image_block_3/1/c2/w/read', u'image_block_3/1/c2/Conv2D', u'image_block_3/1/bn2/g', u'image_block_3/1/bn2/g/read', u'image_block_3/1/bn2/b', u'image_block_3/1/bn2/b/read', u'image_block_3/1/Reshape_4/shape', u'image_block_3/1/Reshape_4', u'image_block_3/1/Reshape_5/shape', u'image_block_3/1/Reshape_5', u'image_block_3/1/Reshape_6/shape', u'image_block_3/1/Reshape_6', u'image_block_3/1/Reshape_7/shape', u'image_block_3/1/Reshape_7', u'image_block_3/1/sub_1', u'image_block_3/1/add_2/y', u'image_block_3/1/add_2', u'image_block_3/1/Rsqrt_1', u'image_block_3/1/mul_2', u'image_block_3/1/mul_3', u'image_block_3/1/add_3', u'image_block_3/1/Relu_1', u'image_block_3/1/c3/w', u'image_block_3/1/c3/w/read', u'image_block_3/1/c3/Conv2D', u'image_block_3/1/bn3/g', u'image_block_3/1/bn3/g/read', u'image_block_3/1/bn3/b', u'image_block_3/1/bn3/b/read', u'image_block_3/1/Reshape_8/shape', u'image_block_3/1/Reshape_8', u'image_block_3/1/Reshape_9/shape', u'image_block_3/1/Reshape_9', u'image_block_3/1/Reshape_10/shape', u'image_block_3/1/Reshape_10', u'image_block_3/1/Reshape_11/shape', u'image_block_3/1/Reshape_11', u'image_block_3/1/sub_2', u'image_block_3/1/add_4/y', u'image_block_3/1/add_4', u'image_block_3/1/Rsqrt_2', u'image_block_3/1/mul_4', u'image_block_3/1/mul_5', u'image_block_3/1/add_5', u'image_block_3/1/add_6', u'image_block_3/1/Relu_2', u'image_block_3/2/c1/w', u'image_block_3/2/c1/w/read', u'image_block_3/2/c1/Conv2D', u'image_block_3/2/bn1/g', u'image_block_3/2/bn1/g/read', u'image_block_3/2/bn1/b', u'image_block_3/2/bn1/b/read', u'image_block_3/2/Reshape/shape', u'image_block_3/2/Reshape', u'image_block_3/2/Reshape_1/shape', u'image_block_3/2/Reshape_1', u'image_block_3/2/Reshape_2/shape', u'image_block_3/2/Reshape_2', u'image_block_3/2/Reshape_3/shape', u'image_block_3/2/Reshape_3', u'image_block_3/2/sub', u'image_block_3/2/add/y', u'image_block_3/2/add', u'image_block_3/2/Rsqrt', u'image_block_3/2/mul', u'image_block_3/2/mul_1', u'image_block_3/2/add_1', u'image_block_3/2/Relu', u'image_block_3/2/c2/w', u'image_block_3/2/c2/w/read', u'image_block_3/2/c2/Conv2D', u'image_block_3/2/bn2/g', u'image_block_3/2/bn2/g/read', u'image_block_3/2/bn2/b', u'image_block_3/2/bn2/b/read', u'image_block_3/2/Reshape_4/shape', u'image_block_3/2/Reshape_4', u'image_block_3/2/Reshape_5/shape', u'image_block_3/2/Reshape_5', u'image_block_3/2/Reshape_6/shape', u'image_block_3/2/Reshape_6', u'image_block_3/2/Reshape_7/shape', u'image_block_3/2/Reshape_7', u'image_block_3/2/sub_1', u'image_block_3/2/add_2/y', u'image_block_3/2/add_2', u'image_block_3/2/Rsqrt_1', u'image_block_3/2/mul_2', u'image_block_3/2/mul_3', u'image_block_3/2/add_3', u'image_block_3/2/Relu_1', u'image_block_3/2/c3/w', u'image_block_3/2/c3/w/read', u'image_block_3/2/c3/Conv2D', u'image_block_3/2/bn3/g', u'image_block_3/2/bn3/g/read', u'image_block_3/2/bn3/b', u'image_block_3/2/bn3/b/read', u'image_block_3/2/Reshape_8/shape', u'image_block_3/2/Reshape_8', u'image_block_3/2/Reshape_9/shape', u'image_block_3/2/Reshape_9', u'image_block_3/2/Reshape_10/shape', u'image_block_3/2/Reshape_10', u'image_block_3/2/Reshape_11/shape', u'image_block_3/2/Reshape_11', u'image_block_3/2/sub_2', u'image_block_3/2/add_4/y', u'image_block_3/2/add_4', u'image_block_3/2/Rsqrt_2', u'image_block_3/2/mul_4', u'image_block_3/2/mul_5', u'image_block_3/2/add_5', u'image_block_3/2/add_6', u'image_block_3/2/Relu_2', u'image_block_3/3/c1/w', u'image_block_3/3/c1/w/read', u'image_block_3/3/c1/Conv2D', u'image_block_3/3/bn1/g', u'image_block_3/3/bn1/g/read', u'image_block_3/3/bn1/b', u'image_block_3/3/bn1/b/read', u'image_block_3/3/Reshape/shape', u'image_block_3/3/Reshape', u'image_block_3/3/Reshape_1/shape', u'image_block_3/3/Reshape_1', u'image_block_3/3/Reshape_2/shape', u'image_block_3/3/Reshape_2', u'image_block_3/3/Reshape_3/shape', u'image_block_3/3/Reshape_3', u'image_block_3/3/sub', u'image_block_3/3/add/y', u'image_block_3/3/add', u'image_block_3/3/Rsqrt', u'image_block_3/3/mul', u'image_block_3/3/mul_1', u'image_block_3/3/add_1', u'image_block_3/3/Relu', u'image_block_3/3/c2/w', u'image_block_3/3/c2/w/read', u'image_block_3/3/c2/Conv2D', u'image_block_3/3/bn2/g', u'image_block_3/3/bn2/g/read', u'image_block_3/3/bn2/b', u'image_block_3/3/bn2/b/read', u'image_block_3/3/Reshape_4/shape', u'image_block_3/3/Reshape_4', u'image_block_3/3/Reshape_5/shape', u'image_block_3/3/Reshape_5', u'image_block_3/3/Reshape_6/shape', u'image_block_3/3/Reshape_6', u'image_block_3/3/Reshape_7/shape', u'image_block_3/3/Reshape_7', u'image_block_3/3/sub_1', u'image_block_3/3/add_2/y', u'image_block_3/3/add_2', u'image_block_3/3/Rsqrt_1', u'image_block_3/3/mul_2', u'image_block_3/3/mul_3', u'image_block_3/3/add_3', u'image_block_3/3/Relu_1', u'image_block_3/3/c3/w', u'image_block_3/3/c3/w/read', u'image_block_3/3/c3/Conv2D', u'image_block_3/3/bn3/g', u'image_block_3/3/bn3/g/read', u'image_block_3/3/bn3/b', u'image_block_3/3/bn3/b/read', u'image_block_3/3/Reshape_8/shape', u'image_block_3/3/Reshape_8', u'image_block_3/3/Reshape_9/shape', u'image_block_3/3/Reshape_9', u'image_block_3/3/Reshape_10/shape', u'image_block_3/3/Reshape_10', u'image_block_3/3/Reshape_11/shape', u'image_block_3/3/Reshape_11', u'image_block_3/3/sub_2', u'image_block_3/3/add_4/y', u'image_block_3/3/add_4', u'image_block_3/3/Rsqrt_2', u'image_block_3/3/mul_4', u'image_block_3/3/mul_5', u'image_block_3/3/add_5', u'image_block_3/3/add_6', u'image_block_3/3/Relu_2', u'image_block_3/4/c1/w', u'image_block_3/4/c1/w/read', u'image_block_3/4/c1/Conv2D', u'image_block_3/4/bn1/g', u'image_block_3/4/bn1/g/read', u'image_block_3/4/bn1/b', u'image_block_3/4/bn1/b/read', u'image_block_3/4/Reshape/shape', u'image_block_3/4/Reshape', u'image_block_3/4/Reshape_1/shape', u'image_block_3/4/Reshape_1', u'image_block_3/4/Reshape_2/shape', u'image_block_3/4/Reshape_2', u'image_block_3/4/Reshape_3/shape', u'image_block_3/4/Reshape_3', u'image_block_3/4/sub', u'image_block_3/4/add/y', u'image_block_3/4/add', u'image_block_3/4/Rsqrt', u'image_block_3/4/mul', u'image_block_3/4/mul_1', u'image_block_3/4/add_1', u'image_block_3/4/Relu', u'image_block_3/4/c2/w', u'image_block_3/4/c2/w/read', u'image_block_3/4/c2/Conv2D', u'image_block_3/4/bn2/g', u'image_block_3/4/bn2/g/read', u'image_block_3/4/bn2/b', u'image_block_3/4/bn2/b/read', u'image_block_3/4/Reshape_4/shape', u'image_block_3/4/Reshape_4', u'image_block_3/4/Reshape_5/shape', u'image_block_3/4/Reshape_5', u'image_block_3/4/Reshape_6/shape', u'image_block_3/4/Reshape_6', u'image_block_3/4/Reshape_7/shape', u'image_block_3/4/Reshape_7', u'image_block_3/4/sub_1', u'image_block_3/4/add_2/y', u'image_block_3/4/add_2', u'image_block_3/4/Rsqrt_1', u'image_block_3/4/mul_2', u'image_block_3/4/mul_3', u'image_block_3/4/add_3', u'image_block_3/4/Relu_1', u'image_block_3/4/c3/w', u'image_block_3/4/c3/w/read', u'image_block_3/4/c3/Conv2D', u'image_block_3/4/bn3/g', u'image_block_3/4/bn3/g/read', u'image_block_3/4/bn3/b', u'image_block_3/4/bn3/b/read', u'image_block_3/4/Reshape_8/shape', u'image_block_3/4/Reshape_8', u'image_block_3/4/Reshape_9/shape', u'image_block_3/4/Reshape_9', u'image_block_3/4/Reshape_10/shape', u'image_block_3/4/Reshape_10', u'image_block_3/4/Reshape_11/shape', u'image_block_3/4/Reshape_11', u'image_block_3/4/sub_2', u'image_block_3/4/add_4/y', u'image_block_3/4/add_4', u'image_block_3/4/Rsqrt_2', u'image_block_3/4/mul_4', u'image_block_3/4/mul_5', u'image_block_3/4/add_5', u'image_block_3/4/add_6', u'image_block_3/4/Relu_2', u'image_block_3/5/c1/w', u'image_block_3/5/c1/w/read', u'image_block_3/5/c1/Conv2D', u'image_block_3/5/bn1/g', u'image_block_3/5/bn1/g/read', u'image_block_3/5/bn1/b', u'image_block_3/5/bn1/b/read', u'image_block_3/5/Reshape/shape', u'image_block_3/5/Reshape', u'image_block_3/5/Reshape_1/shape', u'image_block_3/5/Reshape_1', u'image_block_3/5/Reshape_2/shape', u'image_block_3/5/Reshape_2', u'image_block_3/5/Reshape_3/shape', u'image_block_3/5/Reshape_3', u'image_block_3/5/sub', u'image_block_3/5/add/y', u'image_block_3/5/add', u'image_block_3/5/Rsqrt', u'image_block_3/5/mul', u'image_block_3/5/mul_1', u'image_block_3/5/add_1', u'image_block_3/5/Relu', u'image_block_3/5/c2/w', u'image_block_3/5/c2/w/read', u'image_block_3/5/c2/Conv2D', u'image_block_3/5/bn2/g', u'image_block_3/5/bn2/g/read', u'image_block_3/5/bn2/b', u'image_block_3/5/bn2/b/read', u'image_block_3/5/Reshape_4/shape', u'image_block_3/5/Reshape_4', u'image_block_3/5/Reshape_5/shape', u'image_block_3/5/Reshape_5', u'image_block_3/5/Reshape_6/shape', u'image_block_3/5/Reshape_6', u'image_block_3/5/Reshape_7/shape', u'image_block_3/5/Reshape_7', u'image_block_3/5/sub_1', u'image_block_3/5/add_2/y', u'image_block_3/5/add_2', u'image_block_3/5/Rsqrt_1', u'image_block_3/5/mul_2', u'image_block_3/5/mul_3', u'image_block_3/5/add_3', u'image_block_3/5/Relu_1', u'image_block_3/5/c3/w', u'image_block_3/5/c3/w/read', u'image_block_3/5/c3/Conv2D', u'image_block_3/5/bn3/g', u'image_block_3/5/bn3/g/read', u'image_block_3/5/bn3/b', u'image_block_3/5/bn3/b/read', u'image_block_3/5/Reshape_8/shape', u'image_block_3/5/Reshape_8', u'image_block_3/5/Reshape_9/shape', u'image_block_3/5/Reshape_9', u'image_block_3/5/Reshape_10/shape', u'image_block_3/5/Reshape_10', u'image_block_3/5/Reshape_11/shape', u'image_block_3/5/Reshape_11', u'image_block_3/5/sub_2', u'image_block_3/5/add_4/y', u'image_block_3/5/add_4', u'image_block_3/5/Rsqrt_2', u'image_block_3/5/mul_4', u'image_block_3/5/mul_5', u'image_block_3/5/add_5', u'image_block_3/5/add_6', u'image_block_3/5/Relu_2', u'image_block_3/6/c1/w', u'image_block_3/6/c1/w/read', u'image_block_3/6/c1/Conv2D', u'image_block_3/6/bn1/g', u'image_block_3/6/bn1/g/read', u'image_block_3/6/bn1/b', u'image_block_3/6/bn1/b/read', u'image_block_3/6/Reshape/shape', u'image_block_3/6/Reshape', u'image_block_3/6/Reshape_1/shape', u'image_block_3/6/Reshape_1', u'image_block_3/6/Reshape_2/shape', u'image_block_3/6/Reshape_2', u'image_block_3/6/Reshape_3/shape', u'image_block_3/6/Reshape_3', u'image_block_3/6/sub', u'image_block_3/6/add/y', u'image_block_3/6/add', u'image_block_3/6/Rsqrt', u'image_block_3/6/mul', u'image_block_3/6/mul_1', u'image_block_3/6/add_1', u'image_block_3/6/Relu', u'image_block_3/6/c2/w', u'image_block_3/6/c2/w/read', u'image_block_3/6/c2/Conv2D', u'image_block_3/6/bn2/g', u'image_block_3/6/bn2/g/read', u'image_block_3/6/bn2/b', u'image_block_3/6/bn2/b/read', u'image_block_3/6/Reshape_4/shape', u'image_block_3/6/Reshape_4', u'image_block_3/6/Reshape_5/shape', u'image_block_3/6/Reshape_5', u'image_block_3/6/Reshape_6/shape', u'image_block_3/6/Reshape_6', u'image_block_3/6/Reshape_7/shape', u'image_block_3/6/Reshape_7', u'image_block_3/6/sub_1', u'image_block_3/6/add_2/y', u'image_block_3/6/add_2', u'image_block_3/6/Rsqrt_1', u'image_block_3/6/mul_2', u'image_block_3/6/mul_3', u'image_block_3/6/add_3', u'image_block_3/6/Relu_1', u'image_block_3/6/c3/w', u'image_block_3/6/c3/w/read', u'image_block_3/6/c3/Conv2D', u'image_block_3/6/bn3/g', u'image_block_3/6/bn3/g/read', u'image_block_3/6/bn3/b', u'image_block_3/6/bn3/b/read', u'image_block_3/6/Reshape_8/shape', u'image_block_3/6/Reshape_8', u'image_block_3/6/Reshape_9/shape', u'image_block_3/6/Reshape_9', u'image_block_3/6/Reshape_10/shape', u'image_block_3/6/Reshape_10', u'image_block_3/6/Reshape_11/shape', u'image_block_3/6/Reshape_11', u'image_block_3/6/sub_2', u'image_block_3/6/add_4/y', u'image_block_3/6/add_4', u'image_block_3/6/Rsqrt_2', u'image_block_3/6/mul_4', u'image_block_3/6/mul_5', u'image_block_3/6/add_5', u'image_block_3/6/add_6', u'image_block_3/6/Relu_2', u'image_block_3/7/c1/w', u'image_block_3/7/c1/w/read', u'image_block_3/7/c1/Conv2D', u'image_block_3/7/bn1/g', u'image_block_3/7/bn1/g/read', u'image_block_3/7/bn1/b', u'image_block_3/7/bn1/b/read', u'image_block_3/7/Reshape/shape', u'image_block_3/7/Reshape', u'image_block_3/7/Reshape_1/shape', u'image_block_3/7/Reshape_1', u'image_block_3/7/Reshape_2/shape', u'image_block_3/7/Reshape_2', u'image_block_3/7/Reshape_3/shape', u'image_block_3/7/Reshape_3', u'image_block_3/7/sub', u'image_block_3/7/add/y', u'image_block_3/7/add', u'image_block_3/7/Rsqrt', u'image_block_3/7/mul', u'image_block_3/7/mul_1', u'image_block_3/7/add_1', u'image_block_3/7/Relu', u'image_block_3/7/c2/w', u'image_block_3/7/c2/w/read', u'image_block_3/7/c2/Conv2D', u'image_block_3/7/bn2/g', u'image_block_3/7/bn2/g/read', u'image_block_3/7/bn2/b', u'image_block_3/7/bn2/b/read', u'image_block_3/7/Reshape_4/shape', u'image_block_3/7/Reshape_4', u'image_block_3/7/Reshape_5/shape', u'image_block_3/7/Reshape_5', u'image_block_3/7/Reshape_6/shape', u'image_block_3/7/Reshape_6', u'image_block_3/7/Reshape_7/shape', u'image_block_3/7/Reshape_7', u'image_block_3/7/sub_1', u'image_block_3/7/add_2/y', u'image_block_3/7/add_2', u'image_block_3/7/Rsqrt_1', u'image_block_3/7/mul_2', u'image_block_3/7/mul_3', u'image_block_3/7/add_3', u'image_block_3/7/Relu_1', u'image_block_3/7/c3/w', u'image_block_3/7/c3/w/read', u'image_block_3/7/c3/Conv2D', u'image_block_3/7/bn3/g', u'image_block_3/7/bn3/g/read', u'image_block_3/7/bn3/b', u'image_block_3/7/bn3/b/read', u'image_block_3/7/Reshape_8/shape', u'image_block_3/7/Reshape_8', u'image_block_3/7/Reshape_9/shape', u'image_block_3/7/Reshape_9', u'image_block_3/7/Reshape_10/shape', u'image_block_3/7/Reshape_10', u'image_block_3/7/Reshape_11/shape', u'image_block_3/7/Reshape_11', u'image_block_3/7/sub_2', u'image_block_3/7/add_4/y', u'image_block_3/7/add_4', u'image_block_3/7/Rsqrt_2', u'image_block_3/7/mul_4', u'image_block_3/7/mul_5', u'image_block_3/7/add_5', u'image_block_3/7/add_6', u'image_block_3/7/Relu_2', u'image_block_3/8/c1/w', u'image_block_3/8/c1/w/read', u'image_block_3/8/c1/Conv2D', u'image_block_3/8/bn1/g', u'image_block_3/8/bn1/g/read', u'image_block_3/8/bn1/b', u'image_block_3/8/bn1/b/read', u'image_block_3/8/Reshape/shape', u'image_block_3/8/Reshape', u'image_block_3/8/Reshape_1/shape', u'image_block_3/8/Reshape_1', u'image_block_3/8/Reshape_2/shape', u'image_block_3/8/Reshape_2', u'image_block_3/8/Reshape_3/shape', u'image_block_3/8/Reshape_3', u'image_block_3/8/sub', u'image_block_3/8/add/y', u'image_block_3/8/add', u'image_block_3/8/Rsqrt', u'image_block_3/8/mul', u'image_block_3/8/mul_1', u'image_block_3/8/add_1', u'image_block_3/8/Relu', u'image_block_3/8/c2/w', u'image_block_3/8/c2/w/read', u'image_block_3/8/c2/Conv2D', u'image_block_3/8/bn2/g', u'image_block_3/8/bn2/g/read', u'image_block_3/8/bn2/b', u'image_block_3/8/bn2/b/read', u'image_block_3/8/Reshape_4/shape', u'image_block_3/8/Reshape_4', u'image_block_3/8/Reshape_5/shape', u'image_block_3/8/Reshape_5', u'image_block_3/8/Reshape_6/shape', u'image_block_3/8/Reshape_6', u'image_block_3/8/Reshape_7/shape', u'image_block_3/8/Reshape_7', u'image_block_3/8/sub_1', u'image_block_3/8/add_2/y', u'image_block_3/8/add_2', u'image_block_3/8/Rsqrt_1', u'image_block_3/8/mul_2', u'image_block_3/8/mul_3', u'image_block_3/8/add_3', u'image_block_3/8/Relu_1', u'image_block_3/8/c3/w', u'image_block_3/8/c3/w/read', u'image_block_3/8/c3/Conv2D', u'image_block_3/8/bn3/g', u'image_block_3/8/bn3/g/read', u'image_block_3/8/bn3/b', u'image_block_3/8/bn3/b/read', u'image_block_3/8/Reshape_8/shape', u'image_block_3/8/Reshape_8', u'image_block_3/8/Reshape_9/shape', u'image_block_3/8/Reshape_9', u'image_block_3/8/Reshape_10/shape', u'image_block_3/8/Reshape_10', u'image_block_3/8/Reshape_11/shape', u'image_block_3/8/Reshape_11', u'image_block_3/8/sub_2', u'image_block_3/8/add_4/y', u'image_block_3/8/add_4', u'image_block_3/8/Rsqrt_2', u'image_block_3/8/mul_4', u'image_block_3/8/mul_5', u'image_block_3/8/add_5', u'image_block_3/8/add_6', u'image_block_3/8/Relu_2', u'image_block_3/9/c1/w', u'image_block_3/9/c1/w/read', u'image_block_3/9/c1/Conv2D', u'image_block_3/9/bn1/g', u'image_block_3/9/bn1/g/read', u'image_block_3/9/bn1/b', u'image_block_3/9/bn1/b/read', u'image_block_3/9/Reshape/shape', u'image_block_3/9/Reshape', u'image_block_3/9/Reshape_1/shape', u'image_block_3/9/Reshape_1', u'image_block_3/9/Reshape_2/shape', u'image_block_3/9/Reshape_2', u'image_block_3/9/Reshape_3/shape', u'image_block_3/9/Reshape_3', u'image_block_3/9/sub', u'image_block_3/9/add/y', u'image_block_3/9/add', u'image_block_3/9/Rsqrt', u'image_block_3/9/mul', u'image_block_3/9/mul_1', u'image_block_3/9/add_1', u'image_block_3/9/Relu', u'image_block_3/9/c2/w', u'image_block_3/9/c2/w/read', u'image_block_3/9/c2/Conv2D', u'image_block_3/9/bn2/g', u'image_block_3/9/bn2/g/read', u'image_block_3/9/bn2/b', u'image_block_3/9/bn2/b/read', u'image_block_3/9/Reshape_4/shape', u'image_block_3/9/Reshape_4', u'image_block_3/9/Reshape_5/shape', u'image_block_3/9/Reshape_5', u'image_block_3/9/Reshape_6/shape', u'image_block_3/9/Reshape_6', u'image_block_3/9/Reshape_7/shape', u'image_block_3/9/Reshape_7', u'image_block_3/9/sub_1', u'image_block_3/9/add_2/y', u'image_block_3/9/add_2', u'image_block_3/9/Rsqrt_1', u'image_block_3/9/mul_2', u'image_block_3/9/mul_3', u'image_block_3/9/add_3', u'image_block_3/9/Relu_1', u'image_block_3/9/c3/w', u'image_block_3/9/c3/w/read', u'image_block_3/9/c3/Conv2D', u'image_block_3/9/bn3/g', u'image_block_3/9/bn3/g/read', u'image_block_3/9/bn3/b', u'image_block_3/9/bn3/b/read', u'image_block_3/9/Reshape_8/shape', u'image_block_3/9/Reshape_8', u'image_block_3/9/Reshape_9/shape', u'image_block_3/9/Reshape_9', u'image_block_3/9/Reshape_10/shape', u'image_block_3/9/Reshape_10', u'image_block_3/9/Reshape_11/shape', u'image_block_3/9/Reshape_11', u'image_block_3/9/sub_2', u'image_block_3/9/add_4/y', u'image_block_3/9/add_4', u'image_block_3/9/Rsqrt_2', u'image_block_3/9/mul_4', u'image_block_3/9/mul_5', u'image_block_3/9/add_5', u'image_block_3/9/add_6', u'image_block_3/9/Relu_2', u'image_block_4/0/c1/w', u'image_block_4/0/c1/w/read', u'image_block_4/0/c1/Conv2D', u'image_block_4/0/bn1/g', u'image_block_4/0/bn1/g/read', u'image_block_4/0/bn1/b', u'image_block_4/0/bn1/b/read', u'image_block_4/0/Reshape/shape', u'image_block_4/0/Reshape', u'image_block_4/0/Reshape_1/shape', u'image_block_4/0/Reshape_1', u'image_block_4/0/Reshape_2/shape', u'image_block_4/0/Reshape_2', u'image_block_4/0/Reshape_3/shape', u'image_block_4/0/Reshape_3', u'image_block_4/0/sub', u'image_block_4/0/add/y', u'image_block_4/0/add', u'image_block_4/0/Rsqrt', u'image_block_4/0/mul', u'image_block_4/0/mul_1', u'image_block_4/0/add_1', u'image_block_4/0/Relu', u'image_block_4/0/c2/w', u'image_block_4/0/c2/w/read', u'image_block_4/0/c2/Conv2D', u'image_block_4/0/bn2/g', u'image_block_4/0/bn2/g/read', u'image_block_4/0/bn2/b', u'image_block_4/0/bn2/b/read', u'image_block_4/0/Reshape_4/shape', u'image_block_4/0/Reshape_4', u'image_block_4/0/Reshape_5/shape', u'image_block_4/0/Reshape_5', u'image_block_4/0/Reshape_6/shape', u'image_block_4/0/Reshape_6', u'image_block_4/0/Reshape_7/shape', u'image_block_4/0/Reshape_7', u'image_block_4/0/sub_1', u'image_block_4/0/add_2/y', u'image_block_4/0/add_2', u'image_block_4/0/Rsqrt_1', u'image_block_4/0/mul_2', u'image_block_4/0/mul_3', u'image_block_4/0/add_3', u'image_block_4/0/Relu_1', u'image_block_4/0/AvgPool', u'image_block_4/0/c3/w', u'image_block_4/0/c3/w/read', u'image_block_4/0/c3/Conv2D', u'image_block_4/0/bn3/g', u'image_block_4/0/bn3/g/read', u'image_block_4/0/bn3/b', u'image_block_4/0/bn3/b/read', u'image_block_4/0/Reshape_8/shape', u'image_block_4/0/Reshape_8', u'image_block_4/0/Reshape_9/shape', u'image_block_4/0/Reshape_9', u'image_block_4/0/Reshape_10/shape', u'image_block_4/0/Reshape_10', u'image_block_4/0/Reshape_11/shape', u'image_block_4/0/Reshape_11', u'image_block_4/0/sub_2', u'image_block_4/0/add_4/y', u'image_block_4/0/add_4', u'image_block_4/0/Rsqrt_2', u'image_block_4/0/mul_4', u'image_block_4/0/mul_5', u'image_block_4/0/add_5', u'image_block_4/0/AvgPool_1', u'image_block_4/0/proj_c1/w', u'image_block_4/0/proj_c1/w/read', u'image_block_4/0/proj_c1/Conv2D', u'image_block_4/0/proj_bn1/g', u'image_block_4/0/proj_bn1/g/read', u'image_block_4/0/proj_bn1/b', u'image_block_4/0/proj_bn1/b/read', u'image_block_4/0/Reshape_12/shape', u'image_block_4/0/Reshape_12', u'image_block_4/0/Reshape_13/shape', u'image_block_4/0/Reshape_13', u'image_block_4/0/Reshape_14/shape', u'image_block_4/0/Reshape_14', u'image_block_4/0/Reshape_15/shape', u'image_block_4/0/Reshape_15', u'image_block_4/0/sub_3', u'image_block_4/0/add_6/y', u'image_block_4/0/add_6', u'image_block_4/0/Rsqrt_3', u'image_block_4/0/mul_6', u'image_block_4/0/mul_7', u'image_block_4/0/add_7', u'image_block_4/0/add_8', u'image_block_4/0/Relu_2', u'image_block_4/1/c1/w', u'image_block_4/1/c1/w/read', u'image_block_4/1/c1/Conv2D', u'image_block_4/1/bn1/g', u'image_block_4/1/bn1/g/read', u'image_block_4/1/bn1/b', u'image_block_4/1/bn1/b/read', u'image_block_4/1/Reshape/shape', u'image_block_4/1/Reshape', u'image_block_4/1/Reshape_1/shape', u'image_block_4/1/Reshape_1', u'image_block_4/1/Reshape_2/shape', u'image_block_4/1/Reshape_2', u'image_block_4/1/Reshape_3/shape', u'image_block_4/1/Reshape_3', u'image_block_4/1/sub', u'image_block_4/1/add/y', u'image_block_4/1/add', u'image_block_4/1/Rsqrt', u'image_block_4/1/mul', u'image_block_4/1/mul_1', u'image_block_4/1/add_1', u'image_block_4/1/Relu', u'image_block_4/1/c2/w', u'image_block_4/1/c2/w/read', u'image_block_4/1/c2/Conv2D', u'image_block_4/1/bn2/g', u'image_block_4/1/bn2/g/read', u'image_block_4/1/bn2/b', u'image_block_4/1/bn2/b/read', u'image_block_4/1/Reshape_4/shape', u'image_block_4/1/Reshape_4', u'image_block_4/1/Reshape_5/shape', u'image_block_4/1/Reshape_5', u'image_block_4/1/Reshape_6/shape', u'image_block_4/1/Reshape_6', u'image_block_4/1/Reshape_7/shape', u'image_block_4/1/Reshape_7', u'image_block_4/1/sub_1', u'image_block_4/1/add_2/y', u'image_block_4/1/add_2', u'image_block_4/1/Rsqrt_1', u'image_block_4/1/mul_2', u'image_block_4/1/mul_3', u'image_block_4/1/add_3', u'image_block_4/1/Relu_1', u'image_block_4/1/c3/w', u'image_block_4/1/c3/w/read', u'image_block_4/1/c3/Conv2D', u'image_block_4/1/bn3/g', u'image_block_4/1/bn3/g/read', u'image_block_4/1/bn3/b', u'image_block_4/1/bn3/b/read', u'image_block_4/1/Reshape_8/shape', u'image_block_4/1/Reshape_8', u'image_block_4/1/Reshape_9/shape', u'image_block_4/1/Reshape_9', u'image_block_4/1/Reshape_10/shape', u'image_block_4/1/Reshape_10', u'image_block_4/1/Reshape_11/shape', u'image_block_4/1/Reshape_11', u'image_block_4/1/sub_2', u'image_block_4/1/add_4/y', u'image_block_4/1/add_4', u'image_block_4/1/Rsqrt_2', u'image_block_4/1/mul_4', u'image_block_4/1/mul_5', u'image_block_4/1/add_5', u'image_block_4/1/add_6', u'image_block_4/1/Relu_2', u'image_block_4/2/c1/w', u'image_block_4/2/c1/w/read', u'image_block_4/2/c1/Conv2D', u'image_block_4/2/bn1/g', u'image_block_4/2/bn1/g/read', u'image_block_4/2/bn1/b', u'image_block_4/2/bn1/b/read', u'image_block_4/2/Reshape/shape', u'image_block_4/2/Reshape', u'image_block_4/2/Reshape_1/shape', u'image_block_4/2/Reshape_1', u'image_block_4/2/Reshape_2/shape', u'image_block_4/2/Reshape_2', u'image_block_4/2/Reshape_3/shape', u'image_block_4/2/Reshape_3', u'image_block_4/2/sub', u'image_block_4/2/add/y', u'image_block_4/2/add', u'image_block_4/2/Rsqrt', u'image_block_4/2/mul', u'image_block_4/2/mul_1', u'image_block_4/2/add_1', u'image_block_4/2/Relu', u'image_block_4/2/c2/w', u'image_block_4/2/c2/w/read', u'image_block_4/2/c2/Conv2D', u'image_block_4/2/bn2/g', u'image_block_4/2/bn2/g/read', u'image_block_4/2/bn2/b', u'image_block_4/2/bn2/b/read', u'image_block_4/2/Reshape_4/shape', u'image_block_4/2/Reshape_4', u'image_block_4/2/Reshape_5/shape', u'image_block_4/2/Reshape_5', u'image_block_4/2/Reshape_6/shape', u'image_block_4/2/Reshape_6', u'image_block_4/2/Reshape_7/shape', u'image_block_4/2/Reshape_7', u'image_block_4/2/sub_1', u'image_block_4/2/add_2/y', u'image_block_4/2/add_2', u'image_block_4/2/Rsqrt_1', u'image_block_4/2/mul_2', u'image_block_4/2/mul_3', u'image_block_4/2/add_3', u'image_block_4/2/Relu_1', u'image_block_4/2/c3/w', u'image_block_4/2/c3/w/read', u'image_block_4/2/c3/Conv2D', u'image_block_4/2/bn3/g', u'image_block_4/2/bn3/g/read', u'image_block_4/2/bn3/b', u'image_block_4/2/bn3/b/read', u'image_block_4/2/Reshape_8/shape', u'image_block_4/2/Reshape_8', u'image_block_4/2/Reshape_9/shape', u'image_block_4/2/Reshape_9', u'image_block_4/2/Reshape_10/shape', u'image_block_4/2/Reshape_10', u'image_block_4/2/Reshape_11/shape', u'image_block_4/2/Reshape_11', u'image_block_4/2/sub_2', u'image_block_4/2/add_4/y', u'image_block_4/2/add_4', u'image_block_4/2/Rsqrt_2', u'image_block_4/2/mul_4', u'image_block_4/2/mul_5', u'image_block_4/2/add_5', u'image_block_4/2/add_6', u'image_block_4/2/Relu_2', u'image_block_4/3/c1/w', u'image_block_4/3/c1/w/read', u'image_block_4/3/c1/Conv2D', u'image_block_4/3/bn1/g', u'image_block_4/3/bn1/g/read', u'image_block_4/3/bn1/b', u'image_block_4/3/bn1/b/read', u'image_block_4/3/Reshape/shape', u'image_block_4/3/Reshape', u'image_block_4/3/Reshape_1/shape', u'image_block_4/3/Reshape_1', u'image_block_4/3/Reshape_2/shape', u'image_block_4/3/Reshape_2', u'image_block_4/3/Reshape_3/shape', u'image_block_4/3/Reshape_3', u'image_block_4/3/sub', u'image_block_4/3/add/y', u'image_block_4/3/add', u'image_block_4/3/Rsqrt', u'image_block_4/3/mul', u'image_block_4/3/mul_1', u'image_block_4/3/add_1', u'image_block_4/3/Relu', u'image_block_4/3/c2/w', u'image_block_4/3/c2/w/read', u'image_block_4/3/c2/Conv2D', u'image_block_4/3/bn2/g', u'image_block_4/3/bn2/g/read', u'image_block_4/3/bn2/b', u'image_block_4/3/bn2/b/read', u'image_block_4/3/Reshape_4/shape', u'image_block_4/3/Reshape_4', u'image_block_4/3/Reshape_5/shape', u'image_block_4/3/Reshape_5', u'image_block_4/3/Reshape_6/shape', u'image_block_4/3/Reshape_6', u'image_block_4/3/Reshape_7/shape', u'image_block_4/3/Reshape_7', u'image_block_4/3/sub_1', u'image_block_4/3/add_2/y', u'image_block_4/3/add_2', u'image_block_4/3/Rsqrt_1', u'image_block_4/3/mul_2', u'image_block_4/3/mul_3', u'image_block_4/3/add_3', u'image_block_4/3/Relu_1', u'image_block_4/3/c3/w', u'image_block_4/3/c3/w/read', u'image_block_4/3/c3/Conv2D', u'image_block_4/3/bn3/g', u'image_block_4/3/bn3/g/read', u'image_block_4/3/bn3/b', u'image_block_4/3/bn3/b/read', u'image_block_4/3/Reshape_8/shape', u'image_block_4/3/Reshape_8', u'image_block_4/3/Reshape_9/shape', u'image_block_4/3/Reshape_9', u'image_block_4/3/Reshape_10/shape', u'image_block_4/3/Reshape_10', u'image_block_4/3/Reshape_11/shape', u'image_block_4/3/Reshape_11', u'image_block_4/3/sub_2', u'image_block_4/3/add_4/y', u'image_block_4/3/add_4', u'image_block_4/3/Rsqrt_2', u'image_block_4/3/mul_4', u'image_block_4/3/mul_5', u'image_block_4/3/add_5', u'image_block_4/3/add_6', u'image_block_4/3/Relu_2', u'image_block_4/4/c1/w', u'image_block_4/4/c1/w/read', u'image_block_4/4/c1/Conv2D', u'image_block_4/4/bn1/g', u'image_block_4/4/bn1/g/read', u'image_block_4/4/bn1/b', u'image_block_4/4/bn1/b/read', u'image_block_4/4/Reshape/shape', u'image_block_4/4/Reshape', u'image_block_4/4/Reshape_1/shape', u'image_block_4/4/Reshape_1', u'image_block_4/4/Reshape_2/shape', u'image_block_4/4/Reshape_2', u'image_block_4/4/Reshape_3/shape', u'image_block_4/4/Reshape_3', u'image_block_4/4/sub', u'image_block_4/4/add/y', u'image_block_4/4/add', u'image_block_4/4/Rsqrt', u'image_block_4/4/mul', u'image_block_4/4/mul_1', u'image_block_4/4/add_1', u'image_block_4/4/Relu', u'image_block_4/4/c2/w', u'image_block_4/4/c2/w/read', u'image_block_4/4/c2/Conv2D', u'image_block_4/4/bn2/g', u'image_block_4/4/bn2/g/read', u'image_block_4/4/bn2/b', u'image_block_4/4/bn2/b/read', u'image_block_4/4/Reshape_4/shape', u'image_block_4/4/Reshape_4', u'image_block_4/4/Reshape_5/shape', u'image_block_4/4/Reshape_5', u'image_block_4/4/Reshape_6/shape', u'image_block_4/4/Reshape_6', u'image_block_4/4/Reshape_7/shape', u'image_block_4/4/Reshape_7', u'image_block_4/4/sub_1', u'image_block_4/4/add_2/y', u'image_block_4/4/add_2', u'image_block_4/4/Rsqrt_1', u'image_block_4/4/mul_2', u'image_block_4/4/mul_3', u'image_block_4/4/add_3', u'image_block_4/4/Relu_1', u'image_block_4/4/c3/w', u'image_block_4/4/c3/w/read', u'image_block_4/4/c3/Conv2D', u'image_block_4/4/bn3/g', u'image_block_4/4/bn3/g/read', u'image_block_4/4/bn3/b', u'image_block_4/4/bn3/b/read', u'image_block_4/4/Reshape_8/shape', u'image_block_4/4/Reshape_8', u'image_block_4/4/Reshape_9/shape', u'image_block_4/4/Reshape_9', u'image_block_4/4/Reshape_10/shape', u'image_block_4/4/Reshape_10', u'image_block_4/4/Reshape_11/shape', u'image_block_4/4/Reshape_11', u'image_block_4/4/sub_2', u'image_block_4/4/add_4/y', u'image_block_4/4/add_4', u'image_block_4/4/Rsqrt_2', u'image_block_4/4/mul_4', u'image_block_4/4/mul_5', u'image_block_4/4/add_5', u'image_block_4/4/add_6', u'image_block_4/4/Relu_2', u'image_block_4/5/c1/w', u'image_block_4/5/c1/w/read', u'image_block_4/5/c1/Conv2D', u'image_block_4/5/bn1/g', u'image_block_4/5/bn1/g/read', u'image_block_4/5/bn1/b', u'image_block_4/5/bn1/b/read', u'image_block_4/5/Reshape/shape', u'image_block_4/5/Reshape', u'image_block_4/5/Reshape_1/shape', u'image_block_4/5/Reshape_1', u'image_block_4/5/Reshape_2/shape', u'image_block_4/5/Reshape_2', u'image_block_4/5/Reshape_3/shape', u'image_block_4/5/Reshape_3', u'image_block_4/5/sub', u'image_block_4/5/add/y', u'image_block_4/5/add', u'image_block_4/5/Rsqrt', u'image_block_4/5/mul', u'image_block_4/5/mul_1', u'image_block_4/5/add_1', u'image_block_4/5/Relu', u'image_block_4/5/c2/w', u'image_block_4/5/c2/w/read', u'image_block_4/5/c2/Conv2D', u'image_block_4/5/bn2/g', u'image_block_4/5/bn2/g/read', u'image_block_4/5/bn2/b', u'image_block_4/5/bn2/b/read', u'image_block_4/5/Reshape_4/shape', u'image_block_4/5/Reshape_4', u'image_block_4/5/Reshape_5/shape', u'image_block_4/5/Reshape_5', u'image_block_4/5/Reshape_6/shape', u'image_block_4/5/Reshape_6', u'image_block_4/5/Reshape_7/shape', u'image_block_4/5/Reshape_7', u'image_block_4/5/sub_1', u'image_block_4/5/add_2/y', u'image_block_4/5/add_2', u'image_block_4/5/Rsqrt_1', u'image_block_4/5/mul_2', u'image_block_4/5/mul_3', u'image_block_4/5/add_3', u'image_block_4/5/Relu_1', u'image_block_4/5/c3/w', u'image_block_4/5/c3/w/read', u'image_block_4/5/c3/Conv2D', u'image_block_4/5/bn3/g', u'image_block_4/5/bn3/g/read', u'image_block_4/5/bn3/b', u'image_block_4/5/bn3/b/read', u'image_block_4/5/Reshape_8/shape', u'image_block_4/5/Reshape_8', u'image_block_4/5/Reshape_9/shape', u'image_block_4/5/Reshape_9', u'image_block_4/5/Reshape_10/shape', u'image_block_4/5/Reshape_10', u'image_block_4/5/Reshape_11/shape', u'image_block_4/5/Reshape_11', u'image_block_4/5/sub_2', u'image_block_4/5/add_4/y', u'image_block_4/5/add_4', u'image_block_4/5/Rsqrt_2', u'image_block_4/5/mul_4', u'image_block_4/5/mul_5', u'image_block_4/5/add_5', u'image_block_4/5/add_6', u'image_block_4/5/Relu_2', u'Reshape_2/shape', u'Reshape_2', u'transpose_1/perm', u'transpose_1', u'image_post/wp', u'image_post/wp/read', u'image_post/Mean/reduction_indices', u'image_post/Mean', u'image_post/concat/axis', u'image_post/concat', u'image_post/add', u'image_block/attn/q/w', u'image_block/attn/q/w/read', u'image_block/attn/q/b', u'image_block/attn/q/b/read', u'image_block/attn/q/Reshape/shape', u'image_block/attn/q/Reshape', u'image_block/attn/q/Reshape_1/shape', u'image_block/attn/q/Reshape_1', u'image_block/attn/q/MatMul', u'image_block/attn/q/add', u'image_block/attn/q/Shape_1', u'image_block/attn/q/strided_slice_1/stack', u'image_block/attn/q/strided_slice_1/stack_1', u'image_block/attn/q/strided_slice_1/stack_2', u'image_block/attn/q/strided_slice_1', u'image_block/attn/q/Reshape_2/shape/1', u'image_block/attn/q/Reshape_2/shape/2', u'image_block/attn/q/Reshape_2/shape', u'image_block/attn/q/Reshape_2', u'image_block/attn/k/w', u'image_block/attn/k/w/read', u'image_block/attn/k/b', u'image_block/attn/k/b/read', u'image_block/attn/k/Reshape/shape', u'image_block/attn/k/Reshape', u'image_block/attn/k/Reshape_1/shape', u'image_block/attn/k/Reshape_1', u'image_block/attn/k/MatMul', u'image_block/attn/k/add', u'image_block/attn/k/Shape_1', u'image_block/attn/k/strided_slice_1/stack', u'image_block/attn/k/strided_slice_1/stack_1', u'image_block/attn/k/strided_slice_1/stack_2', u'image_block/attn/k/strided_slice_1', u'image_block/attn/k/Reshape_2/shape/1', u'image_block/attn/k/Reshape_2/shape/2', u'image_block/attn/k/Reshape_2/shape', u'image_block/attn/k/Reshape_2', u'image_block/attn/v/w', u'image_block/attn/v/w/read', u'image_block/attn/v/b', u'image_block/attn/v/b/read', u'image_block/attn/v/Reshape/shape', u'image_block/attn/v/Reshape', u'image_block/attn/v/Reshape_1/shape', u'image_block/attn/v/Reshape_1', u'image_block/attn/v/MatMul', u'image_block/attn/v/add', u'image_block/attn/v/Shape_1', u'image_block/attn/v/strided_slice_1/stack', u'image_block/attn/v/strided_slice_1/stack_1', u'image_block/attn/v/strided_slice_1/stack_2', u'image_block/attn/v/strided_slice_1', u'image_block/attn/v/Reshape_2/shape/1', u'image_block/attn/v/Reshape_2/shape/2', u'image_block/attn/v/Reshape_2/shape', u'image_block/attn/v/Reshape_2', u'image_block/attn/Shape', u'image_block/attn/strided_slice/stack', u'image_block/attn/strided_slice/stack_1', u'image_block/attn/strided_slice/stack_2', u'image_block/attn/strided_slice', u'image_block/attn/Reshape/shape/1', u'image_block/attn/Reshape/shape/2', u'image_block/attn/Reshape/shape/3', u'image_block/attn/Reshape/shape', u'image_block/attn/Reshape', u'image_block/attn/transpose/perm', u'image_block/attn/transpose', u'image_block/attn/Shape_1', u'image_block/attn/strided_slice_1/stack', u'image_block/attn/strided_slice_1/stack_1', u'image_block/attn/strided_slice_1/stack_2', u'image_block/attn/strided_slice_1', u'image_block/attn/Reshape_1/shape/1', u'image_block/attn/Reshape_1/shape/2', u'image_block/attn/Reshape_1/shape/3', u'image_block/attn/Reshape_1/shape', u'image_block/attn/Reshape_1', u'image_block/attn/transpose_1/perm', u'image_block/attn/transpose_1', u'image_block/attn/Shape_2', u'image_block/attn/strided_slice_2/stack', u'image_block/attn/strided_slice_2/stack_1', u'image_block/attn/strided_slice_2/stack_2', u'image_block/attn/strided_slice_2', u'image_block/attn/Reshape_2/shape/1', u'image_block/attn/Reshape_2/shape/2', u'image_block/attn/Reshape_2/shape/3', u'image_block/attn/Reshape_2/shape', u'image_block/attn/Reshape_2', u'image_block/attn/transpose_2/perm', u'image_block/attn/transpose_2', u'image_block/attn/ones/shape_as_tensor', u'image_block/attn/ones/Const', u'image_block/attn/ones', u'image_block/attn/MatMul', u'image_block/attn/mul/x', u'image_block/attn/mul', u'image_block/attn/sub/x', u'image_block/attn/sub', u'image_block/attn/mul_1/x', u'image_block/attn/mul_1', u'image_block/attn/sub_1', u'image_block/attn/Softmax', u'image_block/attn/MatMul_1', u'image_block/attn/transpose_3/perm', u'image_block/attn/transpose_3', u'image_block/attn/Shape_5', u'image_block/attn/strided_slice_5/stack', u'image_block/attn/strided_slice_5/stack_1', u'image_block/attn/strided_slice_5/stack_2', u'image_block/attn/strided_slice_5', u'image_block/attn/Reshape_3/shape/1', u'image_block/attn/Reshape_3/shape/2', u'image_block/attn/Reshape_3/shape', u'image_block/attn/Reshape_3', u'image_block/attn/c_proj/w', u'image_block/attn/c_proj/w/read', u'image_block/attn/c_proj/b', u'image_block/attn/c_proj/b/read', u'image_block/attn/c_proj/Reshape/shape', u'image_block/attn/c_proj/Reshape', u'image_block/attn/c_proj/Reshape_1/shape', u'image_block/attn/c_proj/Reshape_1', u'image_block/attn/c_proj/MatMul', u'image_block/attn/c_proj/add', u'image_block/attn/c_proj/Shape_1', u'image_block/attn/c_proj/strided_slice_1/stack', u'image_block/attn/c_proj/strided_slice_1/stack_1', u'image_block/attn/c_proj/strided_slice_1/stack_2', u'image_block/attn/c_proj/strided_slice_1', u'image_block/attn/c_proj/Reshape_2/shape/1', u'image_block/attn/c_proj/Reshape_2/shape/2', u'image_block/attn/c_proj/Reshape_2/shape', u'image_block/attn/c_proj/Reshape_2', u'image_block/strided_slice/stack', u'image_block/strided_slice/stack_1', u'image_block/strided_slice/stack_2', u'image_block/strided_slice', u'l2_normalize/Square', u'l2_normalize/Sum/reduction_indices', u'l2_normalize/Sum', u'l2_normalize/Maximum/y', u'l2_normalize/Maximum', u'l2_normalize/Rsqrt', u'l2_normalize']