NPU运行LayerNorm算子掉精度严重

happyme531 commented 1 month ago

https://huggingface.co/happyme531/Stable-Diffusion-1.5-LCM-ONNX-RKNN2#%E5%B7%B2%E7%9F%A5%E9%97%AE%E9%A2%98

截至目前，使用最新版本的rknn-toolkit2 2.2.0版本转换的模型仍然存在极其严重的精度损失！即使使用的是fp16数据类型。如图，上方是使用onnx模型推理的结果，下方是使用rknn模型推理的结果。所有参数均一致。并且分辨率越高，精度损失越严重。这是rknn-toolkit2的bug。

384x384:

256x256:

排查发现是unet转换后精度损失很大，即使使用的是fp16数据类型。

yuyun2000 commented 1 month ago

unet哪一层开始掉精度的，按理说这种卷积网络应该没问题的

happyme531 commented 1 month ago

看了下，掉精度问题主要是LayerNorm导致的

layer_name                                                                                                       simulator_error                             runtime_error                      
                                                                                                             entire              single                  entire           single_sim            
                                                                                                          cos      euc        cos      euc            cos      euc        cos      euc          
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[Input] encoder_hidden_states                                                                           1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0512    1.00000 | 0.0512        
[Reshape] encoder_hidden_states_rs                                                                      1.00000 | 0.0512    1.00000 | 0.0512        1.00000 | 0.0512    1.00000 | 0.0           
[Transpose] encoder_hidden_states_tp-rs                                                                 1.00000 | 0.0512    1.00000 | 0.0512        1.00000 | 0.0512    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1120    1.00000 | 0.1120        1.00000 | 0.1121    1.00000 | 0.0031        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1120    1.00000 | 0.0827        1.00000 | 0.1121    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0404    1.00000 | 0.0404        1.00000 | 0.0404    1.00000 | 0.0005        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0404    1.00000 | 0.0306        1.00000 | 0.0404    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0404    1.00000 | 0.0306        1.00000 | 0.0404    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.0962    1.00000 | 0.0962        1.00000 | 0.0962    1.00000 | 0.0010        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.0962    1.00000 | 0.0619        1.00000 | 0.0962    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0320    1.00000 | 0.0320        1.00000 | 0.0321    1.00000 | 0.0020        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0320    1.00000 | 0.0233        1.00000 | 0.0321    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0320    1.00000 | 0.0233        1.00000 | 0.0321    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1320    1.00000 | 0.1320        1.00000 | 0.1320    1.00000 | 0.0030        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1320    1.00000 | 0.0860        1.00000 | 0.1320    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0493    1.00000 | 0.0493        1.00000 | 0.0493    1.00000 | 0.0009        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0493    1.00000 | 0.0311        1.00000 | 0.0493    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0493    1.00000 | 0.0311        1.00000 | 0.0493    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1214    1.00000 | 0.1214        1.00000 | 0.1214    1.00000 | 0.0044        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1214    1.00000 | 0.0840        1.00000 | 0.1214    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0530    1.00000 | 0.0530        1.00000 | 0.0530    1.00000 | 0.0006        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0530    1.00000 | 0.0413        1.00000 | 0.0530    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0530    1.00000 | 0.0413        1.00000 | 0.0530    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1551    1.00000 | 0.1551        1.00000 | 0.1551    1.00000 | 0.0036        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1551    1.00000 | 0.1083        1.00000 | 0.1551    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0811    1.00000 | 0.0811        1.00000 | 0.0811    1.00000 | 0.0016        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0811    1.00000 | 0.0398        1.00000 | 0.0811    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0811    1.00000 | 0.0398        1.00000 | 0.0811    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1552    1.00000 | 0.1552        1.00000 | 0.1552    1.00000 | 0.0047        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1552    1.00000 | 0.0980        1.00000 | 0.1552    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0831    1.00000 | 0.0831        1.00000 | 0.0831    1.00000 | 0.0021        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0831    1.00000 | 0.0382        1.00000 | 0.0831    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0831    1.00000 | 0.0382        1.00000 | 0.0831    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                       1.00000 | 0.1351    1.00000 | 0.1351        1.00000 | 0.1351    1.00000 | 0.0034        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                    1.00000 | 0.1351    1.00000 | 0.0875        1.00000 | 0.1351    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                       1.00000 | 0.1046    1.00000 | 0.1046        1.00000 | 0.1046    1.00000 | 0.0035        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                         1.00000 | 0.1046    1.00000 | 0.0495        1.00000 | 0.1046    1.00000 | 0.0           
[Transpose] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                    1.00000 | 0.1046    1.00000 | 0.0495        1.00000 | 0.1046    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1494    1.00000 | 0.1494        1.00000 | 0.1494    1.00000 | 0.0028        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1494    1.00000 | 0.0819        1.00000 | 0.1494    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1045    1.00000 | 0.1045        1.00000 | 0.1045    1.00000 | 0.0024        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1045    1.00000 | 0.0482        1.00000 | 0.1045    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1045    1.00000 | 0.0482        1.00000 | 0.1045    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1558    1.00000 | 0.1558        1.00000 | 0.1558    1.00000 | 0.0040        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1558    1.00000 | 0.0852        1.00000 | 0.1558    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1172    1.00000 | 0.1172        1.00000 | 0.1172    1.00000 | 0.0026        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1172    1.00000 | 0.0554        1.00000 | 0.1172    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1172    1.00000 | 0.0554        1.00000 | 0.1172    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1547    1.00000 | 0.1547        1.00000 | 0.1546    1.00000 | 0.0032        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1547    1.00000 | 0.0802        1.00000 | 0.1546    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1072    1.00000 | 0.1072        1.00000 | 0.1072    1.00000 | 0.0021        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1072    1.00000 | 0.0467        1.00000 | 0.1072    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1072    1.00000 | 0.0467        1.00000 | 0.1072    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1366    1.00000 | 0.1366        1.00000 | 0.1366    1.00000 | 0.0046        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1366    1.00000 | 0.0816        1.00000 | 0.1366    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1134    1.00000 | 0.1134        1.00000 | 0.1134    1.00000 | 0.0041        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1134    1.00000 | 0.0712        1.00000 | 0.1134    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1134    1.00000 | 0.0712        1.00000 | 0.1134    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1095    1.00000 | 0.1095        1.00000 | 0.1096    1.00000 | 0.0025        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1095    1.00000 | 0.0581        1.00000 | 0.1096    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0731    1.00000 | 0.0731        1.00000 | 0.0731    1.00000 | 0.0013        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0731    1.00000 | 0.0404        1.00000 | 0.0731    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0731    1.00000 | 0.0404        1.00000 | 0.0731    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1123    1.00000 | 0.1123        1.00000 | 0.1123    1.00000 | 0.0023        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1123    1.00000 | 0.0672        1.00000 | 0.1123    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0649    1.00000 | 0.0649        1.00000 | 0.0649    1.00000 | 0.0015        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0649    1.00000 | 0.0386        1.00000 | 0.0649    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0649    1.00000 | 0.0386        1.00000 | 0.0649    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1016    1.00000 | 0.1016        1.00000 | 0.1016    1.00000 | 0.0026        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1016    1.00000 | 0.0631        1.00000 | 0.1016    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0293    1.00000 | 0.0293        1.00000 | 0.0293    1.00000 | 0.0003        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0293    1.00000 | 0.0188        1.00000 | 0.0293    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0293    1.00000 | 0.0188        1.00000 | 0.0293    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1123    1.00000 | 0.1123        1.00000 | 0.1123    1.00000 | 0.0032        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1123    1.00000 | 0.0771        1.00000 | 0.1123    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0379    1.00000 | 0.0379        1.00000 | 0.0379    1.00000 | 0.0010        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0379    1.00000 | 0.0278        1.00000 | 0.0379    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0379    1.00000 | 0.0278        1.00000 | 0.0379    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1070    1.00000 | 0.1070        1.00000 | 0.1070    1.00000 | 0.0020        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1070    1.00000 | 0.0722        1.00000 | 0.1070    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0365    1.00000 | 0.0365        1.00000 | 0.0365    1.00000 | 0.0008        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0365    1.00000 | 0.0285        1.00000 | 0.0365    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0365    1.00000 | 0.0285        1.00000 | 0.0365    1.00000 | 0.0           
[Input] timestep_cond                                                                                   1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0018    1.00000 | 0.0018        
[Reshape] timestep_cond_tp_rs                                                                           1.00000 | 0.0018    1.00000 | 0.0018        1.00000 | 0.0018    1.00000 | 0.0           
[Input] timestep                                                                                        1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Reshape] /time_proj/Unsqueeze_output_0_rs                                                              1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Cast] /time_proj/Cast_output_0-rs                                                                      1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Mul] /time_proj/Mul_output_0-rs                                                                        1.00000 | 0.9044    1.00000 | 0.9044        1.00000 | 0.9044    1.00000 | 0.0           
[Cos] /time_proj/Cos_output_0-rs                                                                        0.99668 | 0.7595    0.99901 | 0.4166        0.99668 | 0.7595    1.00000 | 0.0           
[Sin] /time_proj/Sin_output_0-rs                                                                        0.99840 | 0.4852    0.99904 | 0.3757        0.99840 | 0.4852    1.00000 | 0.0           
[Concat] /time_proj/Concat_1_output_0-rs                                                                0.99746 | 0.9013    1.00000 | 0.0020        0.99746 | 0.9013    1.00000 | 0.0           
[exMatMul] /time_embedding/Add_output_0-rs                                                              0.99803 | 0.9015    1.00000 | 0.0037        0.99803 | 0.9015    1.00000 | 3.0517        
[Conv] /time_embedding/linear_1/Gemm_output_0_mm                                                        0.99999 | 0.1124    1.00000 | 0.0064        
[exSwish] /time_embedding/act/Mul_output_0-rs                                                           1.00000 | 0.0412    1.00000 | 0.0052        1.00000 | 0.0558    1.00000 | 0.0338        
[Conv] /time_embedding/linear_2/Gemm_output_0_mm                                                        1.00000 | 0.0125    1.00000 | 0.0037        
[exSwish] /down_blocks.0/resnets.0/act_1/Mul_output_0-rs                                                1.00000 | 0.0067    1.00000 | 0.0025        1.00000 | 0.0229    1.00000 | 0.0081        
[Conv] /up_blocks.3/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0082    1.00000 | 0.0043        1.00000 | 0.0456    1.00000 | 0.0002        
[Conv] /up_blocks.3/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0049    1.00000 | 0.0028        1.00000 | 0.0267    1.00000 | 0.0           
[Conv] /up_blocks.3/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0051    1.00000 | 0.0028        1.00000 | 0.0261    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0059    1.00000 | 0.0032        1.00000 | 0.0279    1.00000 | 1.5258        
[Conv] /up_blocks.2/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0059    1.00000 | 0.0034        1.00000 | 0.0273    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0077    1.00000 | 0.0046        1.00000 | 0.0384    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0088    1.00000 | 0.0053        1.00000 | 0.0515    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0086    1.00000 | 0.0049        1.00000 | 0.0468    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0118    1.00000 | 0.0072        1.00000 | 0.0701    1.00000 | 1.9073        
[Conv] /up_blocks.0/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0073    1.00000 | 0.0043        1.00000 | 0.0403    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0075    1.00000 | 0.0042        1.00000 | 0.0395    1.00000 | 0.0001        
[Conv] /up_blocks.0/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0063    1.00000 | 0.0033        1.00000 | 0.0339    1.00000 | 0.0005        
[Conv] /mid_block/resnets.1/time_emb_proj/Gemm_output_0_mm                                              1.00000 | 0.0076    1.00000 | 0.0043        1.00000 | 0.0417    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/time_emb_proj/Gemm_output_0_mm                                              1.00000 | 0.0101    1.00000 | 0.0062        1.00000 | 0.0567    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0092    1.00000 | 0.0051        1.00000 | 0.0490    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0090    1.00000 | 0.0059        1.00000 | 0.0534    1.00000 | 0.0004        
[Conv] /down_blocks.2/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0128    1.00000 | 0.0065        1.00000 | 0.0651    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0199    1.00000 | 0.0163        1.00000 | 0.1311    1.00000 | 1.9073        
[Conv] /down_blocks.1/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0072    1.00000 | 0.0039        1.00000 | 0.0390    1.00000 | 0.0004        
[Conv] /down_blocks.1/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0098    1.00000 | 0.0081        1.00000 | 0.0688    1.00000 | 3.0517        
[Conv] /down_blocks.0/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0061    1.00000 | 0.0032        1.00000 | 0.0314    1.00000 | 0.0           
[Conv] /down_blocks.0/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0204    1.00000 | 0.0106        1.00000 | 0.0941    1.00000 | 0.0           
[Input] sample                                                                                          1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0198    1.00000 | 0.0198        
[Conv] /conv_in/Conv_output_0                                                                           1.00000 | 0.0954    1.00000 | 0.0954        1.00000 | 0.1164    1.00000 | 0.1049        
[Reshape] /down_blocks.0/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.0954    1.00000 | 0.0682        1.00000 | 0.1164    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3050    1.00000 | 0.2516        0.99775 | 57.629    0.99775 | 57.628        
[Reshape] /down_blocks.0/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.3050    1.00000 | 0.1782        0.99775 | 57.629    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1648    1.00000 | 0.1178        0.99780 | 26.862    1.00000 | 0.1353        
[exSwish] /down_blocks.0/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0982    1.00000 | 0.0591        0.99760 | 13.442    1.00000 | 0.1579        
[Conv] /down_blocks.0/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.3180    1.00000 | 0.2264        0.99840 | 48.960    1.00000 | 0.0103        
[Add] /down_blocks.0/resnets.0/Add_output_0                                                             1.00000 | 1.1440    1.00000 | 0.7100        0.99977 | 48.745    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 1.1440    1.00000 | 0.4865        0.99977 | 48.745    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.4245    1.00000 | 0.2608        0.79848 | 1036.2    0.79899 | 1035.5        
[Reshape] /down_blocks.0/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.4245    1.00000 | 0.1770        0.79848 | 1036.2    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.0/norm2/Add_output_0                                        1.00000 | 0.2401    1.00000 | 0.1400        0.80415 | 728.08    1.00000 | 0.3410        
[exSwish] /down_blocks.0/resnets.0/act_2/Mul_output_0                                                   1.00000 | 0.0751    1.00000 | 0.0323        0.89997 | 53.299    0.99994 | 1.3389        
[Conv] /down_blocks.0/resnets.0/conv2/Conv_output_0                                                     1.00000 | 0.1945    1.00000 | 0.1243        
[Add] /down_blocks.0/resnets.0/Add_1_output_0                                                           1.00000 | 0.2529    1.00000 | 0.1846        0.97869 | 122.59    1.00000 | 0.1968        
[Reshape] /down_blocks.0/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.2529    1.00000 | 0.1254        0.97869 | 122.59    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.5969    1.00000 | 0.2662        0.89386 | 429.87    0.94890 | 306.85        
[Reshape] /down_blocks.0/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.5969    1.00000 | 0.1763        0.89386 | 429.87    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.1597    1.00000 | 0.0639        0.83664 | 99.236    1.00000 | 0.0019        
[Reshape] /down_blocks.0/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.1597    1.00000 | 0.0329        0.83664 | 99.236    1.00000 | 0.0           
[Reshape] /down_blocks.0/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.1597    1.00000 | 0.0329        0.83664 | 99.236    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.5392    1.00000 | 0.1666        0.79444 | 294.45    1.00000 | 0.4643        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5717    1.00000 | 0.1669        0.83169 | 336.31    1.00000 | 0.0055        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5717    1.00000 | 0.1187        0.83169 | 336.31    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5717    1.00000 | 0.1187        0.83169 | 336.31    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 1.0441    1.00000 | 0.2620        0.78992 | 531.01    1.00000 | 0.0077        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 1.0441    1.00000 | 0.1692        0.78992 | 531.01    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.9920    1.00000 | 0.2618        0.80620 | 517.68    1.00000 | 0.0070        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.9920    1.00000 | 0.1700        0.80620 | 517.68    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 11.536    1.00000 | 3.0699        0.66416 | 8282.7    1.00000 | 0.0774        
[exSoftmax13] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0112    1.00000 | 0.0056        0.79018 | 3.5304    1.00000 | 0.0121        
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2218    1.00000 | 0.0237        0.32463 | 276.62    1.00000 | 0.0027        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2218    1.00000 | 0.0229        0.32463 | 276.62    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1432    1.00000 | 0.0362        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.2035    1.00000 | 0.0583        0.72184 | 167.74    1.00000 | 0.0753        
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.3697    1.00000 | 0.1149        0.70563 | 249.56    1.00000 | 0.3431        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.4580    1.00000 | 0.1361        0.78203 | 330.44    1.00000 | 0.0043        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.4580    1.00000 | 0.0935        0.78203 | 330.44    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 2.6837    1.00000 | 1.3370        0.94825 | 1326.9    1.00000 | 0.0280        
[exSoftmax13] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0335    1.00000 | 0.0221        0.97298 | 29.344    1.00000 | 0.1825        
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1241    1.00000 | 0.0191        0.12919 | 146.78    1.00000 | 0.0020        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1241    1.00000 | 0.0115        0.12919 | 146.78    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0598    1.00000 | 0.0131        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.2191    1.00000 | 0.0613        0.72051 | 184.24    1.00000 | 0.0580        
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.4180    1.00000 | 0.1292        0.65067 | 294.41    1.00000 | 0.3451        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 1.2678    1.00000 | 0.3849        0.74518 | 923.09    1.00000 | 0.0113        
[Split] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.8189    1.00000 | 0.1471        0.70363 | 573.90    1.00000 | 0.0           
[Split] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.9678    1.00000 | 0.2318        0.77100 | 723.00    1.00000 | 0.0           
[exGelu] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.4192    1.00000 | 0.1264        0.70688 | 301.06    1.00000 | 0.3440        
[Mul] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2610    1.00000 | 0.0569        0.47243 | 184.22    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2558    1.00000 | 0.0585        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.3340    1.00000 | 0.0763        0.55981 | 249.80    1.00000 | 0.0863        
[Conv] /down_blocks.0/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.2603    1.00000 | 0.0604        0.58588 | 192.77    1.00000 | 0.0018        
[Reshape] /down_blocks.0/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.2603    1.00000 | 0.0386        0.58588 | 192.77    1.00000 | 0.0           
[Add] /down_blocks.0/attentions.0/Add_output_0                                                          1.00000 | 0.3447    1.00000 | 0.1780        0.93670 | 199.47    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.3447    1.00000 | 0.1158        0.93670 | 199.47    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.9161    1.00000 | 0.2654        0.77677 | 617.81    0.94723 | 314.63        
[Reshape] /down_blocks.0/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.9161    1.00000 | 0.1772        0.77677 | 617.81    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.1/norm1/Add_output_0                                        1.00000 | 0.3163    1.00000 | 0.0866        0.78792 | 205.71    1.00000 | 0.1143        
[exSwish] /down_blocks.0/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1418    1.00000 | 0.0330        0.71121 | 92.113    1.00000 | 0.1233        
[Conv] /down_blocks.0/resnets.1/conv1/Conv_output_0                                                     1.00000 | 0.3992    1.00000 | 0.1254        0.83905 | 257.20    1.00000 | 0.0051        
[Add] /down_blocks.0/resnets.1/Add_output_0                                                             1.00000 | 0.5324    1.00000 | 0.2509        0.95047 | 257.30    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.5324    1.00000 | 0.1732        0.95047 | 257.30    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.6131    1.00000 | 0.2559        0.86249 | 561.42    0.92157 | 451.65        
[Reshape] /down_blocks.0/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.6131    1.00000 | 0.1752        0.86249 | 561.42    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.1/norm2/Add_output_0                                        1.00000 | 0.4056    1.00000 | 0.1731        0.88765 | 350.24    1.00000 | 0.2651        
[exSwish] /down_blocks.0/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1489    1.00000 | 0.0342        0.75220 | 102.42    1.00000 | 0.1681        
[Conv] /down_blocks.0/resnets.1/conv2/Conv_output_0                                                     1.00000 | 0.3245    1.00000 | 0.0952        
[Add] /down_blocks.0/resnets.1/Add_1_output_0                                                           1.00000 | 0.4669    1.00000 | 0.1852        0.90521 | 264.46    1.00000 | 0.1623        
[Reshape] /down_blocks.0/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.4669    1.00000 | 0.1237        0.90521 | 264.46    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.9499    1.00000 | 0.2573        0.79785 | 575.84    0.95729 | 273.75        
[Reshape] /down_blocks.0/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.9499    1.00000 | 0.1778        0.79785 | 575.84    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.3325    1.00000 | 0.1014        0.80902 | 187.15    1.00000 | 0.0026        
[Reshape] /down_blocks.0/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3325    1.00000 | 0.0606        0.80902 | 187.15    1.00000 | 0.0           
[Reshape] /down_blocks.0/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.3325    1.00000 | 0.0606        0.80902 | 187.15    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.7107    1.00000 | 0.1708        0.71964 | 367.24    1.00000 | 0.5312        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.7638    1.00000 | 0.1784        0.81816 | 392.78    1.00000 | 0.0053        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.7638    1.00000 | 0.1241        0.81816 | 392.78    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.7638    1.00000 | 0.1241        0.81816 | 392.78    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 1.4379    1.00000 | 0.2969        0.77874 | 689.91    1.00000 | 0.0086        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 1.4379    1.00000 | 0.2096        0.77874 | 689.91    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 1.3458    1.00000 | 0.2807        0.77497 | 656.63    1.00000 | 0.0099        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 1.3458    1.00000 | 0.1942        0.77497 | 656.63    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 20.878    1.00000 | 6.0511        0.92599 | 10956.    1.00000 | 0.1837        
[exSoftmax13] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0139    1.00000 | 0.0071        0.67083 | 4.2073    1.00000 | 0.0083        
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2886    1.00000 | 0.0343        0.42135 | 280.58    1.00000 | 0.0032        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2886    1.00000 | 0.0336        0.42135 | 280.58    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.2122    1.00000 | 0.0622        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3532    1.00000 | 0.1124        0.76452 | 238.14    1.00000 | 0.1036        
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2842    1.00000 | 0.1003        0.75464 | 184.83    1.00000 | 0.2701        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.2668    1.00000 | 0.0868        0.80654 | 191.89    1.00000 | 0.0030        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.2668    1.00000 | 0.0612        0.80654 | 191.89    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.7016    1.00000 | 0.8623        0.95852 | 779.11    1.00000 | 0.0195        
[exSoftmax13] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0472    1.00000 | 0.0244        0.91552 | 44.084    1.00000 | 0.1272        
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1873    1.00000 | 0.0378        0.69268 | 164.74    1.00000 | 0.0027        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1873    1.00000 | 0.0264        0.69268 | 164.74    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0906    1.00000 | 0.0290        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3720    1.00000 | 0.1087        0.78024 | 251.67    1.00000 | 0.0833        
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.4257    1.00000 | 0.1115        0.66173 | 282.12    1.00000 | 0.3715        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 1.1380    1.00000 | 0.3078        0.79726 | 722.47    1.00000 | 0.0109        
[Split] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.8469    1.00000 | 0.1353        0.77340 | 528.58    1.00000 | 0.0           
[Split] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.7601    1.00000 | 0.1596        0.82030 | 492.50    1.00000 | 0.0           
[exGelu] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.3613    1.00000 | 0.0939        0.73096 | 271.17    1.00000 | 0.3665        
[Mul] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2021    1.00000 | 0.0400        0.55374 | 171.27    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2212    1.00000 | 0.0463        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4307    1.00000 | 0.1104        0.65472 | 316.60    1.00000 | 0.1188        
[Conv] /down_blocks.0/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.4544    1.00000 | 0.1248        0.80872 | 297.45    1.00000 | 0.0050        
[Reshape] /down_blocks.0/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.4544    1.00000 | 0.0902        0.80872 | 297.45    1.00000 | 0.0           
[Add] /down_blocks.0/attentions.1/Add_output_0                                                          1.00000 | 0.5170    1.00000 | 0.1702        0.73068 | 325.70    1.00000 | 0.0           
[Conv] /down_blocks.0/downsamplers.0/conv/Conv_output_0                                                 1.00000 | 0.4343    1.00000 | 0.1059        0.72326 | 303.78    1.00000 | 0.0043        
[Reshape] /down_blocks.1/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.4343    1.00000 | 0.0751        0.72326 | 303.78    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.6000    1.00000 | 0.1269        0.69280 | 336.40    1.00000 | 0.4371        
[Reshape] /down_blocks.1/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.6000    1.00000 | 0.0894        0.69280 | 336.40    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1525    1.00000 | 0.0310        0.66898 | 83.480    1.00000 | 0.0328        
[exSwish] /down_blocks.1/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0753    1.00000 | 0.0147        0.67044 | 39.893    1.00000 | 0.0586        
[Conv] /down_blocks.1/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.3407    1.00000 | 0.0908        0.75881 | 235.33    1.00000 | 0.0034        
[Add] /down_blocks.1/resnets.0/Add_output_0                                                             1.00000 | 0.4484    1.00000 | 0.2772        0.96180 | 235.70    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.4484    1.00000 | 0.1830        0.96180 | 235.70    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.6673    1.00000 | 0.1876        0.81897 | 364.88    1.00000 | 1.6028        
[Reshape] /down_blocks.1/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.6673    1.00000 | 0.1285        0.81897 | 364.88    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.0/norm2/Add_output_0                                        1.00000 | 0.3225    1.00000 | 0.1040        0.82340 | 220.06    1.00000 | 0.1296        
[exSwish] /down_blocks.1/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.1439    1.00000 | 0.0244        0.65254 | 63.961    1.00000 | 0.1066        
[Conv] /down_blocks.1/resnets.0/conv2/Conv_output_0                                                     1.00000 | 0.4490    1.00000 | 0.0960        
[Conv] /down_blocks.1/resnets.0/conv_shortcut/Conv_output_0                                             1.00000 | 0.2789    1.00000 | 0.1005        0.83989 | 182.57    1.00000 | 0.0032        
[Add] /down_blocks.1/resnets.0/Add_1_output_0                                                           1.00000 | 0.5170    1.00000 | 0.1428        0.85590 | 249.69    1.00000 | 0.1360        
[Reshape] /down_blocks.1/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.5170    1.00000 | 0.0990        0.85590 | 249.69    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.7395    1.00000 | 0.1802        0.83342 | 350.03    1.00000 | 1.5768        
[Reshape] /down_blocks.1/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.7395    1.00000 | 0.1260        0.83342 | 350.03    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.3204    1.00000 | 0.0801        0.81016 | 149.82    1.00000 | 0.0020        
[Reshape] /down_blocks.1/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3204    1.00000 | 0.0509        0.81016 | 149.82    1.00000 | 0.0           
[Reshape] /down_blocks.1/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.3204    1.00000 | 0.0509        0.81016 | 149.82    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.3721    1.00000 | 0.0827        0.74216 | 167.59    1.00000 | 0.2835        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5227    1.00000 | 0.1013        0.75846 | 233.98    1.00000 | 0.0034        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5227    1.00000 | 0.0682        0.75846 | 233.98    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5227    1.00000 | 0.0682        0.75846 | 233.98    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.8630    1.00000 | 0.1835        0.76970 | 389.29    1.00000 | 0.0057        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.8630    1.00000 | 0.1209        0.76970 | 389.29    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.8537    1.00000 | 0.1776        0.77802 | 376.46    1.00000 | 0.0057        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.8537    1.00000 | 0.1198        0.77802 | 376.46    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 4.1064    1.00000 | 0.8169        0.76533 | 2052.4    1.00000 | 0.0267        
[exSoftmax13] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0225    1.00000 | 0.0129        0.71923 | 6.2897    1.00000 | 0.0096        
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2459    1.00000 | 0.0258        0.47589 | 139.22    1.00000 | 0.0010        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2459    1.00000 | 0.0232        0.47589 | 139.22    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.2274    1.00000 | 0.0492        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3667    1.00000 | 0.0796        0.74435 | 176.99    1.00000 | 0.0730        
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.3931    1.00000 | 0.0848        0.72279 | 184.50    1.00000 | 0.2999        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.5720    1.00000 | 0.1329        0.78473 | 300.51    1.00000 | 0.0042        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.5720    1.00000 | 0.0912        0.78473 | 300.51    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.6372    1.00000 | 0.6914        0.95071 | 1011.0    1.00000 | 0.0265        
[exSoftmax13] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0216    1.00000 | 0.0106        0.99130 | 9.1238    1.00000 | 0.0820        
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1006    1.00000 | 0.0146        0.75846 | 36.682    1.00000 | 0.0002        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1006    1.00000 | 0.0120        0.75846 | 36.682    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0692    1.00000 | 0.0176        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3772    1.00000 | 0.0783        0.77419 | 179.76    1.00000 | 0.0494        
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.2592    1.00000 | 0.0593        0.69841 | 121.42    1.00000 | 0.1930        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.9946    1.00000 | 0.2295        0.83399 | 427.50    1.00000 | 0.0075        
[Split] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.7002    1.00000 | 0.1013        0.81304 | 302.54    1.00000 | 0.0           
[Split] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.7064    1.00000 | 0.1155        0.85105 | 302.04    1.00000 | 0.0           
[exGelu] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.3505    1.00000 | 0.0744        0.81087 | 148.73    1.00000 | 0.2132        
[Mul] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2066    1.00000 | 0.0359        0.65391 | 84.719    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.3039    1.00000 | 0.0565        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4763    1.00000 | 0.0851        0.64746 | 210.90    1.00000 | 0.0720        
[Conv] /down_blocks.1/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.5509    1.00000 | 0.0980        0.66052 | 240.90    1.00000 | 0.0027        
[Reshape] /down_blocks.1/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.5509    1.00000 | 0.0599        0.66052 | 240.90    1.00000 | 0.0           
[Add] /down_blocks.1/attentions.0/Add_output_0                                                          1.00000 | 0.5941    1.00000 | 0.1484        0.81968 | 253.96    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.5941    1.00000 | 0.0893        0.81968 | 253.96    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.9204    1.00000 | 0.1785        0.79106 | 391.97    1.00000 | 1.6395        
[Reshape] /down_blocks.1/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.9204    1.00000 | 0.1256        0.79106 | 391.97    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.1/norm1/Add_output_0                                        1.00000 | 0.2908    1.00000 | 0.0565        0.81457 | 118.95    1.00000 | 0.0626        
[exSwish] /down_blocks.1/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1375    1.00000 | 0.0234        0.75165 | 55.764    1.00000 | 0.0824        
[Conv] /down_blocks.1/resnets.1/conv1/Conv_output_0                                                     1.00000 | 0.6080    1.00000 | 0.1249        0.83935 | 243.65    1.00000 | 0.0052        
[Add] /down_blocks.1/resnets.1/Add_output_0                                                             1.00000 | 0.6341    1.00000 | 0.1865        0.92061 | 243.71    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.6341    1.00000 | 0.1288        0.92061 | 243.71    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.7121    1.00000 | 0.1882        0.89849 | 273.25    1.00000 | 1.5610        
[Reshape] /down_blocks.1/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.7121    1.00000 | 0.1242        0.89849 | 273.25    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.1/norm2/Add_output_0                                        1.00000 | 0.4328    1.00000 | 0.1240        0.93899 | 156.00    1.00000 | 0.1478        
[exSwish] /down_blocks.1/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1721    1.00000 | 0.0287        0.80083 | 62.423    1.00000 | 0.0927        
[Conv] /down_blocks.1/resnets.1/conv2/Conv_output_0                                                     1.00000 | 0.5563    1.00000 | 0.1100        
[Add] /down_blocks.1/resnets.1/Add_1_output_0                                                           1.00000 | 0.7287    1.00000 | 0.1582        0.83447 | 283.96    1.00000 | 0.1404        
[Reshape] /down_blocks.1/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.7287    1.00000 | 0.1042        0.83447 | 283.96    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.9157    1.00000 | 0.1782        0.83268 | 350.77    1.00000 | 1.6986        
[Reshape] /down_blocks.1/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.9157    1.00000 | 0.1253        0.83268 | 350.77    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.4758    1.00000 | 0.1156        0.88115 | 176.03    1.00000 | 0.0026        
[Reshape] /down_blocks.1/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.4758    1.00000 | 0.0785        0.88115 | 176.03    1.00000 | 0.0           
[Reshape] /down_blocks.1/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.4758    1.00000 | 0.0785        0.88115 | 176.03    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.4040    1.00000 | 0.0902        0.80211 | 149.26    1.00000 | 0.3053        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5413    1.00000 | 0.0994        0.81530 | 195.57    1.00000 | 0.0035        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5413    1.00000 | 0.0656        0.81530 | 195.57    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5413    1.00000 | 0.0656        0.81530 | 195.57    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.8447    1.00000 | 0.1794        0.83285 | 314.95    1.00000 | 0.0048        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.8447    1.00000 | 0.1148        0.83285 | 314.95    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.8617    1.00000 | 0.1756        0.83642 | 317.86    1.00000 | 0.0051        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.8617    1.00000 | 0.1155        0.83642 | 317.86    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 3.6148    1.00000 | 0.7174        0.84117 | 1332.9    1.00000 | 0.0180        
[exSoftmax13] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0124    1.00000 | 0.0051        0.79228 | 3.4093    1.00000 | 0.0055        
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.1812    1.00000 | 0.0202        0.63328 | 90.161    1.00000 | 0.0007        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.1812    1.00000 | 0.0188        0.63328 | 90.161    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1849    1.00000 | 0.0419        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.4989    1.00000 | 0.1196        0.90267 | 183.51    1.00000 | 0.1007        
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2878    1.00000 | 0.0780        0.89099 | 104.51    1.00000 | 0.2614        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.3378    1.00000 | 0.0894        0.90373 | 130.22    1.00000 | 0.0030        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.3378    1.00000 | 0.0589        0.90373 | 130.22    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.1480    1.00000 | 0.5785        0.98866 | 317.21    1.00000 | 0.0177        
[exSoftmax13] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0247    1.00000 | 0.0114        0.99750 | 4.7586    1.00000 | 0.1060        
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1169    1.00000 | 0.0125        0.86980 | 22.317    1.00000 | 0.0002        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1169    1.00000 | 0.0089        0.86980 | 22.317    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0820    1.00000 | 0.0150        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.5107    1.00000 | 0.1175        0.91677 | 184.34    1.00000 | 0.0684        
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.2297    1.00000 | 0.0516        0.80470 | 82.305    1.00000 | 0.1862        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.9067    1.00000 | 0.1935        0.86298 | 317.09    1.00000 | 0.0061        
[Split] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.6647    1.00000 | 0.0838        0.83757 | 231.98    1.00000 | 0.0           
[Split] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.6167    1.00000 | 0.0918        0.88405 | 216.17    1.00000 | 0.0           
[exGelu] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.2845    1.00000 | 0.0521        0.84264 | 100.55    1.00000 | 0.1505        
[Mul] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1519    1.00000 | 0.0280        0.83004 | 49.397    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2544    1.00000 | 0.0720        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.5643    1.00000 | 0.1209        0.85193 | 191.43    1.00000 | 0.1007        
[Conv] /down_blocks.1/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.8221    1.00000 | 0.1731        0.92923 | 252.63    1.00000 | 0.0046        
[Reshape] /down_blocks.1/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.8221    1.00000 | 0.1285        0.92923 | 252.63    1.00000 | 0.0           
[Add] /down_blocks.1/attentions.1/Add_output_0                                                          1.00000 | 0.6987    1.00000 | 0.2193        0.94496 | 199.71    1.00000 | 0.0           
[Conv] /down_blocks.1/downsamplers.0/conv/Conv_output_0                                                 1.00000 | 0.5466    1.00000 | 0.1098        0.80030 | 206.34    1.00000 | 0.0033        
[Reshape] /down_blocks.2/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.5466    1.00000 | 0.0679        0.80030 | 206.34    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.5160    1.00000 | 0.0884        0.79712 | 193.11    1.00000 | 0.8808        
[Reshape] /down_blocks.2/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.5160    1.00000 | 0.0625        0.79712 | 193.11    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1794    1.00000 | 0.0322        0.82941 | 64.911    1.00000 | 0.0344        
[exSwish] /down_blocks.2/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0916    1.00000 | 0.0192        0.84064 | 34.258    1.00000 | 0.0583        
[Conv] /down_blocks.2/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.5233    1.00000 | 0.1522        0.93460 | 209.25    1.00000 | 0.0047        
[Add] /down_blocks.2/resnets.0/Add_output_0                                                             1.00000 | 0.6200    1.00000 | 0.2824        0.97701 | 209.47    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.6200    1.00000 | 0.2161        0.97701 | 209.47    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.4713    1.00000 | 0.1292        0.91428 | 177.69    1.00000 | 0.5023        
[Reshape] /down_blocks.2/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.4713    1.00000 | 0.0873        0.91428 | 177.69    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.0/norm2/Add_output_0                                        1.00000 | 0.2327    1.00000 | 0.0781        0.95531 | 80.975    1.00000 | 0.0819        
[exSwish] /down_blocks.2/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.0932    1.00000 | 0.0182        0.85270 | 32.255    1.00000 | 0.1542        
[Split] /down_blocks.2/resnets.0/act_1/Mul_output_0_split                                               1.00000 | 0.0565    1.00000 | 0.0074        0.84847 | 19.287    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.0/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0741    1.00000 | 0.0096        0.85528 | 25.853    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.0/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2558    1.00000 | 0.0541        
[Conv] /down_blocks.2/resnets.0/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.3376    1.00000 | 0.0720        0.88446 | 126.98    1.00000 | 0.0036        
[Add] /down_blocks.2/resnets.0/conv2/Conv_output_0                                                      1.00000 | 0.4733    1.00000 | 0.1102        0.89326 | 174.44    1.00000 | 0.1096        
[Conv] /down_blocks.2/resnets.0/conv_shortcut/Conv_output_0                                             1.00000 | 0.3602    1.00000 | 0.0833        
[Add] /down_blocks.2/resnets.0/Add_1_output_0                                                           1.00000 | 0.5978    1.00000 | 0.1401        0.89210 | 213.68    1.00000 | 0.1209        
[Reshape] /down_blocks.2/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.5978    1.00000 | 0.0959        0.89210 | 213.68    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.5665    1.00000 | 0.1257        0.89013 | 201.19    1.00000 | 0.4807        
[Reshape] /down_blocks.2/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.5665    1.00000 | 0.0892        0.89013 | 201.19    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.2730    1.00000 | 0.0676        0.92327 | 94.807    1.00000 | 0.0016        
[Reshape] /down_blocks.2/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.2730    1.00000 | 0.0496        0.92327 | 94.807    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.2730    1.00000 | 0.0496        0.92327 | 94.807    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.1330    1.00000 | 0.0323        0.85764 | 46.281    1.00000 | 0.1020        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.2545    1.00000 | 0.0492        0.87457 | 87.891    1.00000 | 0.0013        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.2545    1.00000 | 0.0365        0.87457 | 87.891    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.2545    1.00000 | 0.0365        0.87457 | 87.891    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.4349    1.00000 | 0.0921        0.89971 | 152.35    1.00000 | 0.0039        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.4349    1.00000 | 0.0707        0.89971 | 152.35    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.4326    1.00000 | 0.0925        0.90334 | 148.09    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.4326    1.00000 | 0.0704        0.90334 | 148.09    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 0.8449    1.00000 | 0.2512        0.93196 | 288.47    1.00000 | 0.0083        
[exSoftmax13] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0156    1.00000 | 0.0088        0.92797 | 3.4656    1.00000 | 0.0079        
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.1215    1.00000 | 0.0189        0.81164 | 46.025    1.00000 | 0.0004        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.1215    1.00000 | 0.0149        0.81164 | 46.025    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1874    1.00000 | 0.0448        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3186    1.00000 | 0.0734        0.85753 | 114.43    1.00000 | 0.0613        
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.1872    1.00000 | 0.0448        0.84339 | 67.002    1.00000 | 0.1131        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.2927    1.00000 | 0.0720        0.91289 | 118.86    1.00000 | 0.0020        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.2927    1.00000 | 0.0568        0.91289 | 118.86    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 0.6824    1.00000 | 0.4474        0.98919 | 302.08    1.00000 | 0.0154        
[exSoftmax13] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0107    1.00000 | 0.0051        0.99794 | 2.5821    1.00000 | 0.0520        
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.0668    1.00000 | 0.0098        0.93093 | 15.803    1.00000 | 0.0002        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.0668    1.00000 | 0.0080        0.93093 | 15.803    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0725    1.00000 | 0.0137        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3278    1.00000 | 0.0657        0.86323 | 116.24    1.00000 | 0.0369        
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.1321    1.00000 | 0.0281        0.84601 | 46.455    1.00000 | 0.0951        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.7016    1.00000 | 0.1693        0.90278 | 257.66    1.00000 | 0.0055        
[Split] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.5047    1.00000 | 0.0771        0.88407 | 180.85    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.4874    1.00000 | 0.0932        0.91601 | 183.52    1.00000 | 0.0           
[exGelu] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.2268    1.00000 | 0.0539        0.88827 | 83.311    1.00000 | 0.1506        
[Mul] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1596    1.00000 | 0.0310        0.83192 | 54.729    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.3186    1.00000 | 0.0716        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4462    1.00000 | 0.0831        0.82649 | 146.84    1.00000 | 0.0808        
[Conv] /down_blocks.2/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.7061    1.00000 | 0.1326        0.86478 | 221.02    1.00000 | 0.0033        
[Reshape] /down_blocks.2/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.7061    1.00000 | 0.0895        0.86478 | 221.02    1.00000 | 0.0           
[Add] /down_blocks.2/attentions.0/Add_output_0                                                          1.00000 | 0.7312    1.00000 | 0.1683        0.90818 | 224.99    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.7312    1.00000 | 0.1064        0.90818 | 224.99    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.5890    1.00000 | 0.1239        0.90666 | 185.41    1.00000 | 0.5214        
[Reshape] /down_blocks.2/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.5890    1.00000 | 0.0908        0.90666 | 185.41    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.1/norm1/Add_output_0                                        1.00000 | 0.2513    1.00000 | 0.0560        0.93295 | 76.042    1.00000 | 0.0759        
[exSwish] /down_blocks.2/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1114    1.00000 | 0.0190        0.85802 | 35.043    1.00000 | 0.1242        
[Split] /down_blocks.2/resnets.1/act/Mul_output_0_split                                                 1.00000 | 0.0779    1.00000 | 0.0097        0.85822 | 24.685    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.1/act/Mul_output_0_split_o1                                              1.00000 | 0.0796    1.00000 | 0.0096        0.85787 | 24.873    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.1/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.3959    1.00000 | 0.0826        
[Conv] /down_blocks.2/resnets.1/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.4082    1.00000 | 0.0804        0.89597 | 131.88    1.00000 | 0.0035        
[Add] /down_blocks.2/resnets.1/conv1/Conv_output_0                                                      1.00000 | 0.6219    1.00000 | 0.1390        0.91928 | 194.44    1.00000 | 0.1499        
[Add] /down_blocks.2/resnets.1/Add_output_0                                                             1.00000 | 0.6427    1.00000 | 0.1921        0.95755 | 194.39    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.6427    1.00000 | 0.1380        0.95755 | 194.39    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.5003    1.00000 | 0.1352        0.93866 | 150.34    1.00000 | 0.4279        
[Reshape] /down_blocks.2/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.5003    1.00000 | 0.0893        0.93866 | 150.34    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.1/norm2/Add_output_0                                        1.00000 | 0.3198    1.00000 | 0.1002        0.96832 | 91.041    1.00000 | 0.1122        
[exSwish] /down_blocks.2/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1075    1.00000 | 0.0189        0.88218 | 31.023    1.00000 | 0.0957        
[Split] /down_blocks.2/resnets.1/act_1/Mul_output_0_split                                               1.00000 | 0.0769    1.00000 | 0.0101        0.88717 | 21.748    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.1/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0751    1.00000 | 0.0099        0.87693 | 22.123    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.1/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.3206    1.00000 | 0.0602        
[Conv] /down_blocks.2/resnets.1/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.3009    1.00000 | 0.0593        0.87411 | 92.896    1.00000 | 0.0023        
[Add] /down_blocks.2/resnets.1/conv2/Conv_output_0                                                      1.00000 | 0.4676    1.00000 | 0.0830        0.87405 | 137.80    1.00000 | 0.0852        
[Add] /down_blocks.2/resnets.1/Add_1_output_0                                                           1.00000 | 0.8160    1.00000 | 0.1736        0.91619 | 233.17    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.8160    1.00000 | 0.1188        0.91619 | 233.17    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.6050    1.00000 | 0.1252        0.91530 | 176.65    1.00000 | 0.4461        
[Reshape] /down_blocks.2/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.6050    1.00000 | 0.0910        0.91530 | 176.65    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.3342    1.00000 | 0.0868        0.94459 | 99.391    1.00000 | 0.0015        
[Reshape] /down_blocks.2/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3342    1.00000 | 0.0620        0.94459 | 99.391    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.3342    1.00000 | 0.0620        0.94459 | 99.391    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.1360    1.00000 | 0.0315        0.87512 | 39.727    1.00000 | 0.0800        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.2893    1.00000 | 0.0492        0.87686 | 84.137    1.00000 | 0.0014        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.2893    1.00000 | 0.0357        0.87686 | 84.137    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.2893    1.00000 | 0.0357        0.87686 | 84.137    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.3801    1.00000 | 0.0750        0.90521 | 110.70    1.00000 | 0.0024        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.3801    1.00000 | 0.0534        0.90521 | 110.70    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.3781    1.00000 | 0.0818        0.91723 | 108.15    1.00000 | 0.0023        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.3781    1.00000 | 0.0558        0.91723 | 108.15    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 0.5152    1.00000 | 0.1240        0.93713 | 134.71    1.00000 | 0.0031        
[exSoftmax13] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0057    1.00000 | 0.0017        0.95594 | 1.1868    1.00000 | 0.0026        
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.0987    1.00000 | 0.0144        0.86389 | 34.435    1.00000 | 0.0005        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.0987    1.00000 | 0.0130        0.86389 | 34.435    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1637    1.00000 | 0.0430        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3641    1.00000 | 0.0885        0.91076 | 107.63    1.00000 | 0.0669        
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2249    1.00000 | 0.0500        0.87548 | 69.282    1.00000 | 0.1394        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.3507    1.00000 | 0.0839        0.92832 | 110.15    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.3507    1.00000 | 0.0601        0.92832 | 110.15    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 0.5503    1.00000 | 0.4629        0.99659 | 136.41    1.00000 | 0.0103        
[exSoftmax13] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0133    1.00000 | 0.0050        0.99556 | 3.1225    1.00000 | 0.0442        
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.0962    1.00000 | 0.0150        0.94576 | 21.637    1.00000 | 0.0004        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.0962    1.00000 | 0.0132        0.94576 | 21.637    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.1106    1.00000 | 0.0243        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3808    1.00000 | 0.0771        0.91084 | 111.27    1.00000 | 0.0473        
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.1618    1.00000 | 0.0388        0.87110 | 48.969    1.00000 | 0.0963        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.8751    1.00000 | 0.2230        0.95011 | 260.00    1.00000 | 0.0071        
[Split] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.5923    1.00000 | 0.0886        0.91374 | 178.79    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.6442    1.00000 | 0.1467        0.96392 | 188.77    1.00000 | 0.0           
[exGelu] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.1993    1.00000 | 0.0437        0.91913 | 60.008    1.00000 | 0.1860        
[Mul] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1483    1.00000 | 0.0287        0.83670 | 45.030    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2626    1.00000 | 0.0520        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4581    1.00000 | 0.0826        0.85304 | 131.64    1.00000 | 0.0702        
[Conv] /down_blocks.2/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.6738    1.00000 | 0.1230        0.87419 | 193.59    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.6738    1.00000 | 0.0798        0.87419 | 193.59    1.00000 | 0.0           
[Add] /down_blocks.2/attentions.1/Add_output_0                                                          1.00000 | 0.7400    1.00000 | 0.1940        0.92905 | 188.25    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/Add_output_0_split                                                  1.00000 | 0.5295    1.00000 | 0.0731        0.92884 | 133.61    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/Add_output_0_split_o1                                               1.00000 | 0.5168    1.00000 | 0.0709        0.92927 | 132.61    1.00000 | 0.0           
[Conv] /down_blocks.2/downsamplers.0/conv/Conv_output_0_tile0_conv                                      1.00000 | 0.4451    1.00000 | 0.0883        
[Conv] /down_blocks.2/downsamplers.0/conv/Conv_output_0_tile1_conv                                      1.00000 | 0.4331    1.00000 | 0.0871        0.89205 | 128.66    1.00000 | 0.0031        
[Add] /down_blocks.2/downsamplers.0/conv/Conv_output_0                                                  1.00000 | 0.6325    1.00000 | 0.1185        0.88492 | 188.07    1.00000 | 0.1220        
[Reshape] /down_blocks.3/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6325    1.00000 | 0.0807        0.88492 | 188.07    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3527    1.00000 | 0.0630        0.88368 | 103.49    1.00000 | 0.2748        
[Reshape] /down_blocks.3/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.3527    1.00000 | 0.0444        0.88368 | 103.49    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1418    1.00000 | 0.0262        0.89823 | 41.274    1.00000 | 0.0299        
[exSwish] /down_blocks.3/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0713    1.00000 | 0.0126        0.87967 | 20.538    1.00000 | 0.0361        
[Split] /down_blocks.3/resnets.0/act/Mul_output_0_split                                                 1.00000 | 0.0508    1.00000 | 0.0061        0.87555 | 14.566    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.0/act/Mul_output_0_split_o1                                              1.00000 | 0.0499    1.00000 | 0.0062        0.88357 | 14.478    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.1920    1.00000 | 0.0377        
[Conv] /down_blocks.3/resnets.0/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.1941    1.00000 | 0.0399        0.91631 | 59.608    1.00000 | 0.0019        
[Add] /down_blocks.3/resnets.0/conv1/Conv_output_0                                                      1.00000 | 0.2997    1.00000 | 0.0669        0.92233 | 93.302    1.00000 | 0.0733        
[Add] /down_blocks.3/resnets.0/Add_output_0                                                             1.00000 | 0.3105    1.00000 | 0.0898        0.95398 | 93.287    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.3105    1.00000 | 0.0628        0.95398 | 93.287    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.2466    1.00000 | 0.0657        0.94500 | 71.169    1.00000 | 0.2475        
[Reshape] /down_blocks.3/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.2466    1.00000 | 0.0448        0.94500 | 71.169    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.0/norm2/Add_output_0                                        1.00000 | 0.1831    1.00000 | 0.0513        0.95993 | 52.109    1.00000 | 0.0560        
[exSwish] /down_blocks.3/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.0823    1.00000 | 0.0164        0.90543 | 22.832    1.00000 | 0.0404        
[Split] /down_blocks.3/resnets.0/act_1/Mul_output_0_split                                               1.00000 | 0.0592    1.00000 | 0.0081        0.90256 | 16.383    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.0/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0571    1.00000 | 0.0079        0.90833 | 15.902    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2435    1.00000 | 0.0505        
[Conv] /down_blocks.3/resnets.0/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.2313    1.00000 | 0.0500        0.91744 | 67.365    1.00000 | 0.0029        
[Add] /down_blocks.3/resnets.0/conv2/Conv_output_0                                                      1.00000 | 0.3622    1.00000 | 0.0738        0.90453 | 105.13    1.00000 | 0.0742        
[Add] /down_blocks.3/resnets.0/Add_1_output_0                                                           1.00000 | 0.6532    1.00000 | 0.1310        0.89878 | 188.98    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6532    1.00000 | 0.0865        0.89878 | 188.98    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3403    1.00000 | 0.0629        0.89719 | 97.295    1.00000 | 0.2710        
[Reshape] /down_blocks.3/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.3403    1.00000 | 0.0446        0.89719 | 97.295    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.1/norm1/Add_output_0                                        1.00000 | 0.1655    1.00000 | 0.0328        0.92300 | 46.378    1.00000 | 0.0376        
[exSwish] /down_blocks.3/resnets.1/act/Mul_output_0                                                     1.00000 | 0.0766    1.00000 | 0.0136        0.89530 | 21.007    1.00000 | 0.0377        
[Split] /down_blocks.3/resnets.1/act/Mul_output_0_split                                                 1.00000 | 0.0546    1.00000 | 0.0067        0.89269 | 14.943    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.1/act/Mul_output_0_split_o1                                              1.00000 | 0.0536    1.00000 | 0.0068        0.89786 | 14.765    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.1956    1.00000 | 0.0414        
[Conv] /down_blocks.3/resnets.1/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.1951    1.00000 | 0.0417        0.93178 | 55.024    1.00000 | 0.0014        
[Add] /down_blocks.3/resnets.1/conv1/Conv_output_0                                                      1.00000 | 0.2966    1.00000 | 0.0713        0.93990 | 86.909    1.00000 | 0.0782        
[Add] /down_blocks.3/resnets.1/Add_output_0                                                             1.00000 | 0.3101    1.00000 | 0.0900        0.96200 | 86.881    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.3101    1.00000 | 0.0644        0.96200 | 86.881    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.2367    1.00000 | 0.0664        0.95463 | 64.647    1.00000 | 0.1932        
[Reshape] /down_blocks.3/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.2367    1.00000 | 0.0448        0.95463 | 64.647    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.1/norm2/Add_output_0                                        1.00000 | 0.1994    1.00000 | 0.0581        0.96858 | 53.625    1.00000 | 0.0630        
[exSwish] /down_blocks.3/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.0778    1.00000 | 0.0156        0.91545 | 20.549    1.00000 | 0.0381        
[Split] /down_blocks.3/resnets.1/act_1/Mul_output_0_split                                               1.00000 | 0.0547    1.00000 | 0.0075        0.90907 | 14.765    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.1/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0554    1.00000 | 0.0078        0.92135 | 14.292    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2067    1.00000 | 0.0452        
[Conv] /down_blocks.3/resnets.1/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.2122    1.00000 | 0.0471        0.92565 | 57.850    1.00000 | 0.0019        
[Add] /down_blocks.3/resnets.1/conv2/Conv_output_0                                                      1.00000 | 0.3164    1.00000 | 0.0646        0.91921 | 85.861    1.00000 | 0.0653        
[Add] /down_blocks.3/resnets.1/Add_1_output_0                                                           1.00000 | 0.7013    1.00000 | 0.1410        0.90927 | 198.24    1.00000 | 0.0           
[Reshape] /mid_block/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                       1.00000 | 0.7013    1.00000 | 0.0954        0.90927 | 198.24    1.00000 | 0.0           
[exNorm] /mid_block/resnets.0/norm1/InstanceNormalization_output_0-rs                                   1.00000 | 0.3311    1.00000 | 0.0629        0.90766 | 92.212    1.00000 | 0.2686        
[Reshape] /mid_block/resnets.0/norm1/Reshape_1_output_0                                                 1.00000 | 0.3311    1.00000 | 0.0445        0.90766 | 92.212    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.0/norm1/Add_output_0                                            1.00000 | 0.1776    1.00000 | 0.0373        0.93717 | 48.500    1.00000 | 0.0422        
[exSwish] /mid_block/resnets.0/act/Mul_output_0                                                         1.00000 | 0.0778    1.00000 | 0.0143        0.90618 | 20.885    1.00000 | 0.0385        
[Split] /mid_block/resnets.0/act/Mul_output_0_split                                                     1.00000 | 0.0560    1.00000 | 0.0072        0.90465 | 14.989    1.00000 | 0.0           
[Split] /mid_block/resnets.0/act/Mul_output_0_split_o1                                                  1.00000 | 0.0539    1.00000 | 0.0071        0.90777 | 14.544    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/conv1/Conv_output_0_tile0_conv                                              1.00000 | 0.1958    1.00000 | 0.0443        
[Conv] /mid_block/resnets.0/conv1/Conv_output_0_tile1_conv                                              1.00000 | 0.1869    1.00000 | 0.0434        0.94387 | 52.687    1.00000 | 0.0022        
[Add] /mid_block/resnets.0/conv1/Conv_output_0                                                          1.00000 | 0.2926    1.00000 | 0.0769        0.95469 | 83.466    1.00000 | 0.0870        
[Add] /mid_block/resnets.0/Add_output_0                                                                 1.00000 | 0.3099    1.00000 | 0.1012        0.97290 | 83.426    1.00000 | 0.0           
[Reshape] /mid_block/resnets.0/norm2/Reshape_output_0_rs                                                1.00000 | 0.3099    1.00000 | 0.0713        0.97290 | 83.426    1.00000 | 0.0           
[exNorm] /mid_block/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                           1.00000 | 0.2196    1.00000 | 0.0672        0.96625 | 55.745    1.00000 | 0.2945        
[Reshape] /mid_block/resnets.0/norm2/Reshape_1_output_0                                                 1.00000 | 0.2196    1.00000 | 0.0449        0.96625 | 55.745    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.0/norm2/Add_output_0                                            1.00000 | 0.1915    1.00000 | 0.0592        0.97608 | 47.837    1.00000 | 0.0624        
[exSwish] /mid_block/resnets.0/act_1/Mul_output_0                                                       1.00000 | 0.0753    1.00000 | 0.0161        0.94762 | 17.592    1.00000 | 0.0405        
[Split] /mid_block/resnets.0/act_1/Mul_output_0_split                                                   1.00000 | 0.0552    1.00000 | 0.0086        0.95012 | 12.846    1.00000 | 0.0           
[Split] /mid_block/resnets.0/act_1/Mul_output_0_split_o1                                                1.00000 | 0.0511    1.00000 | 0.0078        0.94449 | 12.019    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/conv2/Conv_output_0_tile0_conv                                              1.00000 | 0.2242    1.00000 | 0.0602        
[Conv] /mid_block/resnets.0/conv2/Conv_output_0_tile1_conv                                              1.00000 | 0.2043    1.00000 | 0.0526        0.96346 | 51.624    1.00000 | 0.0021        
[Add] /mid_block/resnets.0/conv2/Conv_output_0                                                          1.00000 | 0.3299    1.00000 | 0.0960        0.97047 | 83.650    1.00000 | 0.1088        
[Add] /mid_block/resnets.0/Add_1_output_0                                                               1.00000 | 0.7821    1.00000 | 0.1833        0.94131 | 214.94    1.00000 | 0.0           
[Reshape] /mid_block/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.7821    1.00000 | 0.1289        0.94131 | 214.94    1.00000 | 0.0           
[exNorm] /mid_block/attentions.0/norm/InstanceNormalization_output_0-rs                                 1.00000 | 0.2791    1.00000 | 0.0632        0.93970 | 74.525    1.00000 | 0.2465        
[Reshape] /mid_block/attentions.0/norm/Reshape_1_output_0                                               1.00000 | 0.2791    1.00000 | 0.0440        0.93970 | 74.525    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/proj_in/Conv_output_0                                                    1.00000 | 0.1854    1.00000 | 0.0548        0.96681 | 51.376    1.00000 | 0.0015        
[Reshape] /mid_block/attentions.0/Reshape_output_0_rs#1_tp                                              1.00000 | 0.1854    1.00000 | 0.0428        0.96681 | 51.376    1.00000 | 0.0           
[Reshape] /mid_block/attentions.0/Reshape_output_0_tp-rs                                                1.00000 | 0.1854    1.00000 | 0.0428        0.96681 | 51.376    1.00000 | 0.0           
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                              1.00000 | 0.0564    1.00000 | 0.0159        0.93523 | 14.801    1.00000 | 0.0460        
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                       1.00000 | 0.1310    1.00000 | 0.0261        0.93214 | 35.626    1.00000 | 0.0007        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                         1.00000 | 0.1310    1.00000 | 0.0203        0.93214 | 35.626    1.00000 | 0.0           
[Transpose] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                    1.00000 | 0.1310    1.00000 | 0.0203        0.93214 | 35.626    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                       1.00000 | 0.1190    1.00000 | 0.0286        0.95801 | 31.274    1.00000 | 0.0010        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                    1.00000 | 0.1190    1.00000 | 0.0224        0.95801 | 31.274    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                       1.00000 | 0.1135    1.00000 | 0.0341        0.96763 | 29.715    1.00000 | 0.0008        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                           1.00000 | 0.1135    1.00000 | 0.0244        0.96763 | 29.715    1.00000 | 0.0           
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                    1.00000 | 0.0906    1.00000 | 0.0288        0.97547 | 20.854    1.00000 | 0.0002        
[exSoftmax13] /mid_block/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs                 1.00000 | 0.0032    1.00000 | 0.0012        0.98631 | 0.6416    1.00000 | 0.0020        
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                      1.00000 | 0.0564    1.00000 | 0.0128        0.95475 | 15.621    1.00000 | 0.0002        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                   1.00000 | 0.0564    1.00000 | 0.0109        0.95475 | 15.621    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                      1.00000 | 0.1067    1.00000 | 0.0387        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_output_0-rs                                      1.00000 | 0.2136    1.00000 | 0.0663        0.94508 | 57.871    1.00000 | 0.0527        
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                        1.00000 | 0.1038    1.00000 | 0.0280        0.94131 | 27.337    1.00000 | 0.0865        
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                       1.00000 | 0.1574    1.00000 | 0.0462        0.97413 | 42.069    1.00000 | 0.0020        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                           1.00000 | 0.1574    1.00000 | 0.0379        0.97413 | 42.069    1.00000 | 0.0           
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                    1.00000 | 0.2734    1.00000 | 0.2392        0.99852 | 43.495    1.00000 | 0.0002        
[exSoftmax13] /mid_block/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs                 1.00000 | 0.0047    1.00000 | 0.0026        0.99673 | 1.0782    1.00000 | 0.0226        
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                      1.00000 | 0.0487    1.00000 | 0.0107        0.98225 | 9.0138    1.00000 | 0.0001        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                   1.00000 | 0.0487    1.00000 | 0.0096        0.98225 | 9.0138    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                      1.00000 | 0.0665    1.00000 | 0.0203        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                    1.00000 | 0.2263    1.00000 | 0.0541        0.94684 | 58.331    1.00000 | 0.0405        
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                        1.00000 | 0.1393    1.00000 | 0.0408        0.94573 | 35.098    1.00000 | 0.1043        
[Conv] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw              1.00000 | 0.7367    1.00000 | 0.2367        0.98045 | 182.74    1.00000 | 0.0092        
[Split] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph           1.00000 | 0.5232    1.00000 | 0.1064        0.96667 | 132.02    1.00000 | 0.0           
[Split] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph         1.00000 | 0.5186    1.00000 | 0.1588        0.98654 | 126.35    1.00000 | 0.0           
[exGelu] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph          1.00000 | 0.1469    1.00000 | 0.0330        0.94026 | 35.965    0.99999 | 0.4142        
[Mul] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                       1.00000 | 0.2088    1.00000 | 0.0461        0.93045 | 50.783    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                            1.00000 | 0.3064    1.00000 | 0.0670        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                              1.00000 | 0.3872    1.00000 | 0.0798        0.93240 | 95.696    1.00000 | 0.0820        
[Conv] /mid_block/attentions.0/Transpose_1_output_0_sw                                                  1.00000 | 0.7223    1.00000 | 0.1495        0.93386 | 179.26    1.00000 | 0.0042        
[Reshape] /mid_block/attentions.0/proj_out/Conv_output_0                                                1.00000 | 0.7223    1.00000 | 0.1017        0.93386 | 179.26    1.00000 | 0.0           
[Add] /mid_block/attentions.0/Add_output_0                                                              1.00000 | 0.9190    1.00000 | 0.2130        0.93682 | 228.44    1.00000 | 0.0           
[Reshape] /mid_block/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                       1.00000 | 0.9190    1.00000 | 0.1297        0.93682 | 228.44    1.00000 | 0.0           
[exNorm] /mid_block/resnets.1/norm1/InstanceNormalization_output_0-rs                                   1.00000 | 0.3217    1.00000 | 0.0631        0.93341 | 78.315    1.00000 | 0.2395        
[Reshape] /mid_block/resnets.1/norm1/Reshape_1_output_0                                                 1.00000 | 0.3217    1.00000 | 0.0444        0.93341 | 78.315    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.1/norm1/Add_output_0                                            1.00000 | 0.1834    1.00000 | 0.0380        0.94989 | 44.065    1.00000 | 0.0438        
[exSwish] /mid_block/resnets.1/act/Mul_output_0                                                         1.00000 | 0.0820    1.00000 | 0.0151        0.92374 | 19.595    1.00000 | 0.0399        
[Split] /mid_block/resnets.1/act/Mul_output_0_split                                                     1.00000 | 0.0591    1.00000 | 0.0076        0.91954 | 14.308    1.00000 | 0.0           
[Split] /mid_block/resnets.1/act/Mul_output_0_split_o1                                                  1.00000 | 0.0568    1.00000 | 0.0077        0.92805 | 13.388    1.00000 | 0.0           
[Conv] /mid_block/resnets.1/conv1/Conv_output_0_tile0_conv                                              1.00000 | 0.2047    1.00000 | 0.0475        
[Conv] /mid_block/resnets.1/conv1/Conv_output_0_tile1_conv                                              1.00000 | 0.1923    1.00000 | 0.0498        0.96869 | 49.396    1.00000 | 0.0016        
[Add] /mid_block/resnets.1/conv1/Conv_output_0                                                          1.00000 | 0.3022    1.00000 | 0.0903        0.97225 | 75.740    1.00000 | 0.0989        
[Add] /mid_block/resnets.1/Add_output_0                                                                 1.00000 | 0.3181    1.00000 | 0.1058        0.98011 | 75.712    1.00000 | 0.0           
[Reshape] /mid_block/resnets.1/norm2/Reshape_output_0_rs                                                1.00000 | 0.3181    1.00000 | 0.0758        0.98011 | 75.712    1.00000 | 0.0           
[exNorm] /mid_block/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                           1.00000 | 0.2213    1.00000 | 0.0680        0.97177 | 50.990    1.00000 | 0.2868        
[Reshape] /mid_block/resnets.1/norm2/Reshape_1_output_0                                                 1.00000 | 0.2213    1.00000 | 0.0449        0.97177 | 50.990    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.1/norm2/Add_output_0                                            1.00000 | 0.2028    1.00000 | 0.0608        0.97819 | 46.189    1.00000 | 0.0643        
[exSwish] /mid_block/resnets.1/act_1/Mul_output_0                                                       1.00000 | 0.0857    1.00000 | 0.0178        0.95304 | 17.673    1.00000 | 0.0423        
[Split] /mid_block/resnets.1/act_1/Mul_output_0_split                                                   1.00000 | 0.0586    1.00000 | 0.0084        0.95286 | 11.958    1.00000 | 0.0           
[Split] /mid_block/resnets.1/act_1/Mul_output_0_split_o1                                                1.00000 | 0.0625    1.00000 | 0.0091        0.95324 | 13.013    1.00000 | 0.0           
[Conv] /mid_block/resnets.1/conv2/Conv_output_0_tile0_conv                                              1.00000 | 0.2479    1.00000 | 0.0623        
[Conv] /mid_block/resnets.1/conv2/Conv_output_0_tile1_conv                                              1.00000 | 0.2580    1.00000 | 0.0632        0.96768 | 58.068    1.00000 | 0.0027        
[Add] /mid_block/resnets.1/conv2/Conv_output_0                                                          1.00000 | 0.3863    1.00000 | 0.1094        0.97407 | 84.350    1.00000 | 0.1143        
[Add] /mid_block/resnets.1/Add_1_output_0                                                               1.00000 | 0.9692    1.00000 | 0.2001        0.92751 | 233.94    1.00000 | 0.0           
[Concat] /up_blocks.0/Concat_output_0                                                                   1.00000 | 1.1964    1.00000 | 0.1581        0.92084 | 306.64    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.1964    1.00000 | 0.1581        0.92084 | 306.64    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4781    1.00000 | 0.0893        0.91744 | 123.19    1.00000 | 0.8661        
[Reshape] /up_blocks.0/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 0.4781    1.00000 | 0.0628        0.91744 | 123.19    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.0/norm1/Add_output_0                                          1.00000 | 0.2397    1.00000 | 0.0463        0.93721 | 58.426    1.00000 | 0.0562        
[exSwish] /up_blocks.0/resnets.0/act/Mul_output_0                                                       1.00000 | 0.1103    1.00000 | 0.0191        0.91615 | 26.395    1.00000 | 0.0516        
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.0964    1.00000 | 0.0117        0.91772 | 22.212    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.0525    1.00000 | 0.0070        0.91215 | 13.968    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split_o2                                                1.00000 | 0.0107    1.00000 | 0.0014        0.91171 | 2.8643    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.3318    1.00000 | 0.0696        
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1311    1.00000 | 0.0407        0.97777 | 36.412    1.00000 | 0.0021        
[Add] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.3682    1.00000 | 0.0915        0.95336 | 90.590    1.00000 | 0.0986        
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0231    1.00000 | 0.0053        
[Add] /up_blocks.0/resnets.0/conv1/Conv_output_0                                                        1.00000 | 0.3756    1.00000 | 0.0865        0.95390 | 90.829    1.00000 | 0.0277        
[Add] /up_blocks.0/resnets.0/Add_output_0                                                               1.00000 | 0.3850    1.00000 | 0.0943        0.96077 | 90.827    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.3850    1.00000 | 0.0666        0.96077 | 90.827    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2750    1.00000 | 0.0649        0.95643 | 63.338    1.00000 | 0.2624        
[Reshape] /up_blocks.0/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.2750    1.00000 | 0.0443        0.95643 | 63.338    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.0/norm2/Add_output_0                                          1.00000 | 0.2847    1.00000 | 0.0672        0.96666 | 64.400    1.00000 | 0.0750        
[exSwish] /up_blocks.0/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.1296    1.00000 | 0.0246        0.94005 | 27.638    1.00000 | 0.0628        
[Split] /up_blocks.0/resnets.0/act_1/Mul_output_0_split                                                 1.00000 | 0.0956    1.00000 | 0.0117        0.93618 | 20.251    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0874    1.00000 | 0.0121        0.94407 | 18.808    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.0/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.4434    1.00000 | 0.0910        
[Conv] /up_blocks.0/resnets.0/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.4026    1.00000 | 0.0928        0.95789 | 94.808    1.00000 | 0.0022        
[Add] /up_blocks.0/resnets.0/conv2/Conv_output_0                                                        1.00000 | 0.6422    1.00000 | 0.1498        0.95883 | 147.74    1.00000 | 0.1576        
[Conv] /up_blocks.0/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.6349    1.00000 | 0.1578        
[Add] /up_blocks.0/resnets.0/Add_1_output_0                                                             1.00000 | 0.9070    1.00000 | 0.1948        0.94461 | 207.86    1.00000 | 0.1829        
[Concat] /up_blocks.0/Concat_1_output_0                                                                 1.00000 | 1.1177    1.00000 | 0.1554        0.93033 | 280.93    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.1177    1.00000 | 0.1554        0.93033 | 280.93    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4648    1.00000 | 0.0894        0.92100 | 120.52    1.00000 | 0.7978        
[Reshape] /up_blocks.0/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 0.4648    1.00000 | 0.0629        0.92100 | 120.52    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.1/norm1/Add_output_0                                          1.00000 | 0.2428    1.00000 | 0.0507        0.95147 | 57.815    1.00000 | 0.0583        
[exSwish] /up_blocks.0/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1103    1.00000 | 0.0200        0.92852 | 25.725    1.00000 | 0.0534        
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.0934    1.00000 | 0.0123        0.93854 | 20.219    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0574    1.00000 | 0.0075        0.90326 | 15.549    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split_o2                                                1.00000 | 0.0116    1.00000 | 0.0015        0.89857 | 3.3407    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.3916    1.00000 | 0.0860        
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1595    1.00000 | 0.0468        0.97275 | 46.316    1.00000 | 0.0026        
[Add] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.4326    1.00000 | 0.1171        0.96703 | 102.73    1.00000 | 0.1319        
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0272    1.00000 | 0.0065        
[Add] /up_blocks.0/resnets.1/conv1/Conv_output_0                                                        1.00000 | 0.4424    1.00000 | 0.1154        0.96688 | 103.27    1.00000 | 0.0330        
[Add] /up_blocks.0/resnets.1/Add_output_0                                                               1.00000 | 0.4551    1.00000 | 0.1233        0.96964 | 103.25    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.4551    1.00000 | 0.0855        0.96964 | 103.25    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2484    1.00000 | 0.0637        0.96752 | 54.691    1.00000 | 0.2593        
[Reshape] /up_blocks.0/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.2484    1.00000 | 0.0444        0.96752 | 54.691    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.1/norm2/Add_output_0                                          1.00000 | 0.2473    1.00000 | 0.0661        0.97618 | 52.917    1.00000 | 0.0726        
[exSwish] /up_blocks.0/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.1064    1.00000 | 0.0215        0.95504 | 21.533    1.00000 | 0.0564        
[Split] /up_blocks.0/resnets.1/act_1/Mul_output_0_split                                                 1.00000 | 0.0775    1.00000 | 0.0111        0.95281 | 15.577    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0729    1.00000 | 0.0108        0.95727 | 14.868    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.3446    1.00000 | 0.0796        
[Conv] /up_blocks.0/resnets.1/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.3415    1.00000 | 0.0828        0.96790 | 74.237    1.00000 | 0.0029        
[Add] /up_blocks.0/resnets.1/conv2/Conv_output_0                                                        1.00000 | 0.5128    1.00000 | 0.1254        0.96674 | 109.67    1.00000 | 0.1293        
[Conv] /up_blocks.0/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 0.4570    1.00000 | 0.1102        
[Add] /up_blocks.0/resnets.1/Add_1_output_0                                                             1.00000 | 0.6831    1.00000 | 0.1532        0.94876 | 150.96    1.00000 | 0.1387        
[Concat] /up_blocks.0/Concat_2_output_0                                                                 1.00000 | 0.9309    1.00000 | 0.1268        0.92267 | 241.17    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.9309    1.00000 | 0.1268        0.92267 | 241.17    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4757    1.00000 | 0.0902        0.91599 | 124.29    1.00000 | 0.7627        
[Reshape] /up_blocks.0/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.4757    1.00000 | 0.0630        0.91599 | 124.29    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2468    1.00000 | 0.0506        0.95316 | 56.700    1.00000 | 0.0586        
[exSwish] /up_blocks.0/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1160    1.00000 | 0.0219        0.93467 | 26.179    1.00000 | 0.0562        
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split                                                   1.00000 | 0.1024    1.00000 | 0.0136        0.94554 | 21.188    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split_o1                                                1.00000 | 0.0531    1.00000 | 0.0068        0.89564 | 14.995    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split_o2                                                1.00000 | 0.0113    1.00000 | 0.0014        0.87953 | 3.3952    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.4646    1.00000 | 0.1197        
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1644    1.00000 | 0.0520        0.97762 | 47.796    1.00000 | 0.0023        
[Add] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.5092    1.00000 | 0.1695        0.98205 | 113.70    1.00000 | 0.1902        
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0277    1.00000 | 0.0061        
[Add] /up_blocks.0/resnets.2/conv1/Conv_output_0                                                        1.00000 | 0.5254    1.00000 | 0.1749        0.98205 | 114.20    1.00000 | 0.0383        
[Add] /up_blocks.0/resnets.2/Add_output_0                                                               1.00000 | 0.5385    1.00000 | 0.1728        0.98102 | 114.19    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.5385    1.00000 | 0.1183        0.98102 | 114.19    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2176    1.00000 | 0.0651        0.97892 | 44.063    1.00000 | 0.2606        
[Reshape] /up_blocks.0/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.2176    1.00000 | 0.0447        0.97892 | 44.063    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.2/norm2/Add_output_0                                          1.00000 | 0.1955    1.00000 | 0.0580        0.98330 | 38.510    1.00000 | 0.0620        
[exSwish] /up_blocks.0/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.0732    1.00000 | 0.0158        0.96074 | 14.963    1.00000 | 0.0712        
[Split] /up_blocks.0/resnets.2/act_1/Mul_output_0_split                                                 1.00000 | 0.0518    1.00000 | 0.0081        0.96087 | 10.395    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0517    1.00000 | 0.0082        0.96071 | 10.763    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.2/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.1911    1.00000 | 0.0478        
[Conv] /up_blocks.0/resnets.2/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.1926    1.00000 | 0.0483        0.95998 | 40.531    1.00000 | 0.0016        
[Add] /up_blocks.0/resnets.2/conv2/Conv_output_0                                                        1.00000 | 0.2805    1.00000 | 0.0599        0.95699 | 57.567    1.00000 | 0.0594        
[Conv] /up_blocks.0/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.2355    1.00000 | 0.0547        
[Add] /up_blocks.0/resnets.2/Add_1_output_0                                                             1.00000 | 0.3618    1.00000 | 0.0726        0.93984 | 79.742    1.00000 | 0.0684        
[Resize] /up_blocks.0/upsamplers.0/Resize_output_0                                                      1.00000 | 0.7237    1.00000 | 0.0952        0.93984 | 159.48    1.00000 | 0.0           
[Split] /up_blocks.0/upsamplers.0/Resize_output_0_split                                                 1.00000 | 0.5084    1.00000 | 0.0656        0.93767 | 112.35    1.00000 | 0.0           
[Split] /up_blocks.0/upsamplers.0/Resize_output_0_split_o1                                              1.00000 | 0.5150    1.00000 | 0.0690        0.94185 | 113.18    1.00000 | 0.0           
[Conv] /up_blocks.0/upsamplers.0/conv/Conv_output_0_tile0_conv                                          1.00000 | 0.8456    1.00000 | 0.1860        
[Conv] /up_blocks.0/upsamplers.0/conv/Conv_output_0_tile1_conv                                          1.00000 | 0.8795    1.00000 | 0.2038        0.95395 | 189.60    1.00000 | 0.0061        
[Add] /up_blocks.0/upsamplers.0/conv/Conv_output_0                                                      1.00000 | 1.3007    1.00000 | 0.2692        0.95336 | 279.46    1.00000 | 0.2835        
[Concat] /up_blocks.1/Concat_output_0                                                                   1.00000 | 1.4965    1.00000 | 0.2144        0.94764 | 336.95    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.4965    1.00000 | 0.2144        0.94764 | 336.95    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.8617    1.00000 | 0.1765        0.94119 | 207.98    1.00000 | 1.6313        
[Reshape] /up_blocks.1/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 0.8617    1.00000 | 0.1313        0.94119 | 207.98    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.0/norm1/Add_output_0                                          1.00000 | 0.4385    1.00000 | 0.1039        0.97011 | 99.577    1.00000 | 0.1109        
[exSwish] /up_blocks.1/resnets.0/act/Mul_output_0                                                       1.00000 | 0.1720    1.00000 | 0.0326        0.92843 | 42.476    1.00000 | 0.1477        
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.1203    1.00000 | 0.0194        0.96003 | 25.461    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.1198    1.00000 | 0.0131        0.87091 | 33.136    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split_o2                                                1.00000 | 0.0276    1.00000 | 0.0031        0.88323 | 7.6117    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.6618    1.00000 | 0.1952        
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.5725    1.00000 | 0.1129        0.92711 | 162.87    1.00000 | 0.0051        
[Add] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.8944    1.00000 | 0.2828        0.97436 | 222.02    1.00000 | 0.3207        
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.1289    1.00000 | 0.0283        
[Add] /up_blocks.1/resnets.0/conv1/Conv_output_0                                                        1.00000 | 0.9257    1.00000 | 0.2866        0.97483 | 226.03    1.00000 | 0.1294        
[Add] /up_blocks.1/resnets.0/Add_output_0                                                               1.00000 | 0.9577    1.00000 | 0.3207        0.97895 | 225.97    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.9577    1.00000 | 0.2212        0.97895 | 225.97    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4736    1.00000 | 0.1377        0.96975 | 105.55    1.00000 | 0.4929        
[Reshape] /up_blocks.1/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.4736    1.00000 | 0.0895        0.96975 | 105.55    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.0/norm2/Add_output_0                                          1.00000 | 0.4350    1.00000 | 0.1243        0.97955 | 95.413    1.00000 | 0.1386        
[exSwish] /up_blocks.1/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.1834    1.00000 | 0.0380        0.95895 | 36.354    1.00000 | 0.1007        
[Split] /up_blocks.1/resnets.0/act_1/Mul_output_0_split                                                 1.00000 | 0.1321    1.00000 | 0.0193        0.95710 | 26.374    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1273    1.00000 | 0.0190        0.96086 | 25.020    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.7222    1.00000 | 0.1776        
[Conv] /up_blocks.1/resnets.0/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.6847    1.00000 | 0.1752        0.97021 | 142.12    1.00000 | 0.0065        
[Add] /up_blocks.1/resnets.0/conv2/Conv_output_0                                                        1.00000 | 1.0357    1.00000 | 0.2638        0.96945 | 217.28    1.00000 | 0.2705        
[Conv] /up_blocks.1/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.9456    1.00000 | 0.2440        
[Add] /up_blocks.1/resnets.0/Add_1_output_0                                                             1.00000 | 1.4401    1.00000 | 0.3254        0.94903 | 349.03    0.99984 | 19.446        
[Reshape] /up_blocks.1/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.4401    1.00000 | 0.2266        0.94903 | 349.03    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.5826    1.00000 | 0.1270        0.94734 | 139.28    1.00000 | 0.4566        
[Reshape] /up_blocks.1/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.5826    1.00000 | 0.0891        0.94734 | 139.28    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.5118    1.00000 | 0.1377        0.96816 | 120.31    1.00000 | 0.0029        
[Reshape] /up_blocks.1/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5118    1.00000 | 0.1001        0.96816 | 120.31    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.5118    1.00000 | 0.1001        0.96816 | 120.31    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1556    1.00000 | 0.0382        0.93807 | 36.353    1.00000 | 0.1010        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3890    1.00000 | 0.0758        0.93981 | 90.804    1.00000 | 0.0023        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3890    1.00000 | 0.0548        0.93981 | 90.804    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3890    1.00000 | 0.0548        0.93981 | 90.804    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.3883    1.00000 | 0.0868        0.95625 | 89.278    1.00000 | 0.0028        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.3883    1.00000 | 0.0626        0.95625 | 89.278    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.3914    1.00000 | 0.0899        0.96074 | 88.878    1.00000 | 0.0041        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.3914    1.00000 | 0.0658        0.96074 | 88.878    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.5646    1.00000 | 0.1732        0.97139 | 127.25    1.00000 | 0.0051        
[exSoftmax13] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0090    1.00000 | 0.0044        0.96691 | 1.3897    1.00000 | 0.0045        
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1457    1.00000 | 0.0280        0.94661 | 39.973    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1457    1.00000 | 0.0253        0.94661 | 39.973    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2705    1.00000 | 0.0864        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.5730    1.00000 | 0.1566        0.95929 | 135.89    1.00000 | 0.1213        
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2569    1.00000 | 0.0655        0.93958 | 60.540    1.00000 | 0.1823        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.4184    1.00000 | 0.1090        0.96111 | 101.16    1.00000 | 0.0039        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.4184    1.00000 | 0.0752        0.96111 | 101.16    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.4782    1.00000 | 0.3438        0.99694 | 84.616    1.00000 | 0.0078        
[exSoftmax13] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0123    1.00000 | 0.0047        0.99495 | 2.5390    1.00000 | 0.0448        
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1130    1.00000 | 0.0242        0.98162 | 20.713    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1130    1.00000 | 0.0223        0.98162 | 20.713    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1647    1.00000 | 0.0485        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6048    1.00000 | 0.1538        0.96065 | 139.22    1.00000 | 0.1089        
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1861    1.00000 | 0.0469        0.94351 | 42.578    1.00000 | 0.1324        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.0132    1.00000 | 0.2879        0.97359 | 236.74    1.00000 | 0.0106        
[Split] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7406    1.00000 | 0.1366        0.96613 | 171.11    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6914    1.00000 | 0.1633        0.97884 | 163.61    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3158    1.00000 | 0.0919        0.96655 | 74.131    1.00000 | 0.3430        
[Mul] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3537    1.00000 | 0.0773        0.92607 | 82.364    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6789    1.00000 | 0.1484        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.8967    1.00000 | 0.1797        0.92430 | 199.85    1.00000 | 0.1644        
[Conv] /up_blocks.1/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 1.8343    1.00000 | 0.3486        0.92668 | 403.68    1.00000 | 0.0108        
[Reshape] /up_blocks.1/attentions.0/proj_out/Conv_output_0                                              1.00000 | 1.8343    1.00000 | 0.2193        0.92668 | 403.68    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.0/Add_output_0                                                            1.00000 | 1.8605    1.00000 | 0.3934        0.93130 | 404.61    1.00000 | 0.0           
[Concat] /up_blocks.1/Concat_1_output_0                                                                 1.00000 | 1.9991    1.00000 | 0.2494        0.92693 | 462.96    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9991    1.00000 | 0.2494        0.92693 | 462.96    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9416    1.00000 | 0.1771        0.91959 | 243.19    1.00000 | 1.5724        
[Reshape] /up_blocks.1/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 0.9416    1.00000 | 0.1285        0.91959 | 243.19    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.1/norm1/Add_output_0                                          1.00000 | 0.4187    1.00000 | 0.0788        0.94423 | 96.025    1.00000 | 0.0904        
[exSwish] /up_blocks.1/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1929    1.00000 | 0.0330        0.91931 | 43.940    1.00000 | 0.1245        
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.1783    1.00000 | 0.0211        0.92946 | 37.560    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0722    1.00000 | 0.0089        0.86840 | 22.274    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split_o2                                                1.00000 | 0.0147    1.00000 | 0.0018        0.85664 | 4.8828    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.9584    1.00000 | 0.1953        
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.2875    1.00000 | 0.0755        0.95905 | 88.939    1.00000 | 0.0050        
[Add] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 1.0161    1.00000 | 0.2331        0.96119 | 220.28    1.00000 | 0.2632        
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0541    1.00000 | 0.0119        
[Add] /up_blocks.1/resnets.1/conv1/Conv_output_0                                                        1.00000 | 1.0303    1.00000 | 0.2329        0.96164 | 221.24    1.00000 | 0.0695        
[Add] /up_blocks.1/resnets.1/Add_output_0                                                               1.00000 | 1.0519    1.00000 | 0.2471        0.96443 | 221.24    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 1.0519    1.00000 | 0.1713        0.96443 | 221.24    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.5866    1.00000 | 0.1291        0.95933 | 122.41    1.00000 | 0.4537        
[Reshape] /up_blocks.1/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.5866    1.00000 | 0.0891        0.95933 | 122.41    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.1/norm2/Add_output_0                                          1.00000 | 0.5252    1.00000 | 0.1235        0.97275 | 108.10    1.00000 | 0.1364        
[exSwish] /up_blocks.1/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.2118    1.00000 | 0.0371        0.94226 | 41.544    1.00000 | 0.0964        
[Split] /up_blocks.1/resnets.1/act_1/Mul_output_0_split                                                 1.00000 | 0.1539    1.00000 | 0.0191        0.94149 | 30.372    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1454    1.00000 | 0.0181        0.94313 | 28.345    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.8237    1.00000 | 0.1699        
[Conv] /up_blocks.1/resnets.1/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.7760    1.00000 | 0.1594        0.95306 | 154.48    1.00000 | 0.0069        
[Add] /up_blocks.1/resnets.1/conv2/Conv_output_0                                                        1.00000 | 1.1864    1.00000 | 0.2356        0.95471 | 237.08    1.00000 | 0.2454        
[Conv] /up_blocks.1/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 1.2986    1.00000 | 0.2947        
[Add] /up_blocks.1/resnets.1/Add_1_output_0                                                             1.00000 | 1.7885    1.00000 | 0.3605        0.93937 | 417.20    1.00000 | 0.3744        
[Reshape] /up_blocks.1/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.7885    1.00000 | 0.2468        0.93937 | 417.20    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.6525    1.00000 | 0.1261        0.93886 | 150.08    1.00000 | 0.4641        
[Reshape] /up_blocks.1/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.6525    1.00000 | 0.0889        0.93886 | 150.08    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.5674    1.00000 | 0.1448        0.97056 | 121.99    1.00000 | 0.0036        
[Reshape] /up_blocks.1/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5674    1.00000 | 0.1044        0.97056 | 121.99    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.5674    1.00000 | 0.1044        0.97056 | 121.99    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1791    1.00000 | 0.0407        0.94206 | 38.157    1.00000 | 0.1168        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3728    1.00000 | 0.0692        0.93617 | 77.525    1.00000 | 0.0024        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3728    1.00000 | 0.0453        0.93617 | 77.525    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3728    1.00000 | 0.0453        0.93617 | 77.525    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.4951    1.00000 | 0.1144        0.96697 | 101.17    1.00000 | 0.0043        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.4951    1.00000 | 0.0825        0.96697 | 101.17    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.5028    1.00000 | 0.1088        0.96242 | 102.02    1.00000 | 0.0033        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.5028    1.00000 | 0.0775        0.96242 | 102.02    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.8751    1.00000 | 0.2641        0.97912 | 167.60    1.00000 | 0.0088        
[exSoftmax13] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0137    1.00000 | 0.0074        0.96463 | 2.1134    1.00000 | 0.0079        
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1674    1.00000 | 0.0292        0.94419 | 41.006    1.00000 | 0.0010        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1674    1.00000 | 0.0254        0.94419 | 41.006    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.3135    1.00000 | 0.0817        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.6364    1.00000 | 0.1606        0.96409 | 137.79    1.00000 | 0.1218        
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2812    1.00000 | 0.0677        0.93979 | 60.837    1.00000 | 0.1935        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.4752    1.00000 | 0.1132        0.95853 | 105.40    1.00000 | 0.0037        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.4752    1.00000 | 0.0761        0.95853 | 105.40    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.6141    1.00000 | 0.3568        0.99718 | 86.467    1.00000 | 0.0067        
[exSoftmax13] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0113    1.00000 | 0.0052        0.99857 | 1.7266    1.00000 | 0.0553        
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0934    1.00000 | 0.0224        0.98843 | 13.779    1.00000 | 0.0002        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0934    1.00000 | 0.0193        0.98843 | 13.779    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1452    1.00000 | 0.0547        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6665    1.00000 | 0.1749        0.97185 | 139.31    1.00000 | 0.1300        
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1879    1.00000 | 0.0429        0.94164 | 39.823    1.00000 | 0.1237        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.0210    1.00000 | 0.2609        0.97054 | 220.46    1.00000 | 0.0078        
[Split] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7431    1.00000 | 0.1242        0.96452 | 158.67    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.7002    1.00000 | 0.1419        0.97513 | 153.05    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3186    1.00000 | 0.0753        0.95512 | 70.094    1.00000 | 0.2296        
[Mul] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3106    1.00000 | 0.0619        0.92083 | 69.292    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6133    1.00000 | 0.1359        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.8919    1.00000 | 0.1915        0.92910 | 181.59    1.00000 | 0.1536        
[Conv] /up_blocks.1/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 1.7567    1.00000 | 0.3226        0.93265 | 359.06    1.00000 | 0.0114        
[Reshape] /up_blocks.1/attentions.1/proj_out/Conv_output_0                                              1.00000 | 1.7567    1.00000 | 0.2028        0.93265 | 359.06    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.1/Add_output_0                                                            1.00000 | 1.8575    1.00000 | 0.3951        0.92752 | 406.82    1.00000 | 0.0           
[Concat] /up_blocks.1/Concat_2_output_0                                                                 1.00000 | 1.9363    1.00000 | 0.2330        0.91665 | 456.16    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9363    1.00000 | 0.2330        0.91665 | 456.16    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9046    1.00000 | 0.1539        0.88722 | 249.90    1.00000 | 0.9187        
[Reshape] /up_blocks.1/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.9046    1.00000 | 0.1096        0.88722 | 249.90    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.2/norm1/Add_output_0                                          1.00000 | 0.3574    1.00000 | 0.0627        0.93388 | 80.997    1.00000 | 0.0713        
[exSwish] /up_blocks.1/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1732    1.00000 | 0.0297        0.91799 | 39.524    1.00000 | 0.1005        
[Split] /up_blocks.1/resnets.2/act/Mul_output_0_split                                                   1.00000 | 0.1463    1.00000 | 0.0174        0.92648 | 31.446    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.2/act/Mul_output_0_split_o1                                                1.00000 | 0.0927    1.00000 | 0.0111        0.89758 | 23.944    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/conv1/Conv_output_0_tile0_conv                                            1.00000 | 1.2331    1.00000 | 0.3374        
[Conv] /up_blocks.1/resnets.2/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.4158    1.00000 | 0.0914        0.94520 | 101.24    1.00000 | 0.0051        
[Add] /up_blocks.1/resnets.2/conv1/Conv_output_0                                                        1.00000 | 1.3318    1.00000 | 0.3870        0.98083 | 265.80    1.00000 | 0.4559        
[Add] /up_blocks.1/resnets.2/Add_output_0                                                               1.00000 | 1.3659    1.00000 | 0.4391        0.98269 | 265.81    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 1.3659    1.00000 | 0.2890        0.98269 | 265.81    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4367    1.00000 | 0.1258        0.97760 | 90.848    1.00000 | 0.4327        
[Reshape] /up_blocks.1/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.4367    1.00000 | 0.0884        0.97760 | 90.848    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.2/norm2/Add_output_0                                          1.00000 | 0.4813    1.00000 | 0.1618        0.98637 | 95.767    1.00000 | 0.1748        
[exSwish] /up_blocks.1/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1627    1.00000 | 0.0288        0.94254 | 32.177    0.99997 | 0.7123        
[Split] /up_blocks.1/resnets.2/act_1/Mul_output_0_split                                                 1.00000 | 0.1178    1.00000 | 0.0148        0.94312 | 23.568    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.2/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1121    1.00000 | 0.0138        0.94192 | 21.906    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.5777    1.00000 | 0.1206        
[Conv] /up_blocks.1/resnets.2/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.5700    1.00000 | 0.1161        0.94810 | 109.13    1.00000 | 0.0047        
[Add] /up_blocks.1/resnets.2/conv2/Conv_output_0                                                        1.00000 | 0.8276    1.00000 | 0.1532        0.94956 | 159.20    1.00000 | 0.1511        
[Conv] /up_blocks.1/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 1.1853    1.00000 | 0.2494        
[Add] /up_blocks.1/resnets.2/Add_1_output_0                                                             1.00000 | 1.4345    1.00000 | 0.2708        0.93423 | 320.85    1.00000 | 0.2851        
[Reshape] /up_blocks.1/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.4345    1.00000 | 0.1848        0.93423 | 320.85    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.7037    1.00000 | 0.1259        0.93341 | 156.59    1.00000 | 0.6550        
[Reshape] /up_blocks.1/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.7037    1.00000 | 0.0891        0.93341 | 156.59    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.5673    1.00000 | 0.1334        0.96378 | 124.21    1.00000 | 0.0026        
[Reshape] /up_blocks.1/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5673    1.00000 | 0.0960        0.96378 | 124.21    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.5673    1.00000 | 0.0960        0.96378 | 124.21    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1645    1.00000 | 0.0359        0.92627 | 35.917    1.00000 | 0.0949        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3478    1.00000 | 0.0594        0.91674 | 78.983    1.00000 | 0.0016        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3478    1.00000 | 0.0408        0.91674 | 78.983    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3478    1.00000 | 0.0408        0.91674 | 78.983    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.4226    1.00000 | 0.0885        0.94841 | 89.827    1.00000 | 0.0027        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.4226    1.00000 | 0.0585        0.94841 | 89.827    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.4164    1.00000 | 0.0862        0.94819 | 88.813    1.00000 | 0.0031        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.4164    1.00000 | 0.0576        0.94819 | 88.813    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.5395    1.00000 | 0.1253        0.95598 | 113.41    1.00000 | 0.0033        
[exSoftmax13] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0052    1.00000 | 0.0018        0.95486 | 1.3638    1.00000 | 0.0038        
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1135    1.00000 | 0.0200        0.91175 | 38.152    1.00000 | 0.0007        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1135    1.00000 | 0.0186        0.91175 | 38.152    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2049    1.00000 | 0.0592        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.6000    1.00000 | 0.1394        0.95413 | 136.99    1.00000 | 0.0988        
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3271    1.00000 | 0.0728        0.91936 | 76.033    1.00000 | 0.1920        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5529    1.00000 | 0.1196        0.94617 | 127.77    1.00000 | 0.0038        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5529    1.00000 | 0.0800        0.94617 | 127.77    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.5608    1.00000 | 0.3652        0.99658 | 94.669    1.00000 | 0.0098        
[exSoftmax13] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0119    1.00000 | 0.0051        0.99883 | 1.4227    1.00000 | 0.0531        
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0959    1.00000 | 0.0306        0.99329 | 11.085    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0959    1.00000 | 0.0211        0.99329 | 11.085    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1190    1.00000 | 0.0514        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6261    1.00000 | 0.1622        0.96930 | 137.60    1.00000 | 0.1290        
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1696    1.00000 | 0.0363        0.92416 | 38.527    1.00000 | 0.1035        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 0.9052    1.00000 | 0.2138        0.96020 | 208.29    1.00000 | 0.0074        
[Split] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.6425    1.00000 | 0.0951        0.94962 | 146.24    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6376    1.00000 | 0.1186        0.96699 | 148.31    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.2935    1.00000 | 0.0697        0.95411 | 67.069    1.00000 | 0.2026        
[Mul] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2447    1.00000 | 0.0456        0.90951 | 57.798    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.4642    1.00000 | 0.1096        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.7650    1.00000 | 0.1632        0.92158 | 168.49    1.00000 | 0.1295        
[Conv] /up_blocks.1/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 1.4411    1.00000 | 0.2699        0.91834 | 330.46    1.00000 | 0.0083        
[Reshape] /up_blocks.1/attentions.2/proj_out/Conv_output_0                                              1.00000 | 1.4411    1.00000 | 0.1701        0.91834 | 330.46    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.2/Add_output_0                                                            1.00000 | 1.2802    1.00000 | 0.2914        0.91594 | 286.35    1.00000 | 0.0           
[Resize] /up_blocks.1/upsamplers.0/Resize_output_0                                                      1.00000 | 2.5605    1.00000 | 0.2918        0.91594 | 572.70    1.00000 | 0.0           
[Split] /up_blocks.1/upsamplers.0/Resize_output_0_split                                                 1.00000 | 1.8039    1.00000 | 0.2041        0.91826 | 394.31    1.00000 | 0.0           
[Split] /up_blocks.1/upsamplers.0/Resize_output_0_split_o1                                              1.00000 | 1.8171    1.00000 | 0.2085        0.91374 | 415.33    1.00000 | 0.0           
[Conv] /up_blocks.1/upsamplers.0/conv/Conv_output_0_tile0_conv                                          1.00000 | 5.6885    1.00000 | 1.0680        
[Conv] /up_blocks.1/upsamplers.0/conv/Conv_output_0_tile1_conv                                          1.00000 | 5.7284    1.00000 | 1.1018        0.92649 | 1320.5    1.00000 | 0.0396        
[Add] /up_blocks.1/upsamplers.0/conv/Conv_output_0                                                      1.00000 | 8.2873    1.00000 | 1.5235        0.93044 | 1864.5    1.00000 | 1.5146        
[Concat] /up_blocks.2/Concat_output_0                                                                   1.00000 | 8.3167    1.00000 | 1.0545        0.93065 | 1875.2    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 8.3167    1.00000 | 1.0545        0.93065 | 1875.2    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.5649    1.00000 | 0.2951        0.86219 | 680.69    0.91889 | 551.98        
[Reshape] /up_blocks.2/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 1.5649    1.00000 | 0.2206        0.86219 | 680.69    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.0/norm1/Add_output_0                                          1.00000 | 0.8883    1.00000 | 0.1891        0.95039 | 247.52    1.00000 | 0.1965        
[exSwish] /up_blocks.2/resnets.0/act/Mul_output_0                                                       1.00000 | 0.3253    1.00000 | 0.0589        0.91841 | 84.455    1.00000 | 0.3062        
[Split] /up_blocks.2/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.2668    1.00000 | 0.0373        0.94558 | 56.177    1.00000 | 0.0           
[Split] /up_blocks.2/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.1860    1.00000 | 0.0248        0.86713 | 63.061    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.9951    1.00000 | 0.2288        
[Conv] /up_blocks.2/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.7196    1.00000 | 0.1703        0.92975 | 250.22    1.00000 | 0.0097        
[Add] /up_blocks.2/resnets.0/conv1/Conv_output_0                                                        1.00000 | 1.2639    1.00000 | 0.3131        0.95738 | 330.24    1.00000 | 0.3535        
[Add] /up_blocks.2/resnets.0/Add_output_0                                                               1.00000 | 1.3038    1.00000 | 0.3437        0.96249 | 330.22    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 1.3038    1.00000 | 0.2346        0.96249 | 330.22    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7612    1.00000 | 0.1831        0.95629 | 179.31    1.00000 | 1.4972        
[Reshape] /up_blocks.2/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.7612    1.00000 | 0.1239        0.95629 | 179.31    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.0/norm2/Add_output_0                                          1.00000 | 0.8681    1.00000 | 0.1867        0.95495 | 201.63    1.00000 | 0.1988        
[exSwish] /up_blocks.2/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.3911    1.00000 | 0.0751        0.93918 | 84.454    1.00000 | 0.3071        
[Conv] /up_blocks.2/resnets.0/conv2/Conv_output_0                                                       1.00000 | 1.9877    1.00000 | 0.4380        0.94915 | 404.84    1.00000 | 0.0134        
[Conv] /up_blocks.2/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 2.5969    1.00000 | 0.6356        
[Add] /up_blocks.2/resnets.0/Add_1_output_0                                                             1.00000 | 3.3080    1.00000 | 0.6773        0.93649 | 803.77    1.00000 | 0.7066        
[Reshape] /up_blocks.2/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 3.3080    1.00000 | 0.4726        0.93649 | 803.77    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.9119    1.00000 | 0.1788        0.93630 | 216.47    1.00000 | 1.4518        
[Reshape] /up_blocks.2/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.9119    1.00000 | 0.1262        0.93630 | 216.47    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.8930    1.00000 | 0.2286        0.96756 | 191.13    1.00000 | 0.0129        
[Reshape] /up_blocks.2/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.8930    1.00000 | 0.1505        0.96756 | 191.13    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.8930    1.00000 | 0.1505        0.96756 | 191.13    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.4770    1.00000 | 0.1017        0.92890 | 104.79    1.00000 | 0.3493        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.8793    1.00000 | 0.1521        0.91596 | 190.56    1.00000 | 0.0048        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.8793    1.00000 | 0.0964        0.91596 | 190.56    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.8793    1.00000 | 0.0964        0.91596 | 190.56    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.9128    1.00000 | 0.2041        0.95979 | 192.58    1.00000 | 0.0068        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.9128    1.00000 | 0.1414        0.95979 | 192.58    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.8662    1.00000 | 0.1853        0.95303 | 180.63    1.00000 | 0.0059        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.8662    1.00000 | 0.1224        0.95303 | 180.63    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 4.8021    1.00000 | 1.0025        0.96631 | 908.68    1.00000 | 0.0308        
[exSoftmax13] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0226    1.00000 | 0.0118        0.92404 | 3.5565    1.00000 | 0.0152        
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.3565    1.00000 | 0.0562        0.93407 | 93.336    1.00000 | 0.0026        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.3565    1.00000 | 0.0535        0.93407 | 93.336    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.4781    1.00000 | 0.1383        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.9632    1.00000 | 0.2383        0.96126 | 206.35    1.00000 | 0.1834        
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.5014    1.00000 | 0.1162        0.94055 | 109.83    1.00000 | 0.3810        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.7417    1.00000 | 0.1923        0.97079 | 156.21    1.00000 | 0.0056        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.7417    1.00000 | 0.1362        0.97079 | 156.21    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.5346    1.00000 | 0.8104        0.99486 | 241.67    1.00000 | 0.0179        
[exSoftmax13] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0070    1.00000 | 0.0070        1.00000 | 0.0748    1.00000 | 0.0461        
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0912    1.00000 | 0.0408        0.99998 | 0.7216    1.00000 | 7.0365        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0912    1.00000 | 0.0373        0.99998 | 0.7216    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1021    1.00000 | 0.0613        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.9799    1.00000 | 0.2642        0.96895 | 206.34    1.00000 | 0.1741        
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.3845    1.00000 | 0.0942        0.94323 | 83.134    1.00000 | 0.2994        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.5549    1.00000 | 0.3904        0.96704 | 329.01    1.00000 | 0.0104        
[Split] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 1.1921    1.00000 | 0.1770        0.95482 | 256.52    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.9984    1.00000 | 0.1990        0.97679 | 206.02    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.6820    1.00000 | 0.1877        0.97027 | 139.33    1.00000 | 0.5484        
[Mul] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.7092    1.00000 | 0.1319        0.91549 | 146.95    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 1.0277    1.00000 | 0.1868        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 1.4175    1.00000 | 0.2793        0.94270 | 284.54    1.00000 | 0.2327        
[Conv] /up_blocks.2/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 3.1528    1.00000 | 0.5748        0.93854 | 635.57    1.00000 | 0.0142        
[Reshape] /up_blocks.2/attentions.0/proj_out/Conv_output_0                                              1.00000 | 3.1528    1.00000 | 0.3760        0.93854 | 635.57    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.0/Add_output_0                                                            1.00000 | 3.7098    1.00000 | 0.7552        0.91842 | 841.72    1.00000 | 0.0           
[Concat] /up_blocks.2/Concat_1_output_0                                                                 1.00000 | 3.7571    1.00000 | 0.4455        0.91451 | 879.20    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 3.7571    1.00000 | 0.4455        0.91451 | 879.20    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.3984    1.00000 | 0.2513        0.85695 | 461.60    0.98891 | 128.77        
[Reshape] /up_blocks.2/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 1.3984    1.00000 | 0.1778        0.85695 | 461.60    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.1/norm1/Add_output_0                                          1.00000 | 0.3301    1.00000 | 0.0545        0.89702 | 85.232    1.00000 | 0.0650        
[exSwish] /up_blocks.2/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1635    1.00000 | 0.0248        0.87703 | 41.913    1.00000 | 0.1168        
[Split] /up_blocks.2/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.1523    1.00000 | 0.0158        0.90534 | 32.905    1.00000 | 0.0           
[Split] /up_blocks.2/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0594    1.00000 | 0.0076        0.76369 | 25.960    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.5863    1.00000 | 0.1138        
[Conv] /up_blocks.2/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1864    1.00000 | 0.0455        0.87098 | 82.884    1.00000 | 0.0016        
[Add] /up_blocks.2/resnets.1/conv1/Conv_output_0                                                        1.00000 | 0.6220    1.00000 | 0.1311        0.94954 | 144.98    1.00000 | 0.1514        
[Add] /up_blocks.2/resnets.1/Add_output_0                                                               1.00000 | 0.6550    1.00000 | 0.1651        0.96438 | 144.96    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.6550    1.00000 | 0.1112        0.96438 | 144.96    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7913    1.00000 | 0.1824        0.96072 | 169.98    1.00000 | 1.5955        
[Reshape] /up_blocks.2/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.7913    1.00000 | 0.1259        0.96072 | 169.98    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.1/norm2/Add_output_0                                          1.00000 | 0.6315    1.00000 | 0.1514        0.97148 | 131.63    1.00000 | 0.1738        
[exSwish] /up_blocks.2/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.2687    1.00000 | 0.0452        0.93395 | 54.617    1.00000 | 0.2114        
[Conv] /up_blocks.2/resnets.1/conv2/Conv_output_0                                                       1.00000 | 1.1160    1.00000 | 0.2332        0.94936 | 223.65    1.00000 | 0.0081        
[Conv] /up_blocks.2/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 1.4599    1.00000 | 0.3508        
[Add] /up_blocks.2/resnets.1/Add_1_output_0                                                             1.00000 | 1.8554    1.00000 | 0.3854        0.93668 | 448.93    1.00000 | 0.3997        
[Reshape] /up_blocks.2/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.8554    1.00000 | 0.2644        0.93668 | 448.93    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.9122    1.00000 | 0.1791        0.93662 | 215.89    1.00000 | 1.6838        
[Reshape] /up_blocks.2/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.9122    1.00000 | 0.1258        0.93662 | 215.89    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.7514    1.00000 | 0.2058        0.97208 | 159.87    1.00000 | 0.0042        
[Reshape] /up_blocks.2/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.7514    1.00000 | 0.1509        0.97208 | 159.87    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.7514    1.00000 | 0.1509        0.97208 | 159.87    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.4042    1.00000 | 0.0969        0.93564 | 89.049    1.00000 | 0.3276        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.6310    1.00000 | 0.1144        0.91810 | 139.71    1.00000 | 0.0032        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.6310    1.00000 | 0.0710        0.91810 | 139.71    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.6310    1.00000 | 0.0710        0.91810 | 139.71    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.9249    1.00000 | 0.2449        0.97228 | 183.51    1.00000 | 0.0060        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.9249    1.00000 | 0.1622        0.97228 | 183.51    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.8581    1.00000 | 0.1888        0.95496 | 174.25    1.00000 | 0.0053        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.8581    1.00000 | 0.1199        0.95496 | 174.25    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 6.1266    1.00000 | 1.5087        0.98675 | 937.46    1.00000 | 0.0476        
[exSoftmax13] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0205    1.00000 | 0.0130        0.94624 | 2.5902    1.00000 | 0.0095        
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2741    1.00000 | 0.0415        0.92014 | 78.173    1.00000 | 0.0014        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2741    1.00000 | 0.0398        0.92014 | 78.173    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.4093    1.00000 | 0.1036        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.7897    1.00000 | 0.2167        0.95877 | 175.86    1.00000 | 0.1426        
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3983    1.00000 | 0.1039        0.94530 | 90.491    1.00000 | 0.3280        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5176    1.00000 | 0.1291        0.96685 | 114.94    1.00000 | 0.0038        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5176    1.00000 | 0.0904        0.96685 | 114.94    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.9660    1.00000 | 0.4508        0.99291 | 165.41    1.00000 | 0.0109        
[exSoftmax13] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0119    1.00000 | 0.0098        0.99993 | 0.7786    1.00000 | 0.1204        
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0863    1.00000 | 0.0314        0.99907 | 5.2969    1.00000 | 0.0003        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0863    1.00000 | 0.0204        0.99907 | 5.2969    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0975    1.00000 | 0.0652        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.8094    1.00000 | 0.2134        0.96592 | 175.98    1.00000 | 0.1492        
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.3431    1.00000 | 0.0746        0.93044 | 77.739    1.00000 | 0.2871        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.3150    1.00000 | 0.3064        0.95546 | 297.97    1.00000 | 0.0091        
[Split] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.9867    1.00000 | 0.1472        0.95270 | 218.93    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.8692    1.00000 | 0.1450        0.95831 | 202.13    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.5130    1.00000 | 0.1276        0.96201 | 109.14    1.00000 | 0.3335        
[Mul] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.4407    1.00000 | 0.0743        0.90364 | 93.281    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6429    1.00000 | 0.1147        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 1.0229    1.00000 | 0.2239        0.94659 | 209.69    1.00000 | 0.1627        
[Conv] /up_blocks.2/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 1.7919    1.00000 | 0.3320        0.93090 | 373.55    1.00000 | 0.0092        
[Reshape] /up_blocks.2/attentions.1/proj_out/Conv_output_0                                              1.00000 | 1.7919    1.00000 | 0.2075        0.93090 | 373.55    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.1/Add_output_0                                                            1.00000 | 1.9347    1.00000 | 0.4085        0.91671 | 432.42    1.00000 | 0.0           
[Concat] /up_blocks.2/Concat_2_output_0                                                                 1.00000 | 1.9829    1.00000 | 0.2343        0.89098 | 528.46    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9829    1.00000 | 0.2343        0.89098 | 528.46    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.2657    1.00000 | 0.2195        0.84977 | 406.37    0.99968 | 19.418        
[Reshape] /up_blocks.2/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 1.2657    1.00000 | 0.1550        0.84977 | 406.37    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2398    1.00000 | 0.0379        0.90012 | 59.548    1.00000 | 0.0465        
[exSwish] /up_blocks.2/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1149    1.00000 | 0.0178        0.88462 | 28.918    1.00000 | 0.0956        
[Conv] /up_blocks.2/resnets.2/conv1/Conv_output_0                                                       1.00000 | 0.4444    1.00000 | 0.0969        0.95570 | 106.21    1.00000 | 0.0041        
[Add] /up_blocks.2/resnets.2/Add_output_0                                                               1.00000 | 0.4969    1.00000 | 0.1469        0.97677 | 106.22    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.4969    1.00000 | 0.1030        0.97677 | 106.22    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.6252    1.00000 | 0.1809        0.97545 | 134.40    1.00000 | 1.4827        
[Reshape] /up_blocks.2/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.6252    1.00000 | 0.1245        0.97545 | 134.40    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.2/norm2/Add_output_0                                          1.00000 | 0.4021    1.00000 | 0.1211        0.98100 | 81.498    1.00000 | 0.1463        
[exSwish] /up_blocks.2/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1650    1.00000 | 0.0308        0.94177 | 35.594    1.00000 | 0.1197        
[Conv] /up_blocks.2/resnets.2/conv2/Conv_output_0                                                       1.00000 | 0.6099    1.00000 | 0.1448        
[Conv] /up_blocks.2/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.8638    1.00000 | 0.1950        0.91376 | 231.01    1.00000 | 0.0068        
[Add] /up_blocks.2/resnets.2/Add_1_output_0                                                             1.00000 | 1.0471    1.00000 | 0.2293        0.94031 | 259.64    1.00000 | 0.2228        
[Reshape] /up_blocks.2/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.0471    1.00000 | 0.1574        0.94031 | 259.64    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.8773    1.00000 | 0.1815        0.94030 | 209.53    1.00000 | 1.6575        
[Reshape] /up_blocks.2/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.8773    1.00000 | 0.1260        0.94030 | 209.53    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.5379    1.00000 | 0.1431        0.96931 | 124.65    1.00000 | 0.0031        
[Reshape] /up_blocks.2/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5379    1.00000 | 0.0991        0.96931 | 124.65    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.5379    1.00000 | 0.0991        0.96931 | 124.65    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.3361    1.00000 | 0.0747        0.92334 | 78.557    1.00000 | 0.2454        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.5569    1.00000 | 0.0912        0.90470 | 129.72    1.00000 | 0.0030        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.5569    1.00000 | 0.0623        0.90470 | 129.72    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.5569    1.00000 | 0.0623        0.90470 | 129.72    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.6620    1.00000 | 0.1707        0.96078 | 141.54    1.00000 | 0.0058        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.6620    1.00000 | 0.1054        0.96078 | 141.54    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.6323    1.00000 | 0.1428        0.94911 | 136.68    1.00000 | 0.0046        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.6323    1.00000 | 0.0896        0.94911 | 136.68    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 2.8121    1.00000 | 0.5783        0.96997 | 503.59    1.00000 | 0.0176        
[exSoftmax13] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0069    1.00000 | 0.0025        0.96805 | 1.0689    1.00000 | 0.0028        
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2115    1.00000 | 0.0312        0.88338 | 73.067    1.00000 | 0.0010        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2115    1.00000 | 0.0308        0.88338 | 73.067    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2566    1.00000 | 0.0707        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.5778    1.00000 | 0.1479        0.95659 | 140.78    1.00000 | 0.1321        
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.4081    1.00000 | 0.0964        0.93160 | 100.79    1.00000 | 0.3521        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5295    1.00000 | 0.1231        0.94891 | 129.04    1.00000 | 0.0043        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5295    1.00000 | 0.0837        0.94891 | 129.04    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.0615    1.00000 | 0.4736        0.99177 | 218.10    1.00000 | 0.0152        
[exSoftmax13] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0184    1.00000 | 0.0107        0.99960 | 1.7411    1.00000 | 0.1300        
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1127    1.00000 | 0.0301        0.99392 | 12.221    1.00000 | 0.0003        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1127    1.00000 | 0.0226        0.99392 | 12.221    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0884    1.00000 | 0.0486        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.5978    1.00000 | 0.1724        0.96644 | 140.81    1.00000 | 0.1350        
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.2601    1.00000 | 0.0583        0.91962 | 63.309    1.00000 | 0.2040        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 0.9735    1.00000 | 0.2282        0.95039 | 232.20    1.00000 | 0.0072        
[Split] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7274    1.00000 | 0.1011        0.94207 | 168.07    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6470    1.00000 | 0.1134        0.95722 | 160.21    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3428    1.00000 | 0.0844        0.95749 | 77.546    1.00000 | 0.2401        
[Mul] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2164    1.00000 | 0.0364        0.89181 | 48.469    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3057    1.00000 | 0.0570        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.6552    1.00000 | 0.1621        0.95143 | 147.49    1.00000 | 0.1145        
[Conv] /up_blocks.2/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 1.0395    1.00000 | 0.2071        0.93424 | 239.09    1.00000 | 0.0057        
[Reshape] /up_blocks.2/attentions.2/proj_out/Conv_output_0                                              1.00000 | 1.0395    1.00000 | 0.1363        0.93424 | 239.09    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.2/Add_output_0                                                            1.00000 | 0.8366    1.00000 | 0.2263        0.91442 | 183.09    1.00000 | 0.0           
[Resize] /up_blocks.2/upsamplers.0/Resize_output_0                                                      1.00000 | 1.6732    1.00000 | 0.1826        0.91442 | 366.18    1.00000 | 0.0           
[Conv] /up_blocks.2/upsamplers.0/conv/Conv_output_0                                                     1.00000 | 3.7705    1.00000 | 0.7602        0.94971 | 783.53    1.00000 | 0.0295        
[Concat] /up_blocks.3/Concat_output_0                                                                   1.00000 | 3.8058    1.00000 | 0.5195        0.94275 | 848.52    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 3.8058    1.00000 | 0.5195        0.94275 | 848.52    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 2.3518    1.00000 | 0.4389        0.83984 | 958.33    0.95452 | 562.33        
[Reshape] /up_blocks.3/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 2.3518    1.00000 | 0.3094        0.83984 | 958.33    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.0/norm1/Add_output_0                                          1.00000 | 1.1249    1.00000 | 0.2130        0.92847 | 351.80    1.00000 | 0.2858        
[exSwish] /up_blocks.3/resnets.0/act/Mul_output_0                                                       1.00000 | 0.4209    1.00000 | 0.0674        0.85265 | 147.73    1.00000 | 0.4182        
[Conv] /up_blocks.3/resnets.0/conv1/Conv_output_0                                                       1.00000 | 0.8407    1.00000 | 0.2298        0.91369 | 328.95    1.00000 | 0.0097        
[Add] /up_blocks.3/resnets.0/Add_output_0                                                               1.00000 | 0.9140    1.00000 | 0.3147        0.95829 | 328.78    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.9140    1.00000 | 0.2193        0.95829 | 328.78    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7447    1.00000 | 0.2526        0.89995 | 458.42    0.93754 | 378.39        
[Reshape] /up_blocks.3/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.7447    1.00000 | 0.1812        0.89995 | 458.42    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.0/norm2/Add_output_0                                          1.00000 | 0.5549    1.00000 | 0.1693        0.88820 | 307.56    1.00000 | 0.2408        
[exSwish] /up_blocks.3/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.2728    1.00000 | 0.0768        0.82335 | 212.43    1.00000 | 0.2583        
[Conv] /up_blocks.3/resnets.0/conv2/Conv_output_0                                                       1.00000 | 0.7486    1.00000 | 0.2493        
[Conv] /up_blocks.3/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.8910    1.00000 | 0.2867        0.94147 | 293.18    1.00000 | 0.0085        
[Add] /up_blocks.3/resnets.0/Add_1_output_0                                                             1.00000 | 1.1875    1.00000 | 0.3553        0.90692 | 609.83    1.00000 | 0.4355        
[Reshape] /up_blocks.3/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.1875    1.00000 | 0.2529        0.90692 | 609.83    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.8876    1.00000 | 0.2544        0.87622 | 461.09    0.96440 | 260.50        
[Reshape] /up_blocks.3/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.8876    1.00000 | 0.1785        0.87622 | 461.09    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.3963    1.00000 | 0.1297        0.89305 | 178.46    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.3963    1.00000 | 0.0729        0.89305 | 178.46    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.3963    1.00000 | 0.0729        0.89305 | 178.46    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.7777    1.00000 | 0.1763        0.77690 | 335.80    1.00000 | 0.5336        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.8776    1.00000 | 0.1663        0.69007 | 390.67    1.00000 | 0.0053        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.8776    1.00000 | 0.0990        0.69007 | 390.67    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.8776    1.00000 | 0.0990        0.69007 | 390.67    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.8850    1.00000 | 0.4569        0.92501 | 716.15    1.00000 | 0.0151        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.8850    1.00000 | 0.3564        0.92501 | 716.15    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.5499    1.00000 | 0.3265        0.84147 | 639.59    1.00000 | 0.0094        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.5499    1.00000 | 0.2365        0.84147 | 639.59    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 33.898    1.00000 | 17.037        0.98603 | 14216.    1.00000 | 0.4507        
[exSoftmax13] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0421    1.00000 | 0.0321        0.80024 | 6.6677    1.00000 | 0.0154        
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.3443    1.00000 | 0.0508        0.55480 | 280.71    1.00000 | 0.0030        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.3443    1.00000 | 0.0495        0.55480 | 280.71    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.3258    1.00000 | 0.0995        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.4349    1.00000 | 0.1299        0.83690 | 223.64    1.00000 | 0.1365        
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3254    1.00000 | 0.0982        0.86129 | 159.35    1.00000 | 0.2823        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.2942    1.00000 | 0.1026        0.93692 | 122.60    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.2942    1.00000 | 0.0716        0.93692 | 122.60    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.8542    1.00000 | 0.8673        0.98626 | 448.25    1.00000 | 0.0162        
[exSoftmax13] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0376    1.00000 | 0.0227        0.98979 | 15.946    1.00000 | 0.1759        
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1501    1.00000 | 0.0337        0.88793 | 59.482    1.00000 | 0.0011        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1501    1.00000 | 0.0190        0.88793 | 59.482    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0866    1.00000 | 0.0269        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.4495    1.00000 | 0.1099        0.85918 | 223.08    1.00000 | 0.0824        
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.6851    1.00000 | 0.1334        0.68841 | 336.54    1.00000 | 0.4834        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.6466    1.00000 | 0.3913        0.84115 | 802.52    1.00000 | 0.0132        
[Split] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 1.2674    1.00000 | 0.1699        0.77994 | 608.86    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 1.0511    1.00000 | 0.1935        0.88738 | 522.81    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.7937    1.00000 | 0.2336        0.89355 | 415.55    1.00000 | 0.7165        
[Mul] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.6280    1.00000 | 0.1084        0.63913 | 352.96    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.5786    1.00000 | 0.1007        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.7269    1.00000 | 0.1278        0.73228 | 366.34    1.00000 | 0.1512        
[Conv] /up_blocks.3/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 1.1800    1.00000 | 0.2087        0.72299 | 595.55    1.00000 | 0.0067        
[Reshape] /up_blocks.3/attentions.0/proj_out/Conv_output_0                                              1.00000 | 1.1800    1.00000 | 0.1398        0.72299 | 595.55    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.0/Add_output_0                                                            1.00000 | 1.4738    1.00000 | 0.3727        0.81830 | 756.86    1.00000 | 0.0           
[Concat] /up_blocks.3/Concat_1_output_0                                                                 1.00000 | 1.5136    1.00000 | 0.2555        0.83779 | 782.71    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.5136    1.00000 | 0.2555        0.83779 | 782.71    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.3630    1.00000 | 0.3616        0.78133 | 1223.5    0.89298 | 989.56        
[Reshape] /up_blocks.3/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 1.3630    1.00000 | 0.2525        0.78133 | 1223.5    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.1/norm1/Add_output_0                                          1.00000 | 0.3815    1.00000 | 0.1131        0.84591 | 363.34    1.00000 | 0.1910        
[exSwish] /up_blocks.3/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1708    1.00000 | 0.0355        0.67181 | 141.76    0.99999 | 0.7500        
[Conv] /up_blocks.3/resnets.1/conv1/Conv_output_0                                                       1.00000 | 0.4382    1.00000 | 0.1493        0.91723 | 335.09    1.00000 | 0.0100        
[Add] /up_blocks.3/resnets.1/Add_output_0                                                               1.00000 | 0.5475    1.00000 | 0.2695        0.95661 | 334.85    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.5475    1.00000 | 0.1935        0.95661 | 334.85    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.5174    1.00000 | 0.2558        0.89349 | 468.84    0.93180 | 389.60        
[Reshape] /up_blocks.3/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.5174    1.00000 | 0.1808        0.89349 | 468.84    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.1/norm2/Add_output_0                                          1.00000 | 0.3553    1.00000 | 0.1577        0.87393 | 307.98    1.00000 | 0.2153        
[exSwish] /up_blocks.3/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.1451    1.00000 | 0.0409        0.79054 | 117.28    1.00000 | 0.1673        
[Conv] /up_blocks.3/resnets.1/conv2/Conv_output_0                                                       1.00000 | 0.3690    1.00000 | 0.1354        
[Conv] /up_blocks.3/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 0.5098    1.00000 | 0.2227        0.96475 | 213.29    1.00000 | 0.0074        
[Add] /up_blocks.3/resnets.1/Add_1_output_0                                                             1.00000 | 0.6514    1.00000 | 0.2759        0.93063 | 387.90    1.00000 | 0.2886        
[Reshape] /up_blocks.3/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6514    1.00000 | 0.1955        0.93063 | 387.90    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.7508    1.00000 | 0.2600        0.84944 | 567.14    0.93373 | 408.28        
[Reshape] /up_blocks.3/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.7508    1.00000 | 0.1800        0.84944 | 567.14    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.3766    1.00000 | 0.1399        0.89295 | 223.15    1.00000 | 0.0066        
[Reshape] /up_blocks.3/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.3766    1.00000 | 0.0943        0.89295 | 223.15    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.3766    1.00000 | 0.0943        0.89295 | 223.15    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.5532    1.00000 | 0.1595        0.79927 | 304.76    1.00000 | 0.5418        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.6008    1.00000 | 0.1287        0.69770 | 350.05    1.00000 | 0.0041        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.6008    1.00000 | 0.0811        0.69770 | 350.05    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.6008    1.00000 | 0.0811        0.69770 | 350.05    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.5483    1.00000 | 0.5226        0.94139 | 672.20    1.00000 | 0.0158        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.5483    1.00000 | 0.4159        0.94139 | 672.20    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.3004    1.00000 | 0.3673        0.89027 | 667.27    1.00000 | 0.0118        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.3004    1.00000 | 0.2849        0.89027 | 667.27    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 39.356    1.00000 | 35.475        0.99720 | 10374.    1.00000 | 0.7943        
[exSoftmax13] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0297    0.99999 | 0.0248        0.77125 | 4.0997    1.00000 | 0.0084        
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2523    1.00000 | 0.0537        0.65684 | 273.48    1.00000 | 0.0036        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2523    1.00000 | 0.0535        0.65684 | 273.48    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2424    1.00000 | 0.1111        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.3925    1.00000 | 0.1511        0.80553 | 262.07    1.00000 | 0.1466        
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3184    1.00000 | 0.1227        0.85196 | 176.75    1.00000 | 0.3577        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.3203    1.00000 | 0.1294        0.90665 | 193.67    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.3203    1.00000 | 0.0929        0.90665 | 193.67    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 2.1644    1.00000 | 1.2615        0.95146 | 1192.3    1.00000 | 0.0284        
[exSoftmax13] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0279    1.00000 | 0.0196        0.98907 | 19.590    1.00000 | 0.1797        
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1515    1.00000 | 0.0237        0.33942 | 105.58    1.00000 | 0.0004        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1515    1.00000 | 0.0129        0.33942 | 105.58    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1019    1.00000 | 0.0195        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.4152    1.00000 | 0.1143        0.79118 | 269.27    1.00000 | 0.0647        
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.5691    1.00000 | 0.1362        0.66527 | 346.79    1.00000 | 0.5101        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.3241    1.00000 | 0.3528        0.76480 | 803.66    1.00000 | 0.0114        
[Split] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.9976    1.00000 | 0.1447        0.69805 | 618.98    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.8707    1.00000 | 0.1654        0.82204 | 512.58    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.5291    1.00000 | 0.1618        0.83885 | 309.00    1.00000 | 0.4964        
[Mul] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3491    1.00000 | 0.0596        0.52962 | 212.81    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3494    1.00000 | 0.0628        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.5381    1.00000 | 0.1205        0.64647 | 343.73    1.00000 | 0.1161        
[Conv] /up_blocks.3/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 0.6949    1.00000 | 0.1373        0.57822 | 445.65    1.00000 | 0.0047        
[Reshape] /up_blocks.3/attentions.1/proj_out/Conv_output_0                                              1.00000 | 0.6949    1.00000 | 0.0863        0.57822 | 445.65    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.1/Add_output_0                                                            1.00000 | 0.8416    1.00000 | 0.2874        0.87871 | 513.88    1.00000 | 0.0           
[Concat] /up_blocks.3/Concat_2_output_0                                                                 1.00000 | 0.8470    1.00000 | 0.2006        0.88970 | 513.88    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.8470    1.00000 | 0.2006        0.88970 | 513.88    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9919    1.00000 | 0.3562        0.86989 | 739.90    0.94646 | 519.84        
[Reshape] /up_blocks.3/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.9919    1.00000 | 0.2507        0.86989 | 739.90    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2671    1.00000 | 0.0798        0.82832 | 221.61    1.00000 | 0.1101        
[exSwish] /up_blocks.3/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1197    1.00000 | 0.0304        0.76981 | 87.384    1.00000 | 0.2565        
[Conv] /up_blocks.3/resnets.2/conv1/Conv_output_0                                                       1.00000 | 0.3535    1.00000 | 0.1288        0.89335 | 269.24    1.00000 | 0.0078        
[Add] /up_blocks.3/resnets.2/Add_output_0                                                               1.00000 | 0.5657    1.00000 | 0.3101        0.97605 | 268.60    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.5657    1.00000 | 0.2187        0.97605 | 268.60    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4700    1.00000 | 0.2566        0.90923 | 529.62    0.93423 | 479.79        
[Reshape] /up_blocks.3/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.4700    1.00000 | 0.1764        0.90923 | 529.62    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.2/norm2/Add_output_0                                          1.00000 | 0.3263    1.00000 | 0.1622        0.91260 | 347.45    1.00000 | 0.2440        
[exSwish] /up_blocks.3/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1306    1.00000 | 0.0463        0.82707 | 113.86    1.00000 | 0.1628        
[Conv] /up_blocks.3/resnets.2/conv2/Conv_output_0                                                       1.00000 | 0.4666    1.00000 | 0.3023        
[Conv] /up_blocks.3/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.5386    1.00000 | 0.3747        0.99217 | 205.96    1.00000 | 0.0143        
[Add] /up_blocks.3/resnets.2/Add_1_output_0                                                             1.00000 | 0.9020    1.00000 | 0.7005        0.98829 | 386.51    1.00000 | 0.7014        
[Reshape] /up_blocks.3/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.9020    1.00000 | 0.5074        0.98829 | 386.51    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.4519    1.00000 | 0.2655        0.91319 | 439.51    0.93692 | 387.79        
[Reshape] /up_blocks.3/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.4519    1.00000 | 0.1792        0.91319 | 439.51    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.1926    1.00000 | 0.0972        0.80904 | 154.66    1.00000 | 0.0026        
[Reshape] /up_blocks.3/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.1926    1.00000 | 0.0426        0.80904 | 154.66    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.1926    1.00000 | 0.0426        0.80904 | 154.66    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.5178    1.00000 | 0.1475        0.69519 | 337.98    1.00000 | 0.4650        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.4938    1.00000 | 0.1037        0.70327 | 343.48    1.00000 | 0.0044        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.4938    1.00000 | 0.0718        0.70327 | 343.48    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.4938    1.00000 | 0.0718        0.70327 | 343.48    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.1723    1.00000 | 0.5359        0.85913 | 783.40    1.00000 | 0.0131        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.1723    1.00000 | 0.3130        0.85913 | 783.40    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.1278    1.00000 | 0.2768        0.73165 | 711.03    1.00000 | 0.0096        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.1278    1.00000 | 0.1777        0.73165 | 711.03    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 39.574    1.00000 | 16.890        0.98470 | 18383.    1.00000 | 0.3098        
[exSoftmax13] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0100    1.00000 | 0.0062        0.75801 | 2.7709    1.00000 | 0.0045        
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1885    1.00000 | 0.0254        0.34946 | 284.66    1.00000 | 0.0023        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1885    1.00000 | 0.0253        0.34946 | 284.66    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.1444    1.00000 | 0.0394        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.2259    1.00000 | 0.0739        0.80437 | 188.41    1.00000 | 0.0914        
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2612    1.00000 | 0.1084        0.83726 | 176.91    1.00000 | 0.3183        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.2755    1.00000 | 0.1111        0.93279 | 150.24    1.00000 | 0.0035        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.2755    1.00000 | 0.0846        0.93279 | 150.24    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 2.2804    1.00000 | 1.0735        0.95749 | 947.74    1.00000 | 0.0244        
[exSoftmax13] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0318    1.00000 | 0.0222        0.99477 | 13.859    1.00000 | 0.1994        
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1218    1.00000 | 0.0261        0.29165 | 80.437    1.00000 | 0.0004        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1218    1.00000 | 0.0121        0.29165 | 80.437    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0670    1.00000 | 0.0121        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.2426    1.00000 | 0.0767        0.79460 | 197.96    1.00000 | 0.0465        
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.4379    1.00000 | 0.1133        0.66474 | 327.39    1.00000 | 0.5158        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.1340    1.00000 | 0.3274        0.81550 | 762.80    1.00000 | 0.0128        
[Split] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.8439    1.00000 | 0.1263        0.73147 | 577.39    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.7574    1.00000 | 0.1860        0.86997 | 498.48    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3740    1.00000 | 0.1314        0.85581 | 256.69    1.00000 | 0.4210        
[Mul] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2483    1.00000 | 0.0441        0.41029 | 238.33    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3048    1.00000 | 0.0578        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.3949    1.00000 | 0.1166        0.70021 | 369.61    1.00000 | 0.1572        
[Conv] /up_blocks.3/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 0.6315    1.00000 | 0.2756        0.91999 | 501.48    1.00000 | 0.0123        
[Reshape] /up_blocks.3/attentions.2/proj_out/Conv_output_0                                              1.00000 | 0.6315    1.00000 | 0.2450        0.91999 | 501.48    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.2/Add_output_0                                                            1.00000 | 1.2570    1.00000 | 0.8952        0.98283 | 586.88    1.00000 | 0.0           
[Reshape] /conv_norm_out/Reshape_output_0_rs                                                            1.00000 | 1.2570    1.00000 | 0.6420        0.98283 | 586.88    1.00000 | 0.0           
[exNorm] /conv_norm_out/Reshape_output_0_tp-rs_sw                                                       1.00000 | 0.4223    1.00000 | 0.2598        0.87377 | 601.97    0.89414 | 566.55        
[Reshape] /conv_norm_out/Reshape_1_output_0                                                             1.00000 | 0.4223    1.00000 | 0.1763        0.87377 | 601.97    1.00000 | 0.0           
[BatchNormalization] /conv_norm_out/Add_output_0                                                        1.00000 | 0.7759    1.00000 | 0.5661        0.94678 | 951.81    1.00000 | 0.5998        
[exSwish] /act/Mul_output_0                                                                             1.00000 | 0.0511    1.00000 | 0.0187        0.84222 | 51.931    0.99924 | 3.6078        
[Conv] out_sample                                                                                       1.00000 | 0.0234    1.00000 | 0.0200        0.99670 | 22.932    1.00000 | 0.0009

yuyun2000 commented 1 month ago

用1.5.0版本

EvW1998 commented 1 month ago

看了下，掉精度问题主要是LayerNorm导致的

layer_name                                                                                                       simulator_error                             runtime_error                      
                                                                                                             entire              single                  entire           single_sim            
                                                                                                          cos      euc        cos      euc            cos      euc        cos      euc          
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
[Input] encoder_hidden_states                                                                           1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0512    1.00000 | 0.0512        
[Reshape] encoder_hidden_states_rs                                                                      1.00000 | 0.0512    1.00000 | 0.0512        1.00000 | 0.0512    1.00000 | 0.0           
[Transpose] encoder_hidden_states_tp-rs                                                                 1.00000 | 0.0512    1.00000 | 0.0512        1.00000 | 0.0512    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1120    1.00000 | 0.1120        1.00000 | 0.1121    1.00000 | 0.0031        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1120    1.00000 | 0.0827        1.00000 | 0.1121    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0404    1.00000 | 0.0404        1.00000 | 0.0404    1.00000 | 0.0005        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0404    1.00000 | 0.0306        1.00000 | 0.0404    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0404    1.00000 | 0.0306        1.00000 | 0.0404    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.0962    1.00000 | 0.0962        1.00000 | 0.0962    1.00000 | 0.0010        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.0962    1.00000 | 0.0619        1.00000 | 0.0962    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0320    1.00000 | 0.0320        1.00000 | 0.0321    1.00000 | 0.0020        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0320    1.00000 | 0.0233        1.00000 | 0.0321    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0320    1.00000 | 0.0233        1.00000 | 0.0321    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1320    1.00000 | 0.1320        1.00000 | 0.1320    1.00000 | 0.0030        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1320    1.00000 | 0.0860        1.00000 | 0.1320    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0493    1.00000 | 0.0493        1.00000 | 0.0493    1.00000 | 0.0009        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0493    1.00000 | 0.0311        1.00000 | 0.0493    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0493    1.00000 | 0.0311        1.00000 | 0.0493    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1214    1.00000 | 0.1214        1.00000 | 0.1214    1.00000 | 0.0044        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1214    1.00000 | 0.0840        1.00000 | 0.1214    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0530    1.00000 | 0.0530        1.00000 | 0.0530    1.00000 | 0.0006        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0530    1.00000 | 0.0413        1.00000 | 0.0530    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0530    1.00000 | 0.0413        1.00000 | 0.0530    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1551    1.00000 | 0.1551        1.00000 | 0.1551    1.00000 | 0.0036        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1551    1.00000 | 0.1083        1.00000 | 0.1551    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0811    1.00000 | 0.0811        1.00000 | 0.0811    1.00000 | 0.0016        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0811    1.00000 | 0.0398        1.00000 | 0.0811    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0811    1.00000 | 0.0398        1.00000 | 0.0811    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                   1.00000 | 0.1552    1.00000 | 0.1552        1.00000 | 0.1552    1.00000 | 0.0047        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                1.00000 | 0.1552    1.00000 | 0.0980        1.00000 | 0.1552    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                   1.00000 | 0.0831    1.00000 | 0.0831        1.00000 | 0.0831    1.00000 | 0.0021        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                     1.00000 | 0.0831    1.00000 | 0.0382        1.00000 | 0.0831    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                1.00000 | 0.0831    1.00000 | 0.0382        1.00000 | 0.0831    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                       1.00000 | 0.1351    1.00000 | 0.1351        1.00000 | 0.1351    1.00000 | 0.0034        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                    1.00000 | 0.1351    1.00000 | 0.0875        1.00000 | 0.1351    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                       1.00000 | 0.1046    1.00000 | 0.1046        1.00000 | 0.1046    1.00000 | 0.0035        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                         1.00000 | 0.1046    1.00000 | 0.0495        1.00000 | 0.1046    1.00000 | 0.0           
[Transpose] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                    1.00000 | 0.1046    1.00000 | 0.0495        1.00000 | 0.1046    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1494    1.00000 | 0.1494        1.00000 | 0.1494    1.00000 | 0.0028        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1494    1.00000 | 0.0819        1.00000 | 0.1494    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1045    1.00000 | 0.1045        1.00000 | 0.1045    1.00000 | 0.0024        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1045    1.00000 | 0.0482        1.00000 | 0.1045    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1045    1.00000 | 0.0482        1.00000 | 0.1045    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1558    1.00000 | 0.1558        1.00000 | 0.1558    1.00000 | 0.0040        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1558    1.00000 | 0.0852        1.00000 | 0.1558    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1172    1.00000 | 0.1172        1.00000 | 0.1172    1.00000 | 0.0026        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1172    1.00000 | 0.0554        1.00000 | 0.1172    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1172    1.00000 | 0.0554        1.00000 | 0.1172    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1547    1.00000 | 0.1547        1.00000 | 0.1546    1.00000 | 0.0032        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1547    1.00000 | 0.0802        1.00000 | 0.1546    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1072    1.00000 | 0.1072        1.00000 | 0.1072    1.00000 | 0.0021        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1072    1.00000 | 0.0467        1.00000 | 0.1072    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1072    1.00000 | 0.0467        1.00000 | 0.1072    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1366    1.00000 | 0.1366        1.00000 | 0.1366    1.00000 | 0.0046        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1366    1.00000 | 0.0816        1.00000 | 0.1366    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.1134    1.00000 | 0.1134        1.00000 | 0.1134    1.00000 | 0.0041        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.1134    1.00000 | 0.0712        1.00000 | 0.1134    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.1134    1.00000 | 0.0712        1.00000 | 0.1134    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1095    1.00000 | 0.1095        1.00000 | 0.1096    1.00000 | 0.0025        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1095    1.00000 | 0.0581        1.00000 | 0.1096    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0731    1.00000 | 0.0731        1.00000 | 0.0731    1.00000 | 0.0013        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0731    1.00000 | 0.0404        1.00000 | 0.0731    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0731    1.00000 | 0.0404        1.00000 | 0.0731    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1123    1.00000 | 0.1123        1.00000 | 0.1123    1.00000 | 0.0023        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1123    1.00000 | 0.0672        1.00000 | 0.1123    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0649    1.00000 | 0.0649        1.00000 | 0.0649    1.00000 | 0.0015        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0649    1.00000 | 0.0386        1.00000 | 0.0649    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0649    1.00000 | 0.0386        1.00000 | 0.0649    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1016    1.00000 | 0.1016        1.00000 | 0.1016    1.00000 | 0.0026        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1016    1.00000 | 0.0631        1.00000 | 0.1016    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0293    1.00000 | 0.0293        1.00000 | 0.0293    1.00000 | 0.0003        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0293    1.00000 | 0.0188        1.00000 | 0.0293    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0293    1.00000 | 0.0188        1.00000 | 0.0293    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1123    1.00000 | 0.1123        1.00000 | 0.1123    1.00000 | 0.0032        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1123    1.00000 | 0.0771        1.00000 | 0.1123    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0379    1.00000 | 0.0379        1.00000 | 0.0379    1.00000 | 0.0010        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0379    1.00000 | 0.0278        1.00000 | 0.0379    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0379    1.00000 | 0.0278        1.00000 | 0.0379    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_k/MatMul_output_0_mm                     1.00000 | 0.1070    1.00000 | 0.1070        1.00000 | 0.1070    1.00000 | 0.0020        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Transpose_3_output_0_rs                  1.00000 | 0.1070    1.00000 | 0.0722        1.00000 | 0.1070    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_v/MatMul_output_0_mm                     1.00000 | 0.0365    1.00000 | 0.0365        1.00000 | 0.0365    1.00000 | 0.0008        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_4_output_0                       1.00000 | 0.0365    1.00000 | 0.0285        1.00000 | 0.0365    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_5_output_0_rs                  1.00000 | 0.0365    1.00000 | 0.0285        1.00000 | 0.0365    1.00000 | 0.0           
[Input] timestep_cond                                                                                   1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0018    1.00000 | 0.0018        
[Reshape] timestep_cond_tp_rs                                                                           1.00000 | 0.0018    1.00000 | 0.0018        1.00000 | 0.0018    1.00000 | 0.0           
[Input] timestep                                                                                        1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Reshape] /time_proj/Unsqueeze_output_0_rs                                                              1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Cast] /time_proj/Cast_output_0-rs                                                                      1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0       1.00000 | 0.0           
[Mul] /time_proj/Mul_output_0-rs                                                                        1.00000 | 0.9044    1.00000 | 0.9044        1.00000 | 0.9044    1.00000 | 0.0           
[Cos] /time_proj/Cos_output_0-rs                                                                        0.99668 | 0.7595    0.99901 | 0.4166        0.99668 | 0.7595    1.00000 | 0.0           
[Sin] /time_proj/Sin_output_0-rs                                                                        0.99840 | 0.4852    0.99904 | 0.3757        0.99840 | 0.4852    1.00000 | 0.0           
[Concat] /time_proj/Concat_1_output_0-rs                                                                0.99746 | 0.9013    1.00000 | 0.0020        0.99746 | 0.9013    1.00000 | 0.0           
[exMatMul] /time_embedding/Add_output_0-rs                                                              0.99803 | 0.9015    1.00000 | 0.0037        0.99803 | 0.9015    1.00000 | 3.0517        
[Conv] /time_embedding/linear_1/Gemm_output_0_mm                                                        0.99999 | 0.1124    1.00000 | 0.0064        
[exSwish] /time_embedding/act/Mul_output_0-rs                                                           1.00000 | 0.0412    1.00000 | 0.0052        1.00000 | 0.0558    1.00000 | 0.0338        
[Conv] /time_embedding/linear_2/Gemm_output_0_mm                                                        1.00000 | 0.0125    1.00000 | 0.0037        
[exSwish] /down_blocks.0/resnets.0/act_1/Mul_output_0-rs                                                1.00000 | 0.0067    1.00000 | 0.0025        1.00000 | 0.0229    1.00000 | 0.0081        
[Conv] /up_blocks.3/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0082    1.00000 | 0.0043        1.00000 | 0.0456    1.00000 | 0.0002        
[Conv] /up_blocks.3/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0049    1.00000 | 0.0028        1.00000 | 0.0267    1.00000 | 0.0           
[Conv] /up_blocks.3/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0051    1.00000 | 0.0028        1.00000 | 0.0261    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0059    1.00000 | 0.0032        1.00000 | 0.0279    1.00000 | 1.5258        
[Conv] /up_blocks.2/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0059    1.00000 | 0.0034        1.00000 | 0.0273    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0077    1.00000 | 0.0046        1.00000 | 0.0384    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0088    1.00000 | 0.0053        1.00000 | 0.0515    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0086    1.00000 | 0.0049        1.00000 | 0.0468    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0118    1.00000 | 0.0072        1.00000 | 0.0701    1.00000 | 1.9073        
[Conv] /up_blocks.0/resnets.2/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0073    1.00000 | 0.0043        1.00000 | 0.0403    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0075    1.00000 | 0.0042        1.00000 | 0.0395    1.00000 | 0.0001        
[Conv] /up_blocks.0/resnets.0/time_emb_proj/Gemm_output_0_mm                                            1.00000 | 0.0063    1.00000 | 0.0033        1.00000 | 0.0339    1.00000 | 0.0005        
[Conv] /mid_block/resnets.1/time_emb_proj/Gemm_output_0_mm                                              1.00000 | 0.0076    1.00000 | 0.0043        1.00000 | 0.0417    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/time_emb_proj/Gemm_output_0_mm                                              1.00000 | 0.0101    1.00000 | 0.0062        1.00000 | 0.0567    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0092    1.00000 | 0.0051        1.00000 | 0.0490    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0090    1.00000 | 0.0059        1.00000 | 0.0534    1.00000 | 0.0004        
[Conv] /down_blocks.2/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0128    1.00000 | 0.0065        1.00000 | 0.0651    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0199    1.00000 | 0.0163        1.00000 | 0.1311    1.00000 | 1.9073        
[Conv] /down_blocks.1/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0072    1.00000 | 0.0039        1.00000 | 0.0390    1.00000 | 0.0004        
[Conv] /down_blocks.1/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0098    1.00000 | 0.0081        1.00000 | 0.0688    1.00000 | 3.0517        
[Conv] /down_blocks.0/resnets.1/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0061    1.00000 | 0.0032        1.00000 | 0.0314    1.00000 | 0.0           
[Conv] /down_blocks.0/resnets.0/time_emb_proj/Gemm_output_0_mm                                          1.00000 | 0.0204    1.00000 | 0.0106        1.00000 | 0.0941    1.00000 | 0.0           
[Input] sample                                                                                          1.00000 | 0.0       1.00000 | 0.0           1.00000 | 0.0198    1.00000 | 0.0198        
[Conv] /conv_in/Conv_output_0                                                                           1.00000 | 0.0954    1.00000 | 0.0954        1.00000 | 0.1164    1.00000 | 0.1049        
[Reshape] /down_blocks.0/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.0954    1.00000 | 0.0682        1.00000 | 0.1164    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3050    1.00000 | 0.2516        0.99775 | 57.629    0.99775 | 57.628        
[Reshape] /down_blocks.0/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.3050    1.00000 | 0.1782        0.99775 | 57.629    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1648    1.00000 | 0.1178        0.99780 | 26.862    1.00000 | 0.1353        
[exSwish] /down_blocks.0/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0982    1.00000 | 0.0591        0.99760 | 13.442    1.00000 | 0.1579        
[Conv] /down_blocks.0/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.3180    1.00000 | 0.2264        0.99840 | 48.960    1.00000 | 0.0103        
[Add] /down_blocks.0/resnets.0/Add_output_0                                                             1.00000 | 1.1440    1.00000 | 0.7100        0.99977 | 48.745    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 1.1440    1.00000 | 0.4865        0.99977 | 48.745    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.4245    1.00000 | 0.2608        0.79848 | 1036.2    0.79899 | 1035.5        
[Reshape] /down_blocks.0/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.4245    1.00000 | 0.1770        0.79848 | 1036.2    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.0/norm2/Add_output_0                                        1.00000 | 0.2401    1.00000 | 0.1400        0.80415 | 728.08    1.00000 | 0.3410        
[exSwish] /down_blocks.0/resnets.0/act_2/Mul_output_0                                                   1.00000 | 0.0751    1.00000 | 0.0323        0.89997 | 53.299    0.99994 | 1.3389        
[Conv] /down_blocks.0/resnets.0/conv2/Conv_output_0                                                     1.00000 | 0.1945    1.00000 | 0.1243        
[Add] /down_blocks.0/resnets.0/Add_1_output_0                                                           1.00000 | 0.2529    1.00000 | 0.1846        0.97869 | 122.59    1.00000 | 0.1968        
[Reshape] /down_blocks.0/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.2529    1.00000 | 0.1254        0.97869 | 122.59    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.5969    1.00000 | 0.2662        0.89386 | 429.87    0.94890 | 306.85        
[Reshape] /down_blocks.0/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.5969    1.00000 | 0.1763        0.89386 | 429.87    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.1597    1.00000 | 0.0639        0.83664 | 99.236    1.00000 | 0.0019        
[Reshape] /down_blocks.0/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.1597    1.00000 | 0.0329        0.83664 | 99.236    1.00000 | 0.0           
[Reshape] /down_blocks.0/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.1597    1.00000 | 0.0329        0.83664 | 99.236    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.5392    1.00000 | 0.1666        0.79444 | 294.45    1.00000 | 0.4643        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5717    1.00000 | 0.1669        0.83169 | 336.31    1.00000 | 0.0055        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5717    1.00000 | 0.1187        0.83169 | 336.31    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5717    1.00000 | 0.1187        0.83169 | 336.31    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 1.0441    1.00000 | 0.2620        0.78992 | 531.01    1.00000 | 0.0077        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 1.0441    1.00000 | 0.1692        0.78992 | 531.01    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.9920    1.00000 | 0.2618        0.80620 | 517.68    1.00000 | 0.0070        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.9920    1.00000 | 0.1700        0.80620 | 517.68    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 11.536    1.00000 | 3.0699        0.66416 | 8282.7    1.00000 | 0.0774        
[exSoftmax13] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0112    1.00000 | 0.0056        0.79018 | 3.5304    1.00000 | 0.0121        
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2218    1.00000 | 0.0237        0.32463 | 276.62    1.00000 | 0.0027        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2218    1.00000 | 0.0229        0.32463 | 276.62    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1432    1.00000 | 0.0362        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.2035    1.00000 | 0.0583        0.72184 | 167.74    1.00000 | 0.0753        
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.3697    1.00000 | 0.1149        0.70563 | 249.56    1.00000 | 0.3431        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.4580    1.00000 | 0.1361        0.78203 | 330.44    1.00000 | 0.0043        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.4580    1.00000 | 0.0935        0.78203 | 330.44    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 2.6837    1.00000 | 1.3370        0.94825 | 1326.9    1.00000 | 0.0280        
[exSoftmax13] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0335    1.00000 | 0.0221        0.97298 | 29.344    1.00000 | 0.1825        
[exMatMul] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1241    1.00000 | 0.0191        0.12919 | 146.78    1.00000 | 0.0020        
[Reshape] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1241    1.00000 | 0.0115        0.12919 | 146.78    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0598    1.00000 | 0.0131        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.2191    1.00000 | 0.0613        0.72051 | 184.24    1.00000 | 0.0580        
[exNorm] /down_blocks.0/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.4180    1.00000 | 0.1292        0.65067 | 294.41    1.00000 | 0.3451        
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 1.2678    1.00000 | 0.3849        0.74518 | 923.09    1.00000 | 0.0113        
[Split] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.8189    1.00000 | 0.1471        0.70363 | 573.90    1.00000 | 0.0           
[Split] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.9678    1.00000 | 0.2318        0.77100 | 723.00    1.00000 | 0.0           
[exGelu] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.4192    1.00000 | 0.1264        0.70688 | 301.06    1.00000 | 0.3440        
[Mul] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2610    1.00000 | 0.0569        0.47243 | 184.22    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2558    1.00000 | 0.0585        
[Add] /down_blocks.0/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.3340    1.00000 | 0.0763        0.55981 | 249.80    1.00000 | 0.0863        
[Conv] /down_blocks.0/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.2603    1.00000 | 0.0604        0.58588 | 192.77    1.00000 | 0.0018        
[Reshape] /down_blocks.0/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.2603    1.00000 | 0.0386        0.58588 | 192.77    1.00000 | 0.0           
[Add] /down_blocks.0/attentions.0/Add_output_0                                                          1.00000 | 0.3447    1.00000 | 0.1780        0.93670 | 199.47    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.3447    1.00000 | 0.1158        0.93670 | 199.47    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.9161    1.00000 | 0.2654        0.77677 | 617.81    0.94723 | 314.63        
[Reshape] /down_blocks.0/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.9161    1.00000 | 0.1772        0.77677 | 617.81    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.1/norm1/Add_output_0                                        1.00000 | 0.3163    1.00000 | 0.0866        0.78792 | 205.71    1.00000 | 0.1143        
[exSwish] /down_blocks.0/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1418    1.00000 | 0.0330        0.71121 | 92.113    1.00000 | 0.1233        
[Conv] /down_blocks.0/resnets.1/conv1/Conv_output_0                                                     1.00000 | 0.3992    1.00000 | 0.1254        0.83905 | 257.20    1.00000 | 0.0051        
[Add] /down_blocks.0/resnets.1/Add_output_0                                                             1.00000 | 0.5324    1.00000 | 0.2509        0.95047 | 257.30    1.00000 | 0.0           
[Reshape] /down_blocks.0/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.5324    1.00000 | 0.1732        0.95047 | 257.30    1.00000 | 0.0           
[exNorm] /down_blocks.0/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.6131    1.00000 | 0.2559        0.86249 | 561.42    0.92157 | 451.65        
[Reshape] /down_blocks.0/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.6131    1.00000 | 0.1752        0.86249 | 561.42    1.00000 | 0.0           
[BatchNormalization] /down_blocks.0/resnets.1/norm2/Add_output_0                                        1.00000 | 0.4056    1.00000 | 0.1731        0.88765 | 350.24    1.00000 | 0.2651        
[exSwish] /down_blocks.0/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1489    1.00000 | 0.0342        0.75220 | 102.42    1.00000 | 0.1681        
[Conv] /down_blocks.0/resnets.1/conv2/Conv_output_0                                                     1.00000 | 0.3245    1.00000 | 0.0952        
[Add] /down_blocks.0/resnets.1/Add_1_output_0                                                           1.00000 | 0.4669    1.00000 | 0.1852        0.90521 | 264.46    1.00000 | 0.1623        
[Reshape] /down_blocks.0/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.4669    1.00000 | 0.1237        0.90521 | 264.46    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.9499    1.00000 | 0.2573        0.79785 | 575.84    0.95729 | 273.75        
[Reshape] /down_blocks.0/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.9499    1.00000 | 0.1778        0.79785 | 575.84    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.3325    1.00000 | 0.1014        0.80902 | 187.15    1.00000 | 0.0026        
[Reshape] /down_blocks.0/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3325    1.00000 | 0.0606        0.80902 | 187.15    1.00000 | 0.0           
[Reshape] /down_blocks.0/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.3325    1.00000 | 0.0606        0.80902 | 187.15    1.00000 | 0.0           
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.7107    1.00000 | 0.1708        0.71964 | 367.24    1.00000 | 0.5312        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.7638    1.00000 | 0.1784        0.81816 | 392.78    1.00000 | 0.0053        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.7638    1.00000 | 0.1241        0.81816 | 392.78    1.00000 | 0.0           
[Transpose] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.7638    1.00000 | 0.1241        0.81816 | 392.78    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 1.4379    1.00000 | 0.2969        0.77874 | 689.91    1.00000 | 0.0086        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 1.4379    1.00000 | 0.2096        0.77874 | 689.91    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 1.3458    1.00000 | 0.2807        0.77497 | 656.63    1.00000 | 0.0099        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 1.3458    1.00000 | 0.1942        0.77497 | 656.63    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 20.878    1.00000 | 6.0511        0.92599 | 10956.    1.00000 | 0.1837        
[exSoftmax13] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0139    1.00000 | 0.0071        0.67083 | 4.2073    1.00000 | 0.0083        
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2886    1.00000 | 0.0343        0.42135 | 280.58    1.00000 | 0.0032        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2886    1.00000 | 0.0336        0.42135 | 280.58    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.2122    1.00000 | 0.0622        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3532    1.00000 | 0.1124        0.76452 | 238.14    1.00000 | 0.1036        
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2842    1.00000 | 0.1003        0.75464 | 184.83    1.00000 | 0.2701        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.2668    1.00000 | 0.0868        0.80654 | 191.89    1.00000 | 0.0030        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.2668    1.00000 | 0.0612        0.80654 | 191.89    1.00000 | 0.0           
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.7016    1.00000 | 0.8623        0.95852 | 779.11    1.00000 | 0.0195        
[exSoftmax13] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0472    1.00000 | 0.0244        0.91552 | 44.084    1.00000 | 0.1272        
[exMatMul] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1873    1.00000 | 0.0378        0.69268 | 164.74    1.00000 | 0.0027        
[Reshape] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1873    1.00000 | 0.0264        0.69268 | 164.74    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0906    1.00000 | 0.0290        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3720    1.00000 | 0.1087        0.78024 | 251.67    1.00000 | 0.0833        
[exNorm] /down_blocks.0/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.4257    1.00000 | 0.1115        0.66173 | 282.12    1.00000 | 0.3715        
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 1.1380    1.00000 | 0.3078        0.79726 | 722.47    1.00000 | 0.0109        
[Split] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.8469    1.00000 | 0.1353        0.77340 | 528.58    1.00000 | 0.0           
[Split] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.7601    1.00000 | 0.1596        0.82030 | 492.50    1.00000 | 0.0           
[exGelu] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.3613    1.00000 | 0.0939        0.73096 | 271.17    1.00000 | 0.3665        
[Mul] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2021    1.00000 | 0.0400        0.55374 | 171.27    1.00000 | 0.0           
[Conv] /down_blocks.0/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2212    1.00000 | 0.0463        
[Add] /down_blocks.0/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4307    1.00000 | 0.1104        0.65472 | 316.60    1.00000 | 0.1188        
[Conv] /down_blocks.0/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.4544    1.00000 | 0.1248        0.80872 | 297.45    1.00000 | 0.0050        
[Reshape] /down_blocks.0/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.4544    1.00000 | 0.0902        0.80872 | 297.45    1.00000 | 0.0           
[Add] /down_blocks.0/attentions.1/Add_output_0                                                          1.00000 | 0.5170    1.00000 | 0.1702        0.73068 | 325.70    1.00000 | 0.0           
[Conv] /down_blocks.0/downsamplers.0/conv/Conv_output_0                                                 1.00000 | 0.4343    1.00000 | 0.1059        0.72326 | 303.78    1.00000 | 0.0043        
[Reshape] /down_blocks.1/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.4343    1.00000 | 0.0751        0.72326 | 303.78    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.6000    1.00000 | 0.1269        0.69280 | 336.40    1.00000 | 0.4371        
[Reshape] /down_blocks.1/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.6000    1.00000 | 0.0894        0.69280 | 336.40    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1525    1.00000 | 0.0310        0.66898 | 83.480    1.00000 | 0.0328        
[exSwish] /down_blocks.1/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0753    1.00000 | 0.0147        0.67044 | 39.893    1.00000 | 0.0586        
[Conv] /down_blocks.1/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.3407    1.00000 | 0.0908        0.75881 | 235.33    1.00000 | 0.0034        
[Add] /down_blocks.1/resnets.0/Add_output_0                                                             1.00000 | 0.4484    1.00000 | 0.2772        0.96180 | 235.70    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.4484    1.00000 | 0.1830        0.96180 | 235.70    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.6673    1.00000 | 0.1876        0.81897 | 364.88    1.00000 | 1.6028        
[Reshape] /down_blocks.1/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.6673    1.00000 | 0.1285        0.81897 | 364.88    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.0/norm2/Add_output_0                                        1.00000 | 0.3225    1.00000 | 0.1040        0.82340 | 220.06    1.00000 | 0.1296        
[exSwish] /down_blocks.1/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.1439    1.00000 | 0.0244        0.65254 | 63.961    1.00000 | 0.1066        
[Conv] /down_blocks.1/resnets.0/conv2/Conv_output_0                                                     1.00000 | 0.4490    1.00000 | 0.0960        
[Conv] /down_blocks.1/resnets.0/conv_shortcut/Conv_output_0                                             1.00000 | 0.2789    1.00000 | 0.1005        0.83989 | 182.57    1.00000 | 0.0032        
[Add] /down_blocks.1/resnets.0/Add_1_output_0                                                           1.00000 | 0.5170    1.00000 | 0.1428        0.85590 | 249.69    1.00000 | 0.1360        
[Reshape] /down_blocks.1/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.5170    1.00000 | 0.0990        0.85590 | 249.69    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.7395    1.00000 | 0.1802        0.83342 | 350.03    1.00000 | 1.5768        
[Reshape] /down_blocks.1/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.7395    1.00000 | 0.1260        0.83342 | 350.03    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.3204    1.00000 | 0.0801        0.81016 | 149.82    1.00000 | 0.0020        
[Reshape] /down_blocks.1/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3204    1.00000 | 0.0509        0.81016 | 149.82    1.00000 | 0.0           
[Reshape] /down_blocks.1/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.3204    1.00000 | 0.0509        0.81016 | 149.82    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.3721    1.00000 | 0.0827        0.74216 | 167.59    1.00000 | 0.2835        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5227    1.00000 | 0.1013        0.75846 | 233.98    1.00000 | 0.0034        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5227    1.00000 | 0.0682        0.75846 | 233.98    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5227    1.00000 | 0.0682        0.75846 | 233.98    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.8630    1.00000 | 0.1835        0.76970 | 389.29    1.00000 | 0.0057        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.8630    1.00000 | 0.1209        0.76970 | 389.29    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.8537    1.00000 | 0.1776        0.77802 | 376.46    1.00000 | 0.0057        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.8537    1.00000 | 0.1198        0.77802 | 376.46    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 4.1064    1.00000 | 0.8169        0.76533 | 2052.4    1.00000 | 0.0267        
[exSoftmax13] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0225    1.00000 | 0.0129        0.71923 | 6.2897    1.00000 | 0.0096        
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.2459    1.00000 | 0.0258        0.47589 | 139.22    1.00000 | 0.0010        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.2459    1.00000 | 0.0232        0.47589 | 139.22    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.2274    1.00000 | 0.0492        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3667    1.00000 | 0.0796        0.74435 | 176.99    1.00000 | 0.0730        
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.3931    1.00000 | 0.0848        0.72279 | 184.50    1.00000 | 0.2999        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.5720    1.00000 | 0.1329        0.78473 | 300.51    1.00000 | 0.0042        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.5720    1.00000 | 0.0912        0.78473 | 300.51    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.6372    1.00000 | 0.6914        0.95071 | 1011.0    1.00000 | 0.0265        
[exSoftmax13] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0216    1.00000 | 0.0106        0.99130 | 9.1238    1.00000 | 0.0820        
[exMatMul] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1006    1.00000 | 0.0146        0.75846 | 36.682    1.00000 | 0.0002        
[Reshape] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1006    1.00000 | 0.0120        0.75846 | 36.682    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0692    1.00000 | 0.0176        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3772    1.00000 | 0.0783        0.77419 | 179.76    1.00000 | 0.0494        
[exNorm] /down_blocks.1/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.2592    1.00000 | 0.0593        0.69841 | 121.42    1.00000 | 0.1930        
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.9946    1.00000 | 0.2295        0.83399 | 427.50    1.00000 | 0.0075        
[Split] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.7002    1.00000 | 0.1013        0.81304 | 302.54    1.00000 | 0.0           
[Split] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.7064    1.00000 | 0.1155        0.85105 | 302.04    1.00000 | 0.0           
[exGelu] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.3505    1.00000 | 0.0744        0.81087 | 148.73    1.00000 | 0.2132        
[Mul] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.2066    1.00000 | 0.0359        0.65391 | 84.719    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.3039    1.00000 | 0.0565        
[Add] /down_blocks.1/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4763    1.00000 | 0.0851        0.64746 | 210.90    1.00000 | 0.0720        
[Conv] /down_blocks.1/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.5509    1.00000 | 0.0980        0.66052 | 240.90    1.00000 | 0.0027        
[Reshape] /down_blocks.1/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.5509    1.00000 | 0.0599        0.66052 | 240.90    1.00000 | 0.0           
[Add] /down_blocks.1/attentions.0/Add_output_0                                                          1.00000 | 0.5941    1.00000 | 0.1484        0.81968 | 253.96    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.5941    1.00000 | 0.0893        0.81968 | 253.96    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.9204    1.00000 | 0.1785        0.79106 | 391.97    1.00000 | 1.6395        
[Reshape] /down_blocks.1/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.9204    1.00000 | 0.1256        0.79106 | 391.97    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.1/norm1/Add_output_0                                        1.00000 | 0.2908    1.00000 | 0.0565        0.81457 | 118.95    1.00000 | 0.0626        
[exSwish] /down_blocks.1/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1375    1.00000 | 0.0234        0.75165 | 55.764    1.00000 | 0.0824        
[Conv] /down_blocks.1/resnets.1/conv1/Conv_output_0                                                     1.00000 | 0.6080    1.00000 | 0.1249        0.83935 | 243.65    1.00000 | 0.0052        
[Add] /down_blocks.1/resnets.1/Add_output_0                                                             1.00000 | 0.6341    1.00000 | 0.1865        0.92061 | 243.71    1.00000 | 0.0           
[Reshape] /down_blocks.1/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.6341    1.00000 | 0.1288        0.92061 | 243.71    1.00000 | 0.0           
[exNorm] /down_blocks.1/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.7121    1.00000 | 0.1882        0.89849 | 273.25    1.00000 | 1.5610        
[Reshape] /down_blocks.1/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.7121    1.00000 | 0.1242        0.89849 | 273.25    1.00000 | 0.0           
[BatchNormalization] /down_blocks.1/resnets.1/norm2/Add_output_0                                        1.00000 | 0.4328    1.00000 | 0.1240        0.93899 | 156.00    1.00000 | 0.1478        
[exSwish] /down_blocks.1/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1721    1.00000 | 0.0287        0.80083 | 62.423    1.00000 | 0.0927        
[Conv] /down_blocks.1/resnets.1/conv2/Conv_output_0                                                     1.00000 | 0.5563    1.00000 | 0.1100        
[Add] /down_blocks.1/resnets.1/Add_1_output_0                                                           1.00000 | 0.7287    1.00000 | 0.1582        0.83447 | 283.96    1.00000 | 0.1404        
[Reshape] /down_blocks.1/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.7287    1.00000 | 0.1042        0.83447 | 283.96    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.9157    1.00000 | 0.1782        0.83268 | 350.77    1.00000 | 1.6986        
[Reshape] /down_blocks.1/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.9157    1.00000 | 0.1253        0.83268 | 350.77    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.4758    1.00000 | 0.1156        0.88115 | 176.03    1.00000 | 0.0026        
[Reshape] /down_blocks.1/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.4758    1.00000 | 0.0785        0.88115 | 176.03    1.00000 | 0.0           
[Reshape] /down_blocks.1/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.4758    1.00000 | 0.0785        0.88115 | 176.03    1.00000 | 0.0           
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.4040    1.00000 | 0.0902        0.80211 | 149.26    1.00000 | 0.3053        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.5413    1.00000 | 0.0994        0.81530 | 195.57    1.00000 | 0.0035        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.5413    1.00000 | 0.0656        0.81530 | 195.57    1.00000 | 0.0           
[Transpose] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.5413    1.00000 | 0.0656        0.81530 | 195.57    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.8447    1.00000 | 0.1794        0.83285 | 314.95    1.00000 | 0.0048        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.8447    1.00000 | 0.1148        0.83285 | 314.95    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.8617    1.00000 | 0.1756        0.83642 | 317.86    1.00000 | 0.0051        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.8617    1.00000 | 0.1155        0.83642 | 317.86    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 3.6148    1.00000 | 0.7174        0.84117 | 1332.9    1.00000 | 0.0180        
[exSoftmax13] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0124    1.00000 | 0.0051        0.79228 | 3.4093    1.00000 | 0.0055        
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.1812    1.00000 | 0.0202        0.63328 | 90.161    1.00000 | 0.0007        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.1812    1.00000 | 0.0188        0.63328 | 90.161    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1849    1.00000 | 0.0419        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.4989    1.00000 | 0.1196        0.90267 | 183.51    1.00000 | 0.1007        
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2878    1.00000 | 0.0780        0.89099 | 104.51    1.00000 | 0.2614        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.3378    1.00000 | 0.0894        0.90373 | 130.22    1.00000 | 0.0030        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.3378    1.00000 | 0.0589        0.90373 | 130.22    1.00000 | 0.0           
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 1.1480    1.00000 | 0.5785        0.98866 | 317.21    1.00000 | 0.0177        
[exSoftmax13] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0247    1.00000 | 0.0114        0.99750 | 4.7586    1.00000 | 0.1060        
[exMatMul] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.1169    1.00000 | 0.0125        0.86980 | 22.317    1.00000 | 0.0002        
[Reshape] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.1169    1.00000 | 0.0089        0.86980 | 22.317    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0820    1.00000 | 0.0150        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.5107    1.00000 | 0.1175        0.91677 | 184.34    1.00000 | 0.0684        
[exNorm] /down_blocks.1/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.2297    1.00000 | 0.0516        0.80470 | 82.305    1.00000 | 0.1862        
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.9067    1.00000 | 0.1935        0.86298 | 317.09    1.00000 | 0.0061        
[Split] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.6647    1.00000 | 0.0838        0.83757 | 231.98    1.00000 | 0.0           
[Split] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.6167    1.00000 | 0.0918        0.88405 | 216.17    1.00000 | 0.0           
[exGelu] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.2845    1.00000 | 0.0521        0.84264 | 100.55    1.00000 | 0.1505        
[Mul] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1519    1.00000 | 0.0280        0.83004 | 49.397    1.00000 | 0.0           
[Conv] /down_blocks.1/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2544    1.00000 | 0.0720        
[Add] /down_blocks.1/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.5643    1.00000 | 0.1209        0.85193 | 191.43    1.00000 | 0.1007        
[Conv] /down_blocks.1/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.8221    1.00000 | 0.1731        0.92923 | 252.63    1.00000 | 0.0046        
[Reshape] /down_blocks.1/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.8221    1.00000 | 0.1285        0.92923 | 252.63    1.00000 | 0.0           
[Add] /down_blocks.1/attentions.1/Add_output_0                                                          1.00000 | 0.6987    1.00000 | 0.2193        0.94496 | 199.71    1.00000 | 0.0           
[Conv] /down_blocks.1/downsamplers.0/conv/Conv_output_0                                                 1.00000 | 0.5466    1.00000 | 0.1098        0.80030 | 206.34    1.00000 | 0.0033        
[Reshape] /down_blocks.2/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.5466    1.00000 | 0.0679        0.80030 | 206.34    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.5160    1.00000 | 0.0884        0.79712 | 193.11    1.00000 | 0.8808        
[Reshape] /down_blocks.2/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.5160    1.00000 | 0.0625        0.79712 | 193.11    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1794    1.00000 | 0.0322        0.82941 | 64.911    1.00000 | 0.0344        
[exSwish] /down_blocks.2/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0916    1.00000 | 0.0192        0.84064 | 34.258    1.00000 | 0.0583        
[Conv] /down_blocks.2/resnets.0/conv1/Conv_output_0                                                     1.00000 | 0.5233    1.00000 | 0.1522        0.93460 | 209.25    1.00000 | 0.0047        
[Add] /down_blocks.2/resnets.0/Add_output_0                                                             1.00000 | 0.6200    1.00000 | 0.2824        0.97701 | 209.47    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.6200    1.00000 | 0.2161        0.97701 | 209.47    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.4713    1.00000 | 0.1292        0.91428 | 177.69    1.00000 | 0.5023        
[Reshape] /down_blocks.2/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.4713    1.00000 | 0.0873        0.91428 | 177.69    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.0/norm2/Add_output_0                                        1.00000 | 0.2327    1.00000 | 0.0781        0.95531 | 80.975    1.00000 | 0.0819        
[exSwish] /down_blocks.2/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.0932    1.00000 | 0.0182        0.85270 | 32.255    1.00000 | 0.1542        
[Split] /down_blocks.2/resnets.0/act_1/Mul_output_0_split                                               1.00000 | 0.0565    1.00000 | 0.0074        0.84847 | 19.287    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.0/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0741    1.00000 | 0.0096        0.85528 | 25.853    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.0/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2558    1.00000 | 0.0541        
[Conv] /down_blocks.2/resnets.0/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.3376    1.00000 | 0.0720        0.88446 | 126.98    1.00000 | 0.0036        
[Add] /down_blocks.2/resnets.0/conv2/Conv_output_0                                                      1.00000 | 0.4733    1.00000 | 0.1102        0.89326 | 174.44    1.00000 | 0.1096        
[Conv] /down_blocks.2/resnets.0/conv_shortcut/Conv_output_0                                             1.00000 | 0.3602    1.00000 | 0.0833        
[Add] /down_blocks.2/resnets.0/Add_1_output_0                                                           1.00000 | 0.5978    1.00000 | 0.1401        0.89210 | 213.68    1.00000 | 0.1209        
[Reshape] /down_blocks.2/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.5978    1.00000 | 0.0959        0.89210 | 213.68    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.0/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.5665    1.00000 | 0.1257        0.89013 | 201.19    1.00000 | 0.4807        
[Reshape] /down_blocks.2/attentions.0/norm/Reshape_1_output_0                                           1.00000 | 0.5665    1.00000 | 0.0892        0.89013 | 201.19    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/proj_in/Conv_output_0                                                1.00000 | 0.2730    1.00000 | 0.0676        0.92327 | 94.807    1.00000 | 0.0016        
[Reshape] /down_blocks.2/attentions.0/Reshape_output_0_rs#1_tp                                          1.00000 | 0.2730    1.00000 | 0.0496        0.92327 | 94.807    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.0/Reshape_output_0_tp-rs                                            1.00000 | 0.2730    1.00000 | 0.0496        0.92327 | 94.807    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.1330    1.00000 | 0.0323        0.85764 | 46.281    1.00000 | 0.1020        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.2545    1.00000 | 0.0492        0.87457 | 87.891    1.00000 | 0.0013        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.2545    1.00000 | 0.0365        0.87457 | 87.891    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.2545    1.00000 | 0.0365        0.87457 | 87.891    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.4349    1.00000 | 0.0921        0.89971 | 152.35    1.00000 | 0.0039        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.4349    1.00000 | 0.0707        0.89971 | 152.35    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.4326    1.00000 | 0.0925        0.90334 | 148.09    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.4326    1.00000 | 0.0704        0.90334 | 148.09    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 0.8449    1.00000 | 0.2512        0.93196 | 288.47    1.00000 | 0.0083        
[exSoftmax13] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0156    1.00000 | 0.0088        0.92797 | 3.4656    1.00000 | 0.0079        
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.1215    1.00000 | 0.0189        0.81164 | 46.025    1.00000 | 0.0004        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.1215    1.00000 | 0.0149        0.81164 | 46.025    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1874    1.00000 | 0.0448        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3186    1.00000 | 0.0734        0.85753 | 114.43    1.00000 | 0.0613        
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.1872    1.00000 | 0.0448        0.84339 | 67.002    1.00000 | 0.1131        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.2927    1.00000 | 0.0720        0.91289 | 118.86    1.00000 | 0.0020        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.2927    1.00000 | 0.0568        0.91289 | 118.86    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 0.6824    1.00000 | 0.4474        0.98919 | 302.08    1.00000 | 0.0154        
[exSoftmax13] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0107    1.00000 | 0.0051        0.99794 | 2.5821    1.00000 | 0.0520        
[exMatMul] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.0668    1.00000 | 0.0098        0.93093 | 15.803    1.00000 | 0.0002        
[Reshape] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.0668    1.00000 | 0.0080        0.93093 | 15.803    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.0725    1.00000 | 0.0137        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3278    1.00000 | 0.0657        0.86323 | 116.24    1.00000 | 0.0369        
[exNorm] /down_blocks.2/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.1321    1.00000 | 0.0281        0.84601 | 46.455    1.00000 | 0.0951        
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.7016    1.00000 | 0.1693        0.90278 | 257.66    1.00000 | 0.0055        
[Split] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.5047    1.00000 | 0.0771        0.88407 | 180.85    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.4874    1.00000 | 0.0932        0.91601 | 183.52    1.00000 | 0.0           
[exGelu] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.2268    1.00000 | 0.0539        0.88827 | 83.311    1.00000 | 0.1506        
[Mul] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1596    1.00000 | 0.0310        0.83192 | 54.729    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.3186    1.00000 | 0.0716        
[Add] /down_blocks.2/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4462    1.00000 | 0.0831        0.82649 | 146.84    1.00000 | 0.0808        
[Conv] /down_blocks.2/attentions.0/Transpose_1_output_0_sw                                              1.00000 | 0.7061    1.00000 | 0.1326        0.86478 | 221.02    1.00000 | 0.0033        
[Reshape] /down_blocks.2/attentions.0/proj_out/Conv_output_0                                            1.00000 | 0.7061    1.00000 | 0.0895        0.86478 | 221.02    1.00000 | 0.0           
[Add] /down_blocks.2/attentions.0/Add_output_0                                                          1.00000 | 0.7312    1.00000 | 0.1683        0.90818 | 224.99    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.7312    1.00000 | 0.1064        0.90818 | 224.99    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.5890    1.00000 | 0.1239        0.90666 | 185.41    1.00000 | 0.5214        
[Reshape] /down_blocks.2/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.5890    1.00000 | 0.0908        0.90666 | 185.41    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.1/norm1/Add_output_0                                        1.00000 | 0.2513    1.00000 | 0.0560        0.93295 | 76.042    1.00000 | 0.0759        
[exSwish] /down_blocks.2/resnets.1/act/Mul_output_0                                                     1.00000 | 0.1114    1.00000 | 0.0190        0.85802 | 35.043    1.00000 | 0.1242        
[Split] /down_blocks.2/resnets.1/act/Mul_output_0_split                                                 1.00000 | 0.0779    1.00000 | 0.0097        0.85822 | 24.685    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.1/act/Mul_output_0_split_o1                                              1.00000 | 0.0796    1.00000 | 0.0096        0.85787 | 24.873    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.1/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.3959    1.00000 | 0.0826        
[Conv] /down_blocks.2/resnets.1/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.4082    1.00000 | 0.0804        0.89597 | 131.88    1.00000 | 0.0035        
[Add] /down_blocks.2/resnets.1/conv1/Conv_output_0                                                      1.00000 | 0.6219    1.00000 | 0.1390        0.91928 | 194.44    1.00000 | 0.1499        
[Add] /down_blocks.2/resnets.1/Add_output_0                                                             1.00000 | 0.6427    1.00000 | 0.1921        0.95755 | 194.39    1.00000 | 0.0           
[Reshape] /down_blocks.2/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.6427    1.00000 | 0.1380        0.95755 | 194.39    1.00000 | 0.0           
[exNorm] /down_blocks.2/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.5003    1.00000 | 0.1352        0.93866 | 150.34    1.00000 | 0.4279        
[Reshape] /down_blocks.2/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.5003    1.00000 | 0.0893        0.93866 | 150.34    1.00000 | 0.0           
[BatchNormalization] /down_blocks.2/resnets.1/norm2/Add_output_0                                        1.00000 | 0.3198    1.00000 | 0.1002        0.96832 | 91.041    1.00000 | 0.1122        
[exSwish] /down_blocks.2/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.1075    1.00000 | 0.0189        0.88218 | 31.023    1.00000 | 0.0957        
[Split] /down_blocks.2/resnets.1/act_1/Mul_output_0_split                                               1.00000 | 0.0769    1.00000 | 0.0101        0.88717 | 21.748    1.00000 | 0.0           
[Split] /down_blocks.2/resnets.1/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0751    1.00000 | 0.0099        0.87693 | 22.123    1.00000 | 0.0           
[Conv] /down_blocks.2/resnets.1/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.3206    1.00000 | 0.0602        
[Conv] /down_blocks.2/resnets.1/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.3009    1.00000 | 0.0593        0.87411 | 92.896    1.00000 | 0.0023        
[Add] /down_blocks.2/resnets.1/conv2/Conv_output_0                                                      1.00000 | 0.4676    1.00000 | 0.0830        0.87405 | 137.80    1.00000 | 0.0852        
[Add] /down_blocks.2/resnets.1/Add_1_output_0                                                           1.00000 | 0.8160    1.00000 | 0.1736        0.91619 | 233.17    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                 1.00000 | 0.8160    1.00000 | 0.1188        0.91619 | 233.17    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.1/norm/InstanceNormalization_output_0-rs                             1.00000 | 0.6050    1.00000 | 0.1252        0.91530 | 176.65    1.00000 | 0.4461        
[Reshape] /down_blocks.2/attentions.1/norm/Reshape_1_output_0                                           1.00000 | 0.6050    1.00000 | 0.0910        0.91530 | 176.65    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/proj_in/Conv_output_0                                                1.00000 | 0.3342    1.00000 | 0.0868        0.94459 | 99.391    1.00000 | 0.0015        
[Reshape] /down_blocks.2/attentions.1/Reshape_output_0_rs#1_tp                                          1.00000 | 0.3342    1.00000 | 0.0620        0.94459 | 99.391    1.00000 | 0.0           
[Reshape] /down_blocks.2/attentions.1/Reshape_output_0_tp-rs                                            1.00000 | 0.3342    1.00000 | 0.0620        0.94459 | 99.391    1.00000 | 0.0           
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                          1.00000 | 0.1360    1.00000 | 0.0315        0.87512 | 39.727    1.00000 | 0.0800        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                   1.00000 | 0.2893    1.00000 | 0.0492        0.87686 | 84.137    1.00000 | 0.0014        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                     1.00000 | 0.2893    1.00000 | 0.0357        0.87686 | 84.137    1.00000 | 0.0           
[Transpose] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                1.00000 | 0.2893    1.00000 | 0.0357        0.87686 | 84.137    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                   1.00000 | 0.3801    1.00000 | 0.0750        0.90521 | 110.70    1.00000 | 0.0024        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                1.00000 | 0.3801    1.00000 | 0.0534        0.90521 | 110.70    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                   1.00000 | 0.3781    1.00000 | 0.0818        0.91723 | 108.15    1.00000 | 0.0023        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                       1.00000 | 0.3781    1.00000 | 0.0558        0.91723 | 108.15    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                1.00000 | 0.5152    1.00000 | 0.1240        0.93713 | 134.71    1.00000 | 0.0031        
[exSoftmax13] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs             1.00000 | 0.0057    1.00000 | 0.0017        0.95594 | 1.1868    1.00000 | 0.0026        
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                  1.00000 | 0.0987    1.00000 | 0.0144        0.86389 | 34.435    1.00000 | 0.0005        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw               1.00000 | 0.0987    1.00000 | 0.0130        0.86389 | 34.435    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                  1.00000 | 0.1637    1.00000 | 0.0430        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_output_0-rs                                  1.00000 | 0.3641    1.00000 | 0.0885        0.91076 | 107.63    1.00000 | 0.0669        
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                    1.00000 | 0.2249    1.00000 | 0.0500        0.87548 | 69.282    1.00000 | 0.1394        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                   1.00000 | 0.3507    1.00000 | 0.0839        0.92832 | 110.15    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                       1.00000 | 0.3507    1.00000 | 0.0601        0.92832 | 110.15    1.00000 | 0.0           
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                1.00000 | 0.5503    1.00000 | 0.4629        0.99659 | 136.41    1.00000 | 0.0103        
[exSoftmax13] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs             1.00000 | 0.0133    1.00000 | 0.0050        0.99556 | 3.1225    1.00000 | 0.0442        
[exMatMul] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                  1.00000 | 0.0962    1.00000 | 0.0150        0.94576 | 21.637    1.00000 | 0.0004        
[Reshape] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw               1.00000 | 0.0962    1.00000 | 0.0132        0.94576 | 21.637    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                  1.00000 | 0.1106    1.00000 | 0.0243        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                1.00000 | 0.3808    1.00000 | 0.0771        0.91084 | 111.27    1.00000 | 0.0473        
[exNorm] /down_blocks.2/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                    1.00000 | 0.1618    1.00000 | 0.0388        0.87110 | 48.969    1.00000 | 0.0963        
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw          1.00000 | 0.8751    1.00000 | 0.2230        0.95011 | 260.00    1.00000 | 0.0071        
[Split] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph       1.00000 | 0.5923    1.00000 | 0.0886        0.91374 | 178.79    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph     1.00000 | 0.6442    1.00000 | 0.1467        0.96392 | 188.77    1.00000 | 0.0           
[exGelu] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph      1.00000 | 0.1993    1.00000 | 0.0437        0.91913 | 60.008    1.00000 | 0.1860        
[Mul] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                   1.00000 | 0.1483    1.00000 | 0.0287        0.83670 | 45.030    1.00000 | 0.0           
[Conv] /down_blocks.2/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                        1.00000 | 0.2626    1.00000 | 0.0520        
[Add] /down_blocks.2/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                          1.00000 | 0.4581    1.00000 | 0.0826        0.85304 | 131.64    1.00000 | 0.0702        
[Conv] /down_blocks.2/attentions.1/Transpose_1_output_0_sw                                              1.00000 | 0.6738    1.00000 | 0.1230        0.87419 | 193.59    1.00000 | 0.0031        
[Reshape] /down_blocks.2/attentions.1/proj_out/Conv_output_0                                            1.00000 | 0.6738    1.00000 | 0.0798        0.87419 | 193.59    1.00000 | 0.0           
[Add] /down_blocks.2/attentions.1/Add_output_0                                                          1.00000 | 0.7400    1.00000 | 0.1940        0.92905 | 188.25    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/Add_output_0_split                                                  1.00000 | 0.5295    1.00000 | 0.0731        0.92884 | 133.61    1.00000 | 0.0           
[Split] /down_blocks.2/attentions.1/Add_output_0_split_o1                                               1.00000 | 0.5168    1.00000 | 0.0709        0.92927 | 132.61    1.00000 | 0.0           
[Conv] /down_blocks.2/downsamplers.0/conv/Conv_output_0_tile0_conv                                      1.00000 | 0.4451    1.00000 | 0.0883        
[Conv] /down_blocks.2/downsamplers.0/conv/Conv_output_0_tile1_conv                                      1.00000 | 0.4331    1.00000 | 0.0871        0.89205 | 128.66    1.00000 | 0.0031        
[Add] /down_blocks.2/downsamplers.0/conv/Conv_output_0                                                  1.00000 | 0.6325    1.00000 | 0.1185        0.88492 | 188.07    1.00000 | 0.1220        
[Reshape] /down_blocks.3/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6325    1.00000 | 0.0807        0.88492 | 188.07    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.0/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3527    1.00000 | 0.0630        0.88368 | 103.49    1.00000 | 0.2748        
[Reshape] /down_blocks.3/resnets.0/norm1/Reshape_1_output_0                                             1.00000 | 0.3527    1.00000 | 0.0444        0.88368 | 103.49    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.0/norm1/Add_output_0                                        1.00000 | 0.1418    1.00000 | 0.0262        0.89823 | 41.274    1.00000 | 0.0299        
[exSwish] /down_blocks.3/resnets.0/act/Mul_output_0                                                     1.00000 | 0.0713    1.00000 | 0.0126        0.87967 | 20.538    1.00000 | 0.0361        
[Split] /down_blocks.3/resnets.0/act/Mul_output_0_split                                                 1.00000 | 0.0508    1.00000 | 0.0061        0.87555 | 14.566    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.0/act/Mul_output_0_split_o1                                              1.00000 | 0.0499    1.00000 | 0.0062        0.88357 | 14.478    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.1920    1.00000 | 0.0377        
[Conv] /down_blocks.3/resnets.0/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.1941    1.00000 | 0.0399        0.91631 | 59.608    1.00000 | 0.0019        
[Add] /down_blocks.3/resnets.0/conv1/Conv_output_0                                                      1.00000 | 0.2997    1.00000 | 0.0669        0.92233 | 93.302    1.00000 | 0.0733        
[Add] /down_blocks.3/resnets.0/Add_output_0                                                             1.00000 | 0.3105    1.00000 | 0.0898        0.95398 | 93.287    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.0/norm2/Reshape_output_0_rs                                            1.00000 | 0.3105    1.00000 | 0.0628        0.95398 | 93.287    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.2466    1.00000 | 0.0657        0.94500 | 71.169    1.00000 | 0.2475        
[Reshape] /down_blocks.3/resnets.0/norm2/Reshape_1_output_0                                             1.00000 | 0.2466    1.00000 | 0.0448        0.94500 | 71.169    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.0/norm2/Add_output_0                                        1.00000 | 0.1831    1.00000 | 0.0513        0.95993 | 52.109    1.00000 | 0.0560        
[exSwish] /down_blocks.3/resnets.0/act_1/Mul_output_0                                                   1.00000 | 0.0823    1.00000 | 0.0164        0.90543 | 22.832    1.00000 | 0.0404        
[Split] /down_blocks.3/resnets.0/act_1/Mul_output_0_split                                               1.00000 | 0.0592    1.00000 | 0.0081        0.90256 | 16.383    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.0/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0571    1.00000 | 0.0079        0.90833 | 15.902    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.0/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2435    1.00000 | 0.0505        
[Conv] /down_blocks.3/resnets.0/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.2313    1.00000 | 0.0500        0.91744 | 67.365    1.00000 | 0.0029        
[Add] /down_blocks.3/resnets.0/conv2/Conv_output_0                                                      1.00000 | 0.3622    1.00000 | 0.0738        0.90453 | 105.13    1.00000 | 0.0742        
[Add] /down_blocks.3/resnets.0/Add_1_output_0                                                           1.00000 | 0.6532    1.00000 | 0.1310        0.89878 | 188.98    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6532    1.00000 | 0.0865        0.89878 | 188.98    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.1/norm1/InstanceNormalization_output_0-rs                               1.00000 | 0.3403    1.00000 | 0.0629        0.89719 | 97.295    1.00000 | 0.2710        
[Reshape] /down_blocks.3/resnets.1/norm1/Reshape_1_output_0                                             1.00000 | 0.3403    1.00000 | 0.0446        0.89719 | 97.295    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.1/norm1/Add_output_0                                        1.00000 | 0.1655    1.00000 | 0.0328        0.92300 | 46.378    1.00000 | 0.0376        
[exSwish] /down_blocks.3/resnets.1/act/Mul_output_0                                                     1.00000 | 0.0766    1.00000 | 0.0136        0.89530 | 21.007    1.00000 | 0.0377        
[Split] /down_blocks.3/resnets.1/act/Mul_output_0_split                                                 1.00000 | 0.0546    1.00000 | 0.0067        0.89269 | 14.943    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.1/act/Mul_output_0_split_o1                                              1.00000 | 0.0536    1.00000 | 0.0068        0.89786 | 14.765    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/conv1/Conv_output_0_tile0_conv                                          1.00000 | 0.1956    1.00000 | 0.0414        
[Conv] /down_blocks.3/resnets.1/conv1/Conv_output_0_tile1_conv                                          1.00000 | 0.1951    1.00000 | 0.0417        0.93178 | 55.024    1.00000 | 0.0014        
[Add] /down_blocks.3/resnets.1/conv1/Conv_output_0                                                      1.00000 | 0.2966    1.00000 | 0.0713        0.93990 | 86.909    1.00000 | 0.0782        
[Add] /down_blocks.3/resnets.1/Add_output_0                                                             1.00000 | 0.3101    1.00000 | 0.0900        0.96200 | 86.881    1.00000 | 0.0           
[Reshape] /down_blocks.3/resnets.1/norm2/Reshape_output_0_rs                                            1.00000 | 0.3101    1.00000 | 0.0644        0.96200 | 86.881    1.00000 | 0.0           
[exNorm] /down_blocks.3/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                       1.00000 | 0.2367    1.00000 | 0.0664        0.95463 | 64.647    1.00000 | 0.1932        
[Reshape] /down_blocks.3/resnets.1/norm2/Reshape_1_output_0                                             1.00000 | 0.2367    1.00000 | 0.0448        0.95463 | 64.647    1.00000 | 0.0           
[BatchNormalization] /down_blocks.3/resnets.1/norm2/Add_output_0                                        1.00000 | 0.1994    1.00000 | 0.0581        0.96858 | 53.625    1.00000 | 0.0630        
[exSwish] /down_blocks.3/resnets.1/act_1/Mul_output_0                                                   1.00000 | 0.0778    1.00000 | 0.0156        0.91545 | 20.549    1.00000 | 0.0381        
[Split] /down_blocks.3/resnets.1/act_1/Mul_output_0_split                                               1.00000 | 0.0547    1.00000 | 0.0075        0.90907 | 14.765    1.00000 | 0.0           
[Split] /down_blocks.3/resnets.1/act_1/Mul_output_0_split_o1                                            1.00000 | 0.0554    1.00000 | 0.0078        0.92135 | 14.292    1.00000 | 0.0           
[Conv] /down_blocks.3/resnets.1/conv2/Conv_output_0_tile0_conv                                          1.00000 | 0.2067    1.00000 | 0.0452        
[Conv] /down_blocks.3/resnets.1/conv2/Conv_output_0_tile1_conv                                          1.00000 | 0.2122    1.00000 | 0.0471        0.92565 | 57.850    1.00000 | 0.0019        
[Add] /down_blocks.3/resnets.1/conv2/Conv_output_0                                                      1.00000 | 0.3164    1.00000 | 0.0646        0.91921 | 85.861    1.00000 | 0.0653        
[Add] /down_blocks.3/resnets.1/Add_1_output_0                                                           1.00000 | 0.7013    1.00000 | 0.1410        0.90927 | 198.24    1.00000 | 0.0           
[Reshape] /mid_block/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                       1.00000 | 0.7013    1.00000 | 0.0954        0.90927 | 198.24    1.00000 | 0.0           
[exNorm] /mid_block/resnets.0/norm1/InstanceNormalization_output_0-rs                                   1.00000 | 0.3311    1.00000 | 0.0629        0.90766 | 92.212    1.00000 | 0.2686        
[Reshape] /mid_block/resnets.0/norm1/Reshape_1_output_0                                                 1.00000 | 0.3311    1.00000 | 0.0445        0.90766 | 92.212    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.0/norm1/Add_output_0                                            1.00000 | 0.1776    1.00000 | 0.0373        0.93717 | 48.500    1.00000 | 0.0422        
[exSwish] /mid_block/resnets.0/act/Mul_output_0                                                         1.00000 | 0.0778    1.00000 | 0.0143        0.90618 | 20.885    1.00000 | 0.0385        
[Split] /mid_block/resnets.0/act/Mul_output_0_split                                                     1.00000 | 0.0560    1.00000 | 0.0072        0.90465 | 14.989    1.00000 | 0.0           
[Split] /mid_block/resnets.0/act/Mul_output_0_split_o1                                                  1.00000 | 0.0539    1.00000 | 0.0071        0.90777 | 14.544    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/conv1/Conv_output_0_tile0_conv                                              1.00000 | 0.1958    1.00000 | 0.0443        
[Conv] /mid_block/resnets.0/conv1/Conv_output_0_tile1_conv                                              1.00000 | 0.1869    1.00000 | 0.0434        0.94387 | 52.687    1.00000 | 0.0022        
[Add] /mid_block/resnets.0/conv1/Conv_output_0                                                          1.00000 | 0.2926    1.00000 | 0.0769        0.95469 | 83.466    1.00000 | 0.0870        
[Add] /mid_block/resnets.0/Add_output_0                                                                 1.00000 | 0.3099    1.00000 | 0.1012        0.97290 | 83.426    1.00000 | 0.0           
[Reshape] /mid_block/resnets.0/norm2/Reshape_output_0_rs                                                1.00000 | 0.3099    1.00000 | 0.0713        0.97290 | 83.426    1.00000 | 0.0           
[exNorm] /mid_block/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                           1.00000 | 0.2196    1.00000 | 0.0672        0.96625 | 55.745    1.00000 | 0.2945        
[Reshape] /mid_block/resnets.0/norm2/Reshape_1_output_0                                                 1.00000 | 0.2196    1.00000 | 0.0449        0.96625 | 55.745    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.0/norm2/Add_output_0                                            1.00000 | 0.1915    1.00000 | 0.0592        0.97608 | 47.837    1.00000 | 0.0624        
[exSwish] /mid_block/resnets.0/act_1/Mul_output_0                                                       1.00000 | 0.0753    1.00000 | 0.0161        0.94762 | 17.592    1.00000 | 0.0405        
[Split] /mid_block/resnets.0/act_1/Mul_output_0_split                                                   1.00000 | 0.0552    1.00000 | 0.0086        0.95012 | 12.846    1.00000 | 0.0           
[Split] /mid_block/resnets.0/act_1/Mul_output_0_split_o1                                                1.00000 | 0.0511    1.00000 | 0.0078        0.94449 | 12.019    1.00000 | 0.0           
[Conv] /mid_block/resnets.0/conv2/Conv_output_0_tile0_conv                                              1.00000 | 0.2242    1.00000 | 0.0602        
[Conv] /mid_block/resnets.0/conv2/Conv_output_0_tile1_conv                                              1.00000 | 0.2043    1.00000 | 0.0526        0.96346 | 51.624    1.00000 | 0.0021        
[Add] /mid_block/resnets.0/conv2/Conv_output_0                                                          1.00000 | 0.3299    1.00000 | 0.0960        0.97047 | 83.650    1.00000 | 0.1088        
[Add] /mid_block/resnets.0/Add_1_output_0                                                               1.00000 | 0.7821    1.00000 | 0.1833        0.94131 | 214.94    1.00000 | 0.0           
[Reshape] /mid_block/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.7821    1.00000 | 0.1289        0.94131 | 214.94    1.00000 | 0.0           
[exNorm] /mid_block/attentions.0/norm/InstanceNormalization_output_0-rs                                 1.00000 | 0.2791    1.00000 | 0.0632        0.93970 | 74.525    1.00000 | 0.2465        
[Reshape] /mid_block/attentions.0/norm/Reshape_1_output_0                                               1.00000 | 0.2791    1.00000 | 0.0440        0.93970 | 74.525    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/proj_in/Conv_output_0                                                    1.00000 | 0.1854    1.00000 | 0.0548        0.96681 | 51.376    1.00000 | 0.0015        
[Reshape] /mid_block/attentions.0/Reshape_output_0_rs#1_tp                                              1.00000 | 0.1854    1.00000 | 0.0428        0.96681 | 51.376    1.00000 | 0.0           
[Reshape] /mid_block/attentions.0/Reshape_output_0_tp-rs                                                1.00000 | 0.1854    1.00000 | 0.0428        0.96681 | 51.376    1.00000 | 0.0           
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                              1.00000 | 0.0564    1.00000 | 0.0159        0.93523 | 14.801    1.00000 | 0.0460        
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                       1.00000 | 0.1310    1.00000 | 0.0261        0.93214 | 35.626    1.00000 | 0.0007        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                         1.00000 | 0.1310    1.00000 | 0.0203        0.93214 | 35.626    1.00000 | 0.0           
[Transpose] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                    1.00000 | 0.1310    1.00000 | 0.0203        0.93214 | 35.626    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                       1.00000 | 0.1190    1.00000 | 0.0286        0.95801 | 31.274    1.00000 | 0.0010        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                    1.00000 | 0.1190    1.00000 | 0.0224        0.95801 | 31.274    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                       1.00000 | 0.1135    1.00000 | 0.0341        0.96763 | 29.715    1.00000 | 0.0008        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                           1.00000 | 0.1135    1.00000 | 0.0244        0.96763 | 29.715    1.00000 | 0.0           
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                    1.00000 | 0.0906    1.00000 | 0.0288        0.97547 | 20.854    1.00000 | 0.0002        
[exSoftmax13] /mid_block/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs                 1.00000 | 0.0032    1.00000 | 0.0012        0.98631 | 0.6416    1.00000 | 0.0020        
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                      1.00000 | 0.0564    1.00000 | 0.0128        0.95475 | 15.621    1.00000 | 0.0002        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                   1.00000 | 0.0564    1.00000 | 0.0109        0.95475 | 15.621    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                      1.00000 | 0.1067    1.00000 | 0.0387        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_output_0-rs                                      1.00000 | 0.2136    1.00000 | 0.0663        0.94508 | 57.871    1.00000 | 0.0527        
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                        1.00000 | 0.1038    1.00000 | 0.0280        0.94131 | 27.337    1.00000 | 0.0865        
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                       1.00000 | 0.1574    1.00000 | 0.0462        0.97413 | 42.069    1.00000 | 0.0020        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                           1.00000 | 0.1574    1.00000 | 0.0379        0.97413 | 42.069    1.00000 | 0.0           
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                    1.00000 | 0.2734    1.00000 | 0.2392        0.99852 | 43.495    1.00000 | 0.0002        
[exSoftmax13] /mid_block/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs                 1.00000 | 0.0047    1.00000 | 0.0026        0.99673 | 1.0782    1.00000 | 0.0226        
[exMatMul] /mid_block/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                      1.00000 | 0.0487    1.00000 | 0.0107        0.98225 | 9.0138    1.00000 | 0.0001        
[Reshape] /mid_block/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                   1.00000 | 0.0487    1.00000 | 0.0096        0.98225 | 9.0138    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                      1.00000 | 0.0665    1.00000 | 0.0203        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                    1.00000 | 0.2263    1.00000 | 0.0541        0.94684 | 58.331    1.00000 | 0.0405        
[exNorm] /mid_block/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                        1.00000 | 0.1393    1.00000 | 0.0408        0.94573 | 35.098    1.00000 | 0.1043        
[Conv] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw              1.00000 | 0.7367    1.00000 | 0.2367        0.98045 | 182.74    1.00000 | 0.0092        
[Split] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph           1.00000 | 0.5232    1.00000 | 0.1064        0.96667 | 132.02    1.00000 | 0.0           
[Split] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph         1.00000 | 0.5186    1.00000 | 0.1588        0.98654 | 126.35    1.00000 | 0.0           
[exGelu] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph          1.00000 | 0.1469    1.00000 | 0.0330        0.94026 | 35.965    0.99999 | 0.4142        
[Mul] /mid_block/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                       1.00000 | 0.2088    1.00000 | 0.0461        0.93045 | 50.783    1.00000 | 0.0           
[Conv] /mid_block/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                            1.00000 | 0.3064    1.00000 | 0.0670        
[Add] /mid_block/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                              1.00000 | 0.3872    1.00000 | 0.0798        0.93240 | 95.696    1.00000 | 0.0820        
[Conv] /mid_block/attentions.0/Transpose_1_output_0_sw                                                  1.00000 | 0.7223    1.00000 | 0.1495        0.93386 | 179.26    1.00000 | 0.0042        
[Reshape] /mid_block/attentions.0/proj_out/Conv_output_0                                                1.00000 | 0.7223    1.00000 | 0.1017        0.93386 | 179.26    1.00000 | 0.0           
[Add] /mid_block/attentions.0/Add_output_0                                                              1.00000 | 0.9190    1.00000 | 0.2130        0.93682 | 228.44    1.00000 | 0.0           
[Reshape] /mid_block/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                       1.00000 | 0.9190    1.00000 | 0.1297        0.93682 | 228.44    1.00000 | 0.0           
[exNorm] /mid_block/resnets.1/norm1/InstanceNormalization_output_0-rs                                   1.00000 | 0.3217    1.00000 | 0.0631        0.93341 | 78.315    1.00000 | 0.2395        
[Reshape] /mid_block/resnets.1/norm1/Reshape_1_output_0                                                 1.00000 | 0.3217    1.00000 | 0.0444        0.93341 | 78.315    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.1/norm1/Add_output_0                                            1.00000 | 0.1834    1.00000 | 0.0380        0.94989 | 44.065    1.00000 | 0.0438        
[exSwish] /mid_block/resnets.1/act/Mul_output_0                                                         1.00000 | 0.0820    1.00000 | 0.0151        0.92374 | 19.595    1.00000 | 0.0399        
[Split] /mid_block/resnets.1/act/Mul_output_0_split                                                     1.00000 | 0.0591    1.00000 | 0.0076        0.91954 | 14.308    1.00000 | 0.0           
[Split] /mid_block/resnets.1/act/Mul_output_0_split_o1                                                  1.00000 | 0.0568    1.00000 | 0.0077        0.92805 | 13.388    1.00000 | 0.0           
[Conv] /mid_block/resnets.1/conv1/Conv_output_0_tile0_conv                                              1.00000 | 0.2047    1.00000 | 0.0475        
[Conv] /mid_block/resnets.1/conv1/Conv_output_0_tile1_conv                                              1.00000 | 0.1923    1.00000 | 0.0498        0.96869 | 49.396    1.00000 | 0.0016        
[Add] /mid_block/resnets.1/conv1/Conv_output_0                                                          1.00000 | 0.3022    1.00000 | 0.0903        0.97225 | 75.740    1.00000 | 0.0989        
[Add] /mid_block/resnets.1/Add_output_0                                                                 1.00000 | 0.3181    1.00000 | 0.1058        0.98011 | 75.712    1.00000 | 0.0           
[Reshape] /mid_block/resnets.1/norm2/Reshape_output_0_rs                                                1.00000 | 0.3181    1.00000 | 0.0758        0.98011 | 75.712    1.00000 | 0.0           
[exNorm] /mid_block/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                           1.00000 | 0.2213    1.00000 | 0.0680        0.97177 | 50.990    1.00000 | 0.2868        
[Reshape] /mid_block/resnets.1/norm2/Reshape_1_output_0                                                 1.00000 | 0.2213    1.00000 | 0.0449        0.97177 | 50.990    1.00000 | 0.0           
[BatchNormalization] /mid_block/resnets.1/norm2/Add_output_0                                            1.00000 | 0.2028    1.00000 | 0.0608        0.97819 | 46.189    1.00000 | 0.0643        
[exSwish] /mid_block/resnets.1/act_1/Mul_output_0                                                       1.00000 | 0.0857    1.00000 | 0.0178        0.95304 | 17.673    1.00000 | 0.0423        
[Split] /mid_block/resnets.1/act_1/Mul_output_0_split                                                   1.00000 | 0.0586    1.00000 | 0.0084        0.95286 | 11.958    1.00000 | 0.0           
[Split] /mid_block/resnets.1/act_1/Mul_output_0_split_o1                                                1.00000 | 0.0625    1.00000 | 0.0091        0.95324 | 13.013    1.00000 | 0.0           
[Conv] /mid_block/resnets.1/conv2/Conv_output_0_tile0_conv                                              1.00000 | 0.2479    1.00000 | 0.0623        
[Conv] /mid_block/resnets.1/conv2/Conv_output_0_tile1_conv                                              1.00000 | 0.2580    1.00000 | 0.0632        0.96768 | 58.068    1.00000 | 0.0027        
[Add] /mid_block/resnets.1/conv2/Conv_output_0                                                          1.00000 | 0.3863    1.00000 | 0.1094        0.97407 | 84.350    1.00000 | 0.1143        
[Add] /mid_block/resnets.1/Add_1_output_0                                                               1.00000 | 0.9692    1.00000 | 0.2001        0.92751 | 233.94    1.00000 | 0.0           
[Concat] /up_blocks.0/Concat_output_0                                                                   1.00000 | 1.1964    1.00000 | 0.1581        0.92084 | 306.64    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.1964    1.00000 | 0.1581        0.92084 | 306.64    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4781    1.00000 | 0.0893        0.91744 | 123.19    1.00000 | 0.8661        
[Reshape] /up_blocks.0/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 0.4781    1.00000 | 0.0628        0.91744 | 123.19    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.0/norm1/Add_output_0                                          1.00000 | 0.2397    1.00000 | 0.0463        0.93721 | 58.426    1.00000 | 0.0562        
[exSwish] /up_blocks.0/resnets.0/act/Mul_output_0                                                       1.00000 | 0.1103    1.00000 | 0.0191        0.91615 | 26.395    1.00000 | 0.0516        
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.0964    1.00000 | 0.0117        0.91772 | 22.212    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.0525    1.00000 | 0.0070        0.91215 | 13.968    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act/Mul_output_0_split_o2                                                1.00000 | 0.0107    1.00000 | 0.0014        0.91171 | 2.8643    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.3318    1.00000 | 0.0696        
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1311    1.00000 | 0.0407        0.97777 | 36.412    1.00000 | 0.0021        
[Add] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.3682    1.00000 | 0.0915        0.95336 | 90.590    1.00000 | 0.0986        
[Conv] /up_blocks.0/resnets.0/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0231    1.00000 | 0.0053        
[Add] /up_blocks.0/resnets.0/conv1/Conv_output_0                                                        1.00000 | 0.3756    1.00000 | 0.0865        0.95390 | 90.829    1.00000 | 0.0277        
[Add] /up_blocks.0/resnets.0/Add_output_0                                                               1.00000 | 0.3850    1.00000 | 0.0943        0.96077 | 90.827    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.3850    1.00000 | 0.0666        0.96077 | 90.827    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2750    1.00000 | 0.0649        0.95643 | 63.338    1.00000 | 0.2624        
[Reshape] /up_blocks.0/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.2750    1.00000 | 0.0443        0.95643 | 63.338    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.0/norm2/Add_output_0                                          1.00000 | 0.2847    1.00000 | 0.0672        0.96666 | 64.400    1.00000 | 0.0750        
[exSwish] /up_blocks.0/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.1296    1.00000 | 0.0246        0.94005 | 27.638    1.00000 | 0.0628        
[Split] /up_blocks.0/resnets.0/act_1/Mul_output_0_split                                                 1.00000 | 0.0956    1.00000 | 0.0117        0.93618 | 20.251    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.0/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0874    1.00000 | 0.0121        0.94407 | 18.808    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.0/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.4434    1.00000 | 0.0910        
[Conv] /up_blocks.0/resnets.0/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.4026    1.00000 | 0.0928        0.95789 | 94.808    1.00000 | 0.0022        
[Add] /up_blocks.0/resnets.0/conv2/Conv_output_0                                                        1.00000 | 0.6422    1.00000 | 0.1498        0.95883 | 147.74    1.00000 | 0.1576        
[Conv] /up_blocks.0/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.6349    1.00000 | 0.1578        
[Add] /up_blocks.0/resnets.0/Add_1_output_0                                                             1.00000 | 0.9070    1.00000 | 0.1948        0.94461 | 207.86    1.00000 | 0.1829        
[Concat] /up_blocks.0/Concat_1_output_0                                                                 1.00000 | 1.1177    1.00000 | 0.1554        0.93033 | 280.93    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.1177    1.00000 | 0.1554        0.93033 | 280.93    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4648    1.00000 | 0.0894        0.92100 | 120.52    1.00000 | 0.7978        
[Reshape] /up_blocks.0/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 0.4648    1.00000 | 0.0629        0.92100 | 120.52    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.1/norm1/Add_output_0                                          1.00000 | 0.2428    1.00000 | 0.0507        0.95147 | 57.815    1.00000 | 0.0583        
[exSwish] /up_blocks.0/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1103    1.00000 | 0.0200        0.92852 | 25.725    1.00000 | 0.0534        
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.0934    1.00000 | 0.0123        0.93854 | 20.219    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0574    1.00000 | 0.0075        0.90326 | 15.549    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act/Mul_output_0_split_o2                                                1.00000 | 0.0116    1.00000 | 0.0015        0.89857 | 3.3407    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.3916    1.00000 | 0.0860        
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1595    1.00000 | 0.0468        0.97275 | 46.316    1.00000 | 0.0026        
[Add] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.4326    1.00000 | 0.1171        0.96703 | 102.73    1.00000 | 0.1319        
[Conv] /up_blocks.0/resnets.1/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0272    1.00000 | 0.0065        
[Add] /up_blocks.0/resnets.1/conv1/Conv_output_0                                                        1.00000 | 0.4424    1.00000 | 0.1154        0.96688 | 103.27    1.00000 | 0.0330        
[Add] /up_blocks.0/resnets.1/Add_output_0                                                               1.00000 | 0.4551    1.00000 | 0.1233        0.96964 | 103.25    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.4551    1.00000 | 0.0855        0.96964 | 103.25    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2484    1.00000 | 0.0637        0.96752 | 54.691    1.00000 | 0.2593        
[Reshape] /up_blocks.0/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.2484    1.00000 | 0.0444        0.96752 | 54.691    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.1/norm2/Add_output_0                                          1.00000 | 0.2473    1.00000 | 0.0661        0.97618 | 52.917    1.00000 | 0.0726        
[exSwish] /up_blocks.0/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.1064    1.00000 | 0.0215        0.95504 | 21.533    1.00000 | 0.0564        
[Split] /up_blocks.0/resnets.1/act_1/Mul_output_0_split                                                 1.00000 | 0.0775    1.00000 | 0.0111        0.95281 | 15.577    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.1/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0729    1.00000 | 0.0108        0.95727 | 14.868    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.1/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.3446    1.00000 | 0.0796        
[Conv] /up_blocks.0/resnets.1/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.3415    1.00000 | 0.0828        0.96790 | 74.237    1.00000 | 0.0029        
[Add] /up_blocks.0/resnets.1/conv2/Conv_output_0                                                        1.00000 | 0.5128    1.00000 | 0.1254        0.96674 | 109.67    1.00000 | 0.1293        
[Conv] /up_blocks.0/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 0.4570    1.00000 | 0.1102        
[Add] /up_blocks.0/resnets.1/Add_1_output_0                                                             1.00000 | 0.6831    1.00000 | 0.1532        0.94876 | 150.96    1.00000 | 0.1387        
[Concat] /up_blocks.0/Concat_2_output_0                                                                 1.00000 | 0.9309    1.00000 | 0.1268        0.92267 | 241.17    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.9309    1.00000 | 0.1268        0.92267 | 241.17    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.4757    1.00000 | 0.0902        0.91599 | 124.29    1.00000 | 0.7627        
[Reshape] /up_blocks.0/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.4757    1.00000 | 0.0630        0.91599 | 124.29    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2468    1.00000 | 0.0506        0.95316 | 56.700    1.00000 | 0.0586        
[exSwish] /up_blocks.0/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1160    1.00000 | 0.0219        0.93467 | 26.179    1.00000 | 0.0562        
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split                                                   1.00000 | 0.1024    1.00000 | 0.0136        0.94554 | 21.188    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split_o1                                                1.00000 | 0.0531    1.00000 | 0.0068        0.89564 | 14.995    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act/Mul_output_0_split_o2                                                1.00000 | 0.0113    1.00000 | 0.0014        0.87953 | 3.3952    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.4646    1.00000 | 0.1197        
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1644    1.00000 | 0.0520        0.97762 | 47.796    1.00000 | 0.0023        
[Add] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.5092    1.00000 | 0.1695        0.98205 | 113.70    1.00000 | 0.1902        
[Conv] /up_blocks.0/resnets.2/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0277    1.00000 | 0.0061        
[Add] /up_blocks.0/resnets.2/conv1/Conv_output_0                                                        1.00000 | 0.5254    1.00000 | 0.1749        0.98205 | 114.20    1.00000 | 0.0383        
[Add] /up_blocks.0/resnets.2/Add_output_0                                                               1.00000 | 0.5385    1.00000 | 0.1728        0.98102 | 114.19    1.00000 | 0.0           
[Reshape] /up_blocks.0/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.5385    1.00000 | 0.1183        0.98102 | 114.19    1.00000 | 0.0           
[exNorm] /up_blocks.0/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.2176    1.00000 | 0.0651        0.97892 | 44.063    1.00000 | 0.2606        
[Reshape] /up_blocks.0/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.2176    1.00000 | 0.0447        0.97892 | 44.063    1.00000 | 0.0           
[BatchNormalization] /up_blocks.0/resnets.2/norm2/Add_output_0                                          1.00000 | 0.1955    1.00000 | 0.0580        0.98330 | 38.510    1.00000 | 0.0620        
[exSwish] /up_blocks.0/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.0732    1.00000 | 0.0158        0.96074 | 14.963    1.00000 | 0.0712        
[Split] /up_blocks.0/resnets.2/act_1/Mul_output_0_split                                                 1.00000 | 0.0518    1.00000 | 0.0081        0.96087 | 10.395    1.00000 | 0.0           
[Split] /up_blocks.0/resnets.2/act_1/Mul_output_0_split_o1                                              1.00000 | 0.0517    1.00000 | 0.0082        0.96071 | 10.763    1.00000 | 0.0           
[Conv] /up_blocks.0/resnets.2/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.1911    1.00000 | 0.0478        
[Conv] /up_blocks.0/resnets.2/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.1926    1.00000 | 0.0483        0.95998 | 40.531    1.00000 | 0.0016        
[Add] /up_blocks.0/resnets.2/conv2/Conv_output_0                                                        1.00000 | 0.2805    1.00000 | 0.0599        0.95699 | 57.567    1.00000 | 0.0594        
[Conv] /up_blocks.0/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.2355    1.00000 | 0.0547        
[Add] /up_blocks.0/resnets.2/Add_1_output_0                                                             1.00000 | 0.3618    1.00000 | 0.0726        0.93984 | 79.742    1.00000 | 0.0684        
[Resize] /up_blocks.0/upsamplers.0/Resize_output_0                                                      1.00000 | 0.7237    1.00000 | 0.0952        0.93984 | 159.48    1.00000 | 0.0           
[Split] /up_blocks.0/upsamplers.0/Resize_output_0_split                                                 1.00000 | 0.5084    1.00000 | 0.0656        0.93767 | 112.35    1.00000 | 0.0           
[Split] /up_blocks.0/upsamplers.0/Resize_output_0_split_o1                                              1.00000 | 0.5150    1.00000 | 0.0690        0.94185 | 113.18    1.00000 | 0.0           
[Conv] /up_blocks.0/upsamplers.0/conv/Conv_output_0_tile0_conv                                          1.00000 | 0.8456    1.00000 | 0.1860        
[Conv] /up_blocks.0/upsamplers.0/conv/Conv_output_0_tile1_conv                                          1.00000 | 0.8795    1.00000 | 0.2038        0.95395 | 189.60    1.00000 | 0.0061        
[Add] /up_blocks.0/upsamplers.0/conv/Conv_output_0                                                      1.00000 | 1.3007    1.00000 | 0.2692        0.95336 | 279.46    1.00000 | 0.2835        
[Concat] /up_blocks.1/Concat_output_0                                                                   1.00000 | 1.4965    1.00000 | 0.2144        0.94764 | 336.95    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.4965    1.00000 | 0.2144        0.94764 | 336.95    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.8617    1.00000 | 0.1765        0.94119 | 207.98    1.00000 | 1.6313        
[Reshape] /up_blocks.1/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 0.8617    1.00000 | 0.1313        0.94119 | 207.98    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.0/norm1/Add_output_0                                          1.00000 | 0.4385    1.00000 | 0.1039        0.97011 | 99.577    1.00000 | 0.1109        
[exSwish] /up_blocks.1/resnets.0/act/Mul_output_0                                                       1.00000 | 0.1720    1.00000 | 0.0326        0.92843 | 42.476    1.00000 | 0.1477        
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.1203    1.00000 | 0.0194        0.96003 | 25.461    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.1198    1.00000 | 0.0131        0.87091 | 33.136    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act/Mul_output_0_split_o2                                                1.00000 | 0.0276    1.00000 | 0.0031        0.88323 | 7.6117    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.6618    1.00000 | 0.1952        
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.5725    1.00000 | 0.1129        0.92711 | 162.87    1.00000 | 0.0051        
[Add] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 0.8944    1.00000 | 0.2828        0.97436 | 222.02    1.00000 | 0.3207        
[Conv] /up_blocks.1/resnets.0/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.1289    1.00000 | 0.0283        
[Add] /up_blocks.1/resnets.0/conv1/Conv_output_0                                                        1.00000 | 0.9257    1.00000 | 0.2866        0.97483 | 226.03    1.00000 | 0.1294        
[Add] /up_blocks.1/resnets.0/Add_output_0                                                               1.00000 | 0.9577    1.00000 | 0.3207        0.97895 | 225.97    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.9577    1.00000 | 0.2212        0.97895 | 225.97    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4736    1.00000 | 0.1377        0.96975 | 105.55    1.00000 | 0.4929        
[Reshape] /up_blocks.1/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.4736    1.00000 | 0.0895        0.96975 | 105.55    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.0/norm2/Add_output_0                                          1.00000 | 0.4350    1.00000 | 0.1243        0.97955 | 95.413    1.00000 | 0.1386        
[exSwish] /up_blocks.1/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.1834    1.00000 | 0.0380        0.95895 | 36.354    1.00000 | 0.1007        
[Split] /up_blocks.1/resnets.0/act_1/Mul_output_0_split                                                 1.00000 | 0.1321    1.00000 | 0.0193        0.95710 | 26.374    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.0/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1273    1.00000 | 0.0190        0.96086 | 25.020    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.0/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.7222    1.00000 | 0.1776        
[Conv] /up_blocks.1/resnets.0/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.6847    1.00000 | 0.1752        0.97021 | 142.12    1.00000 | 0.0065        
[Add] /up_blocks.1/resnets.0/conv2/Conv_output_0                                                        1.00000 | 1.0357    1.00000 | 0.2638        0.96945 | 217.28    1.00000 | 0.2705        
[Conv] /up_blocks.1/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.9456    1.00000 | 0.2440        
[Add] /up_blocks.1/resnets.0/Add_1_output_0                                                             1.00000 | 1.4401    1.00000 | 0.3254        0.94903 | 349.03    0.99984 | 19.446        
[Reshape] /up_blocks.1/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.4401    1.00000 | 0.2266        0.94903 | 349.03    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.5826    1.00000 | 0.1270        0.94734 | 139.28    1.00000 | 0.4566        
[Reshape] /up_blocks.1/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.5826    1.00000 | 0.0891        0.94734 | 139.28    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.5118    1.00000 | 0.1377        0.96816 | 120.31    1.00000 | 0.0029        
[Reshape] /up_blocks.1/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5118    1.00000 | 0.1001        0.96816 | 120.31    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.5118    1.00000 | 0.1001        0.96816 | 120.31    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1556    1.00000 | 0.0382        0.93807 | 36.353    1.00000 | 0.1010        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3890    1.00000 | 0.0758        0.93981 | 90.804    1.00000 | 0.0023        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3890    1.00000 | 0.0548        0.93981 | 90.804    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3890    1.00000 | 0.0548        0.93981 | 90.804    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.3883    1.00000 | 0.0868        0.95625 | 89.278    1.00000 | 0.0028        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.3883    1.00000 | 0.0626        0.95625 | 89.278    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.3914    1.00000 | 0.0899        0.96074 | 88.878    1.00000 | 0.0041        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.3914    1.00000 | 0.0658        0.96074 | 88.878    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.5646    1.00000 | 0.1732        0.97139 | 127.25    1.00000 | 0.0051        
[exSoftmax13] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0090    1.00000 | 0.0044        0.96691 | 1.3897    1.00000 | 0.0045        
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1457    1.00000 | 0.0280        0.94661 | 39.973    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1457    1.00000 | 0.0253        0.94661 | 39.973    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2705    1.00000 | 0.0864        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.5730    1.00000 | 0.1566        0.95929 | 135.89    1.00000 | 0.1213        
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2569    1.00000 | 0.0655        0.93958 | 60.540    1.00000 | 0.1823        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.4184    1.00000 | 0.1090        0.96111 | 101.16    1.00000 | 0.0039        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.4184    1.00000 | 0.0752        0.96111 | 101.16    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.4782    1.00000 | 0.3438        0.99694 | 84.616    1.00000 | 0.0078        
[exSoftmax13] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0123    1.00000 | 0.0047        0.99495 | 2.5390    1.00000 | 0.0448        
[exMatMul] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1130    1.00000 | 0.0242        0.98162 | 20.713    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1130    1.00000 | 0.0223        0.98162 | 20.713    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1647    1.00000 | 0.0485        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6048    1.00000 | 0.1538        0.96065 | 139.22    1.00000 | 0.1089        
[exNorm] /up_blocks.1/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1861    1.00000 | 0.0469        0.94351 | 42.578    1.00000 | 0.1324        
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.0132    1.00000 | 0.2879        0.97359 | 236.74    1.00000 | 0.0106        
[Split] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7406    1.00000 | 0.1366        0.96613 | 171.11    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6914    1.00000 | 0.1633        0.97884 | 163.61    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3158    1.00000 | 0.0919        0.96655 | 74.131    1.00000 | 0.3430        
[Mul] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3537    1.00000 | 0.0773        0.92607 | 82.364    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6789    1.00000 | 0.1484        
[Add] /up_blocks.1/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.8967    1.00000 | 0.1797        0.92430 | 199.85    1.00000 | 0.1644        
[Conv] /up_blocks.1/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 1.8343    1.00000 | 0.3486        0.92668 | 403.68    1.00000 | 0.0108        
[Reshape] /up_blocks.1/attentions.0/proj_out/Conv_output_0                                              1.00000 | 1.8343    1.00000 | 0.2193        0.92668 | 403.68    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.0/Add_output_0                                                            1.00000 | 1.8605    1.00000 | 0.3934        0.93130 | 404.61    1.00000 | 0.0           
[Concat] /up_blocks.1/Concat_1_output_0                                                                 1.00000 | 1.9991    1.00000 | 0.2494        0.92693 | 462.96    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9991    1.00000 | 0.2494        0.92693 | 462.96    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9416    1.00000 | 0.1771        0.91959 | 243.19    1.00000 | 1.5724        
[Reshape] /up_blocks.1/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 0.9416    1.00000 | 0.1285        0.91959 | 243.19    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.1/norm1/Add_output_0                                          1.00000 | 0.4187    1.00000 | 0.0788        0.94423 | 96.025    1.00000 | 0.0904        
[exSwish] /up_blocks.1/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1929    1.00000 | 0.0330        0.91931 | 43.940    1.00000 | 0.1245        
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.1783    1.00000 | 0.0211        0.92946 | 37.560    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0722    1.00000 | 0.0089        0.86840 | 22.274    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act/Mul_output_0_split_o2                                                1.00000 | 0.0147    1.00000 | 0.0018        0.85664 | 4.8828    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.9584    1.00000 | 0.1953        
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.2875    1.00000 | 0.0755        0.95905 | 88.939    1.00000 | 0.0050        
[Add] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile0_conv_add                                         1.00000 | 1.0161    1.00000 | 0.2331        0.96119 | 220.28    1.00000 | 0.2632        
[Conv] /up_blocks.1/resnets.1/conv1/Conv_output_0_tile2_conv                                            1.00000 | 0.0541    1.00000 | 0.0119        
[Add] /up_blocks.1/resnets.1/conv1/Conv_output_0                                                        1.00000 | 1.0303    1.00000 | 0.2329        0.96164 | 221.24    1.00000 | 0.0695        
[Add] /up_blocks.1/resnets.1/Add_output_0                                                               1.00000 | 1.0519    1.00000 | 0.2471        0.96443 | 221.24    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 1.0519    1.00000 | 0.1713        0.96443 | 221.24    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.5866    1.00000 | 0.1291        0.95933 | 122.41    1.00000 | 0.4537        
[Reshape] /up_blocks.1/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.5866    1.00000 | 0.0891        0.95933 | 122.41    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.1/norm2/Add_output_0                                          1.00000 | 0.5252    1.00000 | 0.1235        0.97275 | 108.10    1.00000 | 0.1364        
[exSwish] /up_blocks.1/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.2118    1.00000 | 0.0371        0.94226 | 41.544    1.00000 | 0.0964        
[Split] /up_blocks.1/resnets.1/act_1/Mul_output_0_split                                                 1.00000 | 0.1539    1.00000 | 0.0191        0.94149 | 30.372    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.1/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1454    1.00000 | 0.0181        0.94313 | 28.345    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.1/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.8237    1.00000 | 0.1699        
[Conv] /up_blocks.1/resnets.1/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.7760    1.00000 | 0.1594        0.95306 | 154.48    1.00000 | 0.0069        
[Add] /up_blocks.1/resnets.1/conv2/Conv_output_0                                                        1.00000 | 1.1864    1.00000 | 0.2356        0.95471 | 237.08    1.00000 | 0.2454        
[Conv] /up_blocks.1/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 1.2986    1.00000 | 0.2947        
[Add] /up_blocks.1/resnets.1/Add_1_output_0                                                             1.00000 | 1.7885    1.00000 | 0.3605        0.93937 | 417.20    1.00000 | 0.3744        
[Reshape] /up_blocks.1/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.7885    1.00000 | 0.2468        0.93937 | 417.20    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.6525    1.00000 | 0.1261        0.93886 | 150.08    1.00000 | 0.4641        
[Reshape] /up_blocks.1/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.6525    1.00000 | 0.0889        0.93886 | 150.08    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.5674    1.00000 | 0.1448        0.97056 | 121.99    1.00000 | 0.0036        
[Reshape] /up_blocks.1/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5674    1.00000 | 0.1044        0.97056 | 121.99    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.5674    1.00000 | 0.1044        0.97056 | 121.99    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1791    1.00000 | 0.0407        0.94206 | 38.157    1.00000 | 0.1168        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3728    1.00000 | 0.0692        0.93617 | 77.525    1.00000 | 0.0024        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3728    1.00000 | 0.0453        0.93617 | 77.525    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3728    1.00000 | 0.0453        0.93617 | 77.525    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.4951    1.00000 | 0.1144        0.96697 | 101.17    1.00000 | 0.0043        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.4951    1.00000 | 0.0825        0.96697 | 101.17    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.5028    1.00000 | 0.1088        0.96242 | 102.02    1.00000 | 0.0033        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.5028    1.00000 | 0.0775        0.96242 | 102.02    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.8751    1.00000 | 0.2641        0.97912 | 167.60    1.00000 | 0.0088        
[exSoftmax13] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0137    1.00000 | 0.0074        0.96463 | 2.1134    1.00000 | 0.0079        
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1674    1.00000 | 0.0292        0.94419 | 41.006    1.00000 | 0.0010        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1674    1.00000 | 0.0254        0.94419 | 41.006    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.3135    1.00000 | 0.0817        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.6364    1.00000 | 0.1606        0.96409 | 137.79    1.00000 | 0.1218        
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2812    1.00000 | 0.0677        0.93979 | 60.837    1.00000 | 0.1935        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.4752    1.00000 | 0.1132        0.95853 | 105.40    1.00000 | 0.0037        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.4752    1.00000 | 0.0761        0.95853 | 105.40    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.6141    1.00000 | 0.3568        0.99718 | 86.467    1.00000 | 0.0067        
[exSoftmax13] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0113    1.00000 | 0.0052        0.99857 | 1.7266    1.00000 | 0.0553        
[exMatMul] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0934    1.00000 | 0.0224        0.98843 | 13.779    1.00000 | 0.0002        
[Reshape] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0934    1.00000 | 0.0193        0.98843 | 13.779    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1452    1.00000 | 0.0547        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6665    1.00000 | 0.1749        0.97185 | 139.31    1.00000 | 0.1300        
[exNorm] /up_blocks.1/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1879    1.00000 | 0.0429        0.94164 | 39.823    1.00000 | 0.1237        
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.0210    1.00000 | 0.2609        0.97054 | 220.46    1.00000 | 0.0078        
[Split] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7431    1.00000 | 0.1242        0.96452 | 158.67    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.7002    1.00000 | 0.1419        0.97513 | 153.05    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3186    1.00000 | 0.0753        0.95512 | 70.094    1.00000 | 0.2296        
[Mul] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3106    1.00000 | 0.0619        0.92083 | 69.292    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6133    1.00000 | 0.1359        
[Add] /up_blocks.1/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.8919    1.00000 | 0.1915        0.92910 | 181.59    1.00000 | 0.1536        
[Conv] /up_blocks.1/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 1.7567    1.00000 | 0.3226        0.93265 | 359.06    1.00000 | 0.0114        
[Reshape] /up_blocks.1/attentions.1/proj_out/Conv_output_0                                              1.00000 | 1.7567    1.00000 | 0.2028        0.93265 | 359.06    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.1/Add_output_0                                                            1.00000 | 1.8575    1.00000 | 0.3951        0.92752 | 406.82    1.00000 | 0.0           
[Concat] /up_blocks.1/Concat_2_output_0                                                                 1.00000 | 1.9363    1.00000 | 0.2330        0.91665 | 456.16    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9363    1.00000 | 0.2330        0.91665 | 456.16    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9046    1.00000 | 0.1539        0.88722 | 249.90    1.00000 | 0.9187        
[Reshape] /up_blocks.1/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.9046    1.00000 | 0.1096        0.88722 | 249.90    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.2/norm1/Add_output_0                                          1.00000 | 0.3574    1.00000 | 0.0627        0.93388 | 80.997    1.00000 | 0.0713        
[exSwish] /up_blocks.1/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1732    1.00000 | 0.0297        0.91799 | 39.524    1.00000 | 0.1005        
[Split] /up_blocks.1/resnets.2/act/Mul_output_0_split                                                   1.00000 | 0.1463    1.00000 | 0.0174        0.92648 | 31.446    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.2/act/Mul_output_0_split_o1                                                1.00000 | 0.0927    1.00000 | 0.0111        0.89758 | 23.944    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/conv1/Conv_output_0_tile0_conv                                            1.00000 | 1.2331    1.00000 | 0.3374        
[Conv] /up_blocks.1/resnets.2/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.4158    1.00000 | 0.0914        0.94520 | 101.24    1.00000 | 0.0051        
[Add] /up_blocks.1/resnets.2/conv1/Conv_output_0                                                        1.00000 | 1.3318    1.00000 | 0.3870        0.98083 | 265.80    1.00000 | 0.4559        
[Add] /up_blocks.1/resnets.2/Add_output_0                                                               1.00000 | 1.3659    1.00000 | 0.4391        0.98269 | 265.81    1.00000 | 0.0           
[Reshape] /up_blocks.1/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 1.3659    1.00000 | 0.2890        0.98269 | 265.81    1.00000 | 0.0           
[exNorm] /up_blocks.1/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4367    1.00000 | 0.1258        0.97760 | 90.848    1.00000 | 0.4327        
[Reshape] /up_blocks.1/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.4367    1.00000 | 0.0884        0.97760 | 90.848    1.00000 | 0.0           
[BatchNormalization] /up_blocks.1/resnets.2/norm2/Add_output_0                                          1.00000 | 0.4813    1.00000 | 0.1618        0.98637 | 95.767    1.00000 | 0.1748        
[exSwish] /up_blocks.1/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1627    1.00000 | 0.0288        0.94254 | 32.177    0.99997 | 0.7123        
[Split] /up_blocks.1/resnets.2/act_1/Mul_output_0_split                                                 1.00000 | 0.1178    1.00000 | 0.0148        0.94312 | 23.568    1.00000 | 0.0           
[Split] /up_blocks.1/resnets.2/act_1/Mul_output_0_split_o1                                              1.00000 | 0.1121    1.00000 | 0.0138        0.94192 | 21.906    1.00000 | 0.0           
[Conv] /up_blocks.1/resnets.2/conv2/Conv_output_0_tile0_conv                                            1.00000 | 0.5777    1.00000 | 0.1206        
[Conv] /up_blocks.1/resnets.2/conv2/Conv_output_0_tile1_conv                                            1.00000 | 0.5700    1.00000 | 0.1161        0.94810 | 109.13    1.00000 | 0.0047        
[Add] /up_blocks.1/resnets.2/conv2/Conv_output_0                                                        1.00000 | 0.8276    1.00000 | 0.1532        0.94956 | 159.20    1.00000 | 0.1511        
[Conv] /up_blocks.1/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 1.1853    1.00000 | 0.2494        
[Add] /up_blocks.1/resnets.2/Add_1_output_0                                                             1.00000 | 1.4345    1.00000 | 0.2708        0.93423 | 320.85    1.00000 | 0.2851        
[Reshape] /up_blocks.1/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.4345    1.00000 | 0.1848        0.93423 | 320.85    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.7037    1.00000 | 0.1259        0.93341 | 156.59    1.00000 | 0.6550        
[Reshape] /up_blocks.1/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.7037    1.00000 | 0.0891        0.93341 | 156.59    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.5673    1.00000 | 0.1334        0.96378 | 124.21    1.00000 | 0.0026        
[Reshape] /up_blocks.1/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5673    1.00000 | 0.0960        0.96378 | 124.21    1.00000 | 0.0           
[Reshape] /up_blocks.1/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.5673    1.00000 | 0.0960        0.96378 | 124.21    1.00000 | 0.0           
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.1645    1.00000 | 0.0359        0.92627 | 35.917    1.00000 | 0.0949        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.3478    1.00000 | 0.0594        0.91674 | 78.983    1.00000 | 0.0016        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.3478    1.00000 | 0.0408        0.91674 | 78.983    1.00000 | 0.0           
[Transpose] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.3478    1.00000 | 0.0408        0.91674 | 78.983    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.4226    1.00000 | 0.0885        0.94841 | 89.827    1.00000 | 0.0027        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.4226    1.00000 | 0.0585        0.94841 | 89.827    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.4164    1.00000 | 0.0862        0.94819 | 88.813    1.00000 | 0.0031        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.4164    1.00000 | 0.0576        0.94819 | 88.813    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 0.5395    1.00000 | 0.1253        0.95598 | 113.41    1.00000 | 0.0033        
[exSoftmax13] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0052    1.00000 | 0.0018        0.95486 | 1.3638    1.00000 | 0.0038        
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1135    1.00000 | 0.0200        0.91175 | 38.152    1.00000 | 0.0007        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1135    1.00000 | 0.0186        0.91175 | 38.152    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2049    1.00000 | 0.0592        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.6000    1.00000 | 0.1394        0.95413 | 136.99    1.00000 | 0.0988        
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3271    1.00000 | 0.0728        0.91936 | 76.033    1.00000 | 0.1920        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5529    1.00000 | 0.1196        0.94617 | 127.77    1.00000 | 0.0038        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5529    1.00000 | 0.0800        0.94617 | 127.77    1.00000 | 0.0           
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.5608    1.00000 | 0.3652        0.99658 | 94.669    1.00000 | 0.0098        
[exSoftmax13] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0119    1.00000 | 0.0051        0.99883 | 1.4227    1.00000 | 0.0531        
[exMatMul] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0959    1.00000 | 0.0306        0.99329 | 11.085    1.00000 | 0.0008        
[Reshape] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0959    1.00000 | 0.0211        0.99329 | 11.085    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1190    1.00000 | 0.0514        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.6261    1.00000 | 0.1622        0.96930 | 137.60    1.00000 | 0.1290        
[exNorm] /up_blocks.1/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.1696    1.00000 | 0.0363        0.92416 | 38.527    1.00000 | 0.1035        
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 0.9052    1.00000 | 0.2138        0.96020 | 208.29    1.00000 | 0.0074        
[Split] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.6425    1.00000 | 0.0951        0.94962 | 146.24    1.00000 | 0.0           
[Split] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6376    1.00000 | 0.1186        0.96699 | 148.31    1.00000 | 0.0           
[exGelu] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.2935    1.00000 | 0.0697        0.95411 | 67.069    1.00000 | 0.2026        
[Mul] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2447    1.00000 | 0.0456        0.90951 | 57.798    1.00000 | 0.0           
[Conv] /up_blocks.1/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.4642    1.00000 | 0.1096        
[Add] /up_blocks.1/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.7650    1.00000 | 0.1632        0.92158 | 168.49    1.00000 | 0.1295        
[Conv] /up_blocks.1/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 1.4411    1.00000 | 0.2699        0.91834 | 330.46    1.00000 | 0.0083        
[Reshape] /up_blocks.1/attentions.2/proj_out/Conv_output_0                                              1.00000 | 1.4411    1.00000 | 0.1701        0.91834 | 330.46    1.00000 | 0.0           
[Add] /up_blocks.1/attentions.2/Add_output_0                                                            1.00000 | 1.2802    1.00000 | 0.2914        0.91594 | 286.35    1.00000 | 0.0           
[Resize] /up_blocks.1/upsamplers.0/Resize_output_0                                                      1.00000 | 2.5605    1.00000 | 0.2918        0.91594 | 572.70    1.00000 | 0.0           
[Split] /up_blocks.1/upsamplers.0/Resize_output_0_split                                                 1.00000 | 1.8039    1.00000 | 0.2041        0.91826 | 394.31    1.00000 | 0.0           
[Split] /up_blocks.1/upsamplers.0/Resize_output_0_split_o1                                              1.00000 | 1.8171    1.00000 | 0.2085        0.91374 | 415.33    1.00000 | 0.0           
[Conv] /up_blocks.1/upsamplers.0/conv/Conv_output_0_tile0_conv                                          1.00000 | 5.6885    1.00000 | 1.0680        
[Conv] /up_blocks.1/upsamplers.0/conv/Conv_output_0_tile1_conv                                          1.00000 | 5.7284    1.00000 | 1.1018        0.92649 | 1320.5    1.00000 | 0.0396        
[Add] /up_blocks.1/upsamplers.0/conv/Conv_output_0                                                      1.00000 | 8.2873    1.00000 | 1.5235        0.93044 | 1864.5    1.00000 | 1.5146        
[Concat] /up_blocks.2/Concat_output_0                                                                   1.00000 | 8.3167    1.00000 | 1.0545        0.93065 | 1875.2    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 8.3167    1.00000 | 1.0545        0.93065 | 1875.2    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.5649    1.00000 | 0.2951        0.86219 | 680.69    0.91889 | 551.98        
[Reshape] /up_blocks.2/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 1.5649    1.00000 | 0.2206        0.86219 | 680.69    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.0/norm1/Add_output_0                                          1.00000 | 0.8883    1.00000 | 0.1891        0.95039 | 247.52    1.00000 | 0.1965        
[exSwish] /up_blocks.2/resnets.0/act/Mul_output_0                                                       1.00000 | 0.3253    1.00000 | 0.0589        0.91841 | 84.455    1.00000 | 0.3062        
[Split] /up_blocks.2/resnets.0/act/Mul_output_0_split                                                   1.00000 | 0.2668    1.00000 | 0.0373        0.94558 | 56.177    1.00000 | 0.0           
[Split] /up_blocks.2/resnets.0/act/Mul_output_0_split_o1                                                1.00000 | 0.1860    1.00000 | 0.0248        0.86713 | 63.061    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.0/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.9951    1.00000 | 0.2288        
[Conv] /up_blocks.2/resnets.0/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.7196    1.00000 | 0.1703        0.92975 | 250.22    1.00000 | 0.0097        
[Add] /up_blocks.2/resnets.0/conv1/Conv_output_0                                                        1.00000 | 1.2639    1.00000 | 0.3131        0.95738 | 330.24    1.00000 | 0.3535        
[Add] /up_blocks.2/resnets.0/Add_output_0                                                               1.00000 | 1.3038    1.00000 | 0.3437        0.96249 | 330.22    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 1.3038    1.00000 | 0.2346        0.96249 | 330.22    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7612    1.00000 | 0.1831        0.95629 | 179.31    1.00000 | 1.4972        
[Reshape] /up_blocks.2/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.7612    1.00000 | 0.1239        0.95629 | 179.31    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.0/norm2/Add_output_0                                          1.00000 | 0.8681    1.00000 | 0.1867        0.95495 | 201.63    1.00000 | 0.1988        
[exSwish] /up_blocks.2/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.3911    1.00000 | 0.0751        0.93918 | 84.454    1.00000 | 0.3071        
[Conv] /up_blocks.2/resnets.0/conv2/Conv_output_0                                                       1.00000 | 1.9877    1.00000 | 0.4380        0.94915 | 404.84    1.00000 | 0.0134        
[Conv] /up_blocks.2/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 2.5969    1.00000 | 0.6356        
[Add] /up_blocks.2/resnets.0/Add_1_output_0                                                             1.00000 | 3.3080    1.00000 | 0.6773        0.93649 | 803.77    1.00000 | 0.7066        
[Reshape] /up_blocks.2/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 3.3080    1.00000 | 0.4726        0.93649 | 803.77    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.9119    1.00000 | 0.1788        0.93630 | 216.47    1.00000 | 1.4518        
[Reshape] /up_blocks.2/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.9119    1.00000 | 0.1262        0.93630 | 216.47    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.8930    1.00000 | 0.2286        0.96756 | 191.13    1.00000 | 0.0129        
[Reshape] /up_blocks.2/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.8930    1.00000 | 0.1505        0.96756 | 191.13    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.8930    1.00000 | 0.1505        0.96756 | 191.13    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.4770    1.00000 | 0.1017        0.92890 | 104.79    1.00000 | 0.3493        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.8793    1.00000 | 0.1521        0.91596 | 190.56    1.00000 | 0.0048        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.8793    1.00000 | 0.0964        0.91596 | 190.56    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.8793    1.00000 | 0.0964        0.91596 | 190.56    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.9128    1.00000 | 0.2041        0.95979 | 192.58    1.00000 | 0.0068        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.9128    1.00000 | 0.1414        0.95979 | 192.58    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.8662    1.00000 | 0.1853        0.95303 | 180.63    1.00000 | 0.0059        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.8662    1.00000 | 0.1224        0.95303 | 180.63    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 4.8021    1.00000 | 1.0025        0.96631 | 908.68    1.00000 | 0.0308        
[exSoftmax13] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0226    1.00000 | 0.0118        0.92404 | 3.5565    1.00000 | 0.0152        
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.3565    1.00000 | 0.0562        0.93407 | 93.336    1.00000 | 0.0026        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.3565    1.00000 | 0.0535        0.93407 | 93.336    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.4781    1.00000 | 0.1383        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.9632    1.00000 | 0.2383        0.96126 | 206.35    1.00000 | 0.1834        
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.5014    1.00000 | 0.1162        0.94055 | 109.83    1.00000 | 0.3810        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.7417    1.00000 | 0.1923        0.97079 | 156.21    1.00000 | 0.0056        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.7417    1.00000 | 0.1362        0.97079 | 156.21    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.5346    1.00000 | 0.8104        0.99486 | 241.67    1.00000 | 0.0179        
[exSoftmax13] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0070    1.00000 | 0.0070        1.00000 | 0.0748    1.00000 | 0.0461        
[exMatMul] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0912    1.00000 | 0.0408        0.99998 | 0.7216    1.00000 | 7.0365        
[Reshape] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0912    1.00000 | 0.0373        0.99998 | 0.7216    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1021    1.00000 | 0.0613        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.9799    1.00000 | 0.2642        0.96895 | 206.34    1.00000 | 0.1741        
[exNorm] /up_blocks.2/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.3845    1.00000 | 0.0942        0.94323 | 83.134    1.00000 | 0.2994        
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.5549    1.00000 | 0.3904        0.96704 | 329.01    1.00000 | 0.0104        
[Split] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 1.1921    1.00000 | 0.1770        0.95482 | 256.52    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.9984    1.00000 | 0.1990        0.97679 | 206.02    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.6820    1.00000 | 0.1877        0.97027 | 139.33    1.00000 | 0.5484        
[Mul] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.7092    1.00000 | 0.1319        0.91549 | 146.95    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 1.0277    1.00000 | 0.1868        
[Add] /up_blocks.2/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 1.4175    1.00000 | 0.2793        0.94270 | 284.54    1.00000 | 0.2327        
[Conv] /up_blocks.2/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 3.1528    1.00000 | 0.5748        0.93854 | 635.57    1.00000 | 0.0142        
[Reshape] /up_blocks.2/attentions.0/proj_out/Conv_output_0                                              1.00000 | 3.1528    1.00000 | 0.3760        0.93854 | 635.57    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.0/Add_output_0                                                            1.00000 | 3.7098    1.00000 | 0.7552        0.91842 | 841.72    1.00000 | 0.0           
[Concat] /up_blocks.2/Concat_1_output_0                                                                 1.00000 | 3.7571    1.00000 | 0.4455        0.91451 | 879.20    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 3.7571    1.00000 | 0.4455        0.91451 | 879.20    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.3984    1.00000 | 0.2513        0.85695 | 461.60    0.98891 | 128.77        
[Reshape] /up_blocks.2/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 1.3984    1.00000 | 0.1778        0.85695 | 461.60    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.1/norm1/Add_output_0                                          1.00000 | 0.3301    1.00000 | 0.0545        0.89702 | 85.232    1.00000 | 0.0650        
[exSwish] /up_blocks.2/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1635    1.00000 | 0.0248        0.87703 | 41.913    1.00000 | 0.1168        
[Split] /up_blocks.2/resnets.1/act/Mul_output_0_split                                                   1.00000 | 0.1523    1.00000 | 0.0158        0.90534 | 32.905    1.00000 | 0.0           
[Split] /up_blocks.2/resnets.1/act/Mul_output_0_split_o1                                                1.00000 | 0.0594    1.00000 | 0.0076        0.76369 | 25.960    1.00000 | 0.0           
[Conv] /up_blocks.2/resnets.1/conv1/Conv_output_0_tile0_conv                                            1.00000 | 0.5863    1.00000 | 0.1138        
[Conv] /up_blocks.2/resnets.1/conv1/Conv_output_0_tile1_conv                                            1.00000 | 0.1864    1.00000 | 0.0455        0.87098 | 82.884    1.00000 | 0.0016        
[Add] /up_blocks.2/resnets.1/conv1/Conv_output_0                                                        1.00000 | 0.6220    1.00000 | 0.1311        0.94954 | 144.98    1.00000 | 0.1514        
[Add] /up_blocks.2/resnets.1/Add_output_0                                                               1.00000 | 0.6550    1.00000 | 0.1651        0.96438 | 144.96    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.6550    1.00000 | 0.1112        0.96438 | 144.96    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7913    1.00000 | 0.1824        0.96072 | 169.98    1.00000 | 1.5955        
[Reshape] /up_blocks.2/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.7913    1.00000 | 0.1259        0.96072 | 169.98    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.1/norm2/Add_output_0                                          1.00000 | 0.6315    1.00000 | 0.1514        0.97148 | 131.63    1.00000 | 0.1738        
[exSwish] /up_blocks.2/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.2687    1.00000 | 0.0452        0.93395 | 54.617    1.00000 | 0.2114        
[Conv] /up_blocks.2/resnets.1/conv2/Conv_output_0                                                       1.00000 | 1.1160    1.00000 | 0.2332        0.94936 | 223.65    1.00000 | 0.0081        
[Conv] /up_blocks.2/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 1.4599    1.00000 | 0.3508        
[Add] /up_blocks.2/resnets.1/Add_1_output_0                                                             1.00000 | 1.8554    1.00000 | 0.3854        0.93668 | 448.93    1.00000 | 0.3997        
[Reshape] /up_blocks.2/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.8554    1.00000 | 0.2644        0.93668 | 448.93    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.9122    1.00000 | 0.1791        0.93662 | 215.89    1.00000 | 1.6838        
[Reshape] /up_blocks.2/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.9122    1.00000 | 0.1258        0.93662 | 215.89    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.7514    1.00000 | 0.2058        0.97208 | 159.87    1.00000 | 0.0042        
[Reshape] /up_blocks.2/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.7514    1.00000 | 0.1509        0.97208 | 159.87    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.7514    1.00000 | 0.1509        0.97208 | 159.87    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.4042    1.00000 | 0.0969        0.93564 | 89.049    1.00000 | 0.3276        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.6310    1.00000 | 0.1144        0.91810 | 139.71    1.00000 | 0.0032        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.6310    1.00000 | 0.0710        0.91810 | 139.71    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.6310    1.00000 | 0.0710        0.91810 | 139.71    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.9249    1.00000 | 0.2449        0.97228 | 183.51    1.00000 | 0.0060        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.9249    1.00000 | 0.1622        0.97228 | 183.51    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.8581    1.00000 | 0.1888        0.95496 | 174.25    1.00000 | 0.0053        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.8581    1.00000 | 0.1199        0.95496 | 174.25    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 6.1266    1.00000 | 1.5087        0.98675 | 937.46    1.00000 | 0.0476        
[exSoftmax13] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0205    1.00000 | 0.0130        0.94624 | 2.5902    1.00000 | 0.0095        
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2741    1.00000 | 0.0415        0.92014 | 78.173    1.00000 | 0.0014        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2741    1.00000 | 0.0398        0.92014 | 78.173    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.4093    1.00000 | 0.1036        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.7897    1.00000 | 0.2167        0.95877 | 175.86    1.00000 | 0.1426        
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3983    1.00000 | 0.1039        0.94530 | 90.491    1.00000 | 0.3280        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5176    1.00000 | 0.1291        0.96685 | 114.94    1.00000 | 0.0038        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5176    1.00000 | 0.0904        0.96685 | 114.94    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 0.9660    1.00000 | 0.4508        0.99291 | 165.41    1.00000 | 0.0109        
[exSoftmax13] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0119    1.00000 | 0.0098        0.99993 | 0.7786    1.00000 | 0.1204        
[exMatMul] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.0863    1.00000 | 0.0314        0.99907 | 5.2969    1.00000 | 0.0003        
[Reshape] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.0863    1.00000 | 0.0204        0.99907 | 5.2969    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0975    1.00000 | 0.0652        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.8094    1.00000 | 0.2134        0.96592 | 175.98    1.00000 | 0.1492        
[exNorm] /up_blocks.2/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.3431    1.00000 | 0.0746        0.93044 | 77.739    1.00000 | 0.2871        
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.3150    1.00000 | 0.3064        0.95546 | 297.97    1.00000 | 0.0091        
[Split] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.9867    1.00000 | 0.1472        0.95270 | 218.93    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.8692    1.00000 | 0.1450        0.95831 | 202.13    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.5130    1.00000 | 0.1276        0.96201 | 109.14    1.00000 | 0.3335        
[Mul] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.4407    1.00000 | 0.0743        0.90364 | 93.281    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.6429    1.00000 | 0.1147        
[Add] /up_blocks.2/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 1.0229    1.00000 | 0.2239        0.94659 | 209.69    1.00000 | 0.1627        
[Conv] /up_blocks.2/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 1.7919    1.00000 | 0.3320        0.93090 | 373.55    1.00000 | 0.0092        
[Reshape] /up_blocks.2/attentions.1/proj_out/Conv_output_0                                              1.00000 | 1.7919    1.00000 | 0.2075        0.93090 | 373.55    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.1/Add_output_0                                                            1.00000 | 1.9347    1.00000 | 0.4085        0.91671 | 432.42    1.00000 | 0.0           
[Concat] /up_blocks.2/Concat_2_output_0                                                                 1.00000 | 1.9829    1.00000 | 0.2343        0.89098 | 528.46    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.9829    1.00000 | 0.2343        0.89098 | 528.46    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.2657    1.00000 | 0.2195        0.84977 | 406.37    0.99968 | 19.418        
[Reshape] /up_blocks.2/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 1.2657    1.00000 | 0.1550        0.84977 | 406.37    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2398    1.00000 | 0.0379        0.90012 | 59.548    1.00000 | 0.0465        
[exSwish] /up_blocks.2/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1149    1.00000 | 0.0178        0.88462 | 28.918    1.00000 | 0.0956        
[Conv] /up_blocks.2/resnets.2/conv1/Conv_output_0                                                       1.00000 | 0.4444    1.00000 | 0.0969        0.95570 | 106.21    1.00000 | 0.0041        
[Add] /up_blocks.2/resnets.2/Add_output_0                                                               1.00000 | 0.4969    1.00000 | 0.1469        0.97677 | 106.22    1.00000 | 0.0           
[Reshape] /up_blocks.2/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.4969    1.00000 | 0.1030        0.97677 | 106.22    1.00000 | 0.0           
[exNorm] /up_blocks.2/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.6252    1.00000 | 0.1809        0.97545 | 134.40    1.00000 | 1.4827        
[Reshape] /up_blocks.2/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.6252    1.00000 | 0.1245        0.97545 | 134.40    1.00000 | 0.0           
[BatchNormalization] /up_blocks.2/resnets.2/norm2/Add_output_0                                          1.00000 | 0.4021    1.00000 | 0.1211        0.98100 | 81.498    1.00000 | 0.1463        
[exSwish] /up_blocks.2/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1650    1.00000 | 0.0308        0.94177 | 35.594    1.00000 | 0.1197        
[Conv] /up_blocks.2/resnets.2/conv2/Conv_output_0                                                       1.00000 | 0.6099    1.00000 | 0.1448        
[Conv] /up_blocks.2/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.8638    1.00000 | 0.1950        0.91376 | 231.01    1.00000 | 0.0068        
[Add] /up_blocks.2/resnets.2/Add_1_output_0                                                             1.00000 | 1.0471    1.00000 | 0.2293        0.94031 | 259.64    1.00000 | 0.2228        
[Reshape] /up_blocks.2/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.0471    1.00000 | 0.1574        0.94031 | 259.64    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.8773    1.00000 | 0.1815        0.94030 | 209.53    1.00000 | 1.6575        
[Reshape] /up_blocks.2/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.8773    1.00000 | 0.1260        0.94030 | 209.53    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.5379    1.00000 | 0.1431        0.96931 | 124.65    1.00000 | 0.0031        
[Reshape] /up_blocks.2/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.5379    1.00000 | 0.0991        0.96931 | 124.65    1.00000 | 0.0           
[Reshape] /up_blocks.2/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.5379    1.00000 | 0.0991        0.96931 | 124.65    1.00000 | 0.0           
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.3361    1.00000 | 0.0747        0.92334 | 78.557    1.00000 | 0.2454        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.5569    1.00000 | 0.0912        0.90470 | 129.72    1.00000 | 0.0030        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.5569    1.00000 | 0.0623        0.90470 | 129.72    1.00000 | 0.0           
[Transpose] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.5569    1.00000 | 0.0623        0.90470 | 129.72    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 0.6620    1.00000 | 0.1707        0.96078 | 141.54    1.00000 | 0.0058        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 0.6620    1.00000 | 0.1054        0.96078 | 141.54    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 0.6323    1.00000 | 0.1428        0.94911 | 136.68    1.00000 | 0.0046        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 0.6323    1.00000 | 0.0896        0.94911 | 136.68    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 2.8121    1.00000 | 0.5783        0.96997 | 503.59    1.00000 | 0.0176        
[exSoftmax13] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               1.00000 | 0.0069    1.00000 | 0.0025        0.96805 | 1.0689    1.00000 | 0.0028        
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2115    1.00000 | 0.0312        0.88338 | 73.067    1.00000 | 0.0010        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2115    1.00000 | 0.0308        0.88338 | 73.067    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2566    1.00000 | 0.0707        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.5778    1.00000 | 0.1479        0.95659 | 140.78    1.00000 | 0.1321        
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.4081    1.00000 | 0.0964        0.93160 | 100.79    1.00000 | 0.3521        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.5295    1.00000 | 0.1231        0.94891 | 129.04    1.00000 | 0.0043        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.5295    1.00000 | 0.0837        0.94891 | 129.04    1.00000 | 0.0           
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.0615    1.00000 | 0.4736        0.99177 | 218.10    1.00000 | 0.0152        
[exSoftmax13] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0184    1.00000 | 0.0107        0.99960 | 1.7411    1.00000 | 0.1300        
[exMatMul] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1127    1.00000 | 0.0301        0.99392 | 12.221    1.00000 | 0.0003        
[Reshape] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1127    1.00000 | 0.0226        0.99392 | 12.221    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0884    1.00000 | 0.0486        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.5978    1.00000 | 0.1724        0.96644 | 140.81    1.00000 | 0.1350        
[exNorm] /up_blocks.2/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.2601    1.00000 | 0.0583        0.91962 | 63.309    1.00000 | 0.2040        
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 0.9735    1.00000 | 0.2282        0.95039 | 232.20    1.00000 | 0.0072        
[Split] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.7274    1.00000 | 0.1011        0.94207 | 168.07    1.00000 | 0.0           
[Split] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.6470    1.00000 | 0.1134        0.95722 | 160.21    1.00000 | 0.0           
[exGelu] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3428    1.00000 | 0.0844        0.95749 | 77.546    1.00000 | 0.2401        
[Mul] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2164    1.00000 | 0.0364        0.89181 | 48.469    1.00000 | 0.0           
[Conv] /up_blocks.2/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3057    1.00000 | 0.0570        
[Add] /up_blocks.2/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.6552    1.00000 | 0.1621        0.95143 | 147.49    1.00000 | 0.1145        
[Conv] /up_blocks.2/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 1.0395    1.00000 | 0.2071        0.93424 | 239.09    1.00000 | 0.0057        
[Reshape] /up_blocks.2/attentions.2/proj_out/Conv_output_0                                              1.00000 | 1.0395    1.00000 | 0.1363        0.93424 | 239.09    1.00000 | 0.0           
[Add] /up_blocks.2/attentions.2/Add_output_0                                                            1.00000 | 0.8366    1.00000 | 0.2263        0.91442 | 183.09    1.00000 | 0.0           
[Resize] /up_blocks.2/upsamplers.0/Resize_output_0                                                      1.00000 | 1.6732    1.00000 | 0.1826        0.91442 | 366.18    1.00000 | 0.0           
[Conv] /up_blocks.2/upsamplers.0/conv/Conv_output_0                                                     1.00000 | 3.7705    1.00000 | 0.7602        0.94971 | 783.53    1.00000 | 0.0295        
[Concat] /up_blocks.3/Concat_output_0                                                                   1.00000 | 3.8058    1.00000 | 0.5195        0.94275 | 848.52    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.0/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 3.8058    1.00000 | 0.5195        0.94275 | 848.52    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.0/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 2.3518    1.00000 | 0.4389        0.83984 | 958.33    0.95452 | 562.33        
[Reshape] /up_blocks.3/resnets.0/norm1/Reshape_1_output_0                                               1.00000 | 2.3518    1.00000 | 0.3094        0.83984 | 958.33    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.0/norm1/Add_output_0                                          1.00000 | 1.1249    1.00000 | 0.2130        0.92847 | 351.80    1.00000 | 0.2858        
[exSwish] /up_blocks.3/resnets.0/act/Mul_output_0                                                       1.00000 | 0.4209    1.00000 | 0.0674        0.85265 | 147.73    1.00000 | 0.4182        
[Conv] /up_blocks.3/resnets.0/conv1/Conv_output_0                                                       1.00000 | 0.8407    1.00000 | 0.2298        0.91369 | 328.95    1.00000 | 0.0097        
[Add] /up_blocks.3/resnets.0/Add_output_0                                                               1.00000 | 0.9140    1.00000 | 0.3147        0.95829 | 328.78    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.0/norm2/Reshape_output_0_rs                                              1.00000 | 0.9140    1.00000 | 0.2193        0.95829 | 328.78    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.0/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.7447    1.00000 | 0.2526        0.89995 | 458.42    0.93754 | 378.39        
[Reshape] /up_blocks.3/resnets.0/norm2/Reshape_1_output_0                                               1.00000 | 0.7447    1.00000 | 0.1812        0.89995 | 458.42    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.0/norm2/Add_output_0                                          1.00000 | 0.5549    1.00000 | 0.1693        0.88820 | 307.56    1.00000 | 0.2408        
[exSwish] /up_blocks.3/resnets.0/act_1/Mul_output_0                                                     1.00000 | 0.2728    1.00000 | 0.0768        0.82335 | 212.43    1.00000 | 0.2583        
[Conv] /up_blocks.3/resnets.0/conv2/Conv_output_0                                                       1.00000 | 0.7486    1.00000 | 0.2493        
[Conv] /up_blocks.3/resnets.0/conv_shortcut/Conv_output_0                                               1.00000 | 0.8910    1.00000 | 0.2867        0.94147 | 293.18    1.00000 | 0.0085        
[Add] /up_blocks.3/resnets.0/Add_1_output_0                                                             1.00000 | 1.1875    1.00000 | 0.3553        0.90692 | 609.83    1.00000 | 0.4355        
[Reshape] /up_blocks.3/attentions.0/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 1.1875    1.00000 | 0.2529        0.90692 | 609.83    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.0/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.8876    1.00000 | 0.2544        0.87622 | 461.09    0.96440 | 260.50        
[Reshape] /up_blocks.3/attentions.0/norm/Reshape_1_output_0                                             1.00000 | 0.8876    1.00000 | 0.1785        0.87622 | 461.09    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/proj_in/Conv_output_0                                                  1.00000 | 0.3963    1.00000 | 0.1297        0.89305 | 178.46    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.0/Reshape_output_0_rs#1_tp                                            1.00000 | 0.3963    1.00000 | 0.0729        0.89305 | 178.46    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.0/Reshape_output_0_tp-rs                                              1.00000 | 0.3963    1.00000 | 0.0729        0.89305 | 178.46    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.7777    1.00000 | 0.1763        0.77690 | 335.80    1.00000 | 0.5336        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.8776    1.00000 | 0.1663        0.69007 | 390.67    1.00000 | 0.0053        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.8776    1.00000 | 0.0990        0.69007 | 390.67    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.8776    1.00000 | 0.0990        0.69007 | 390.67    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.8850    1.00000 | 0.4569        0.92501 | 716.15    1.00000 | 0.0151        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.8850    1.00000 | 0.3564        0.92501 | 716.15    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.5499    1.00000 | 0.3265        0.84147 | 639.59    1.00000 | 0.0094        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.5499    1.00000 | 0.2365        0.84147 | 639.59    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 33.898    1.00000 | 17.037        0.98603 | 14216.    1.00000 | 0.4507        
[exSoftmax13] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0421    1.00000 | 0.0321        0.80024 | 6.6677    1.00000 | 0.0154        
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.3443    1.00000 | 0.0508        0.55480 | 280.71    1.00000 | 0.0030        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.3443    1.00000 | 0.0495        0.55480 | 280.71    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.3258    1.00000 | 0.0995        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.4349    1.00000 | 0.1299        0.83690 | 223.64    1.00000 | 0.1365        
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3254    1.00000 | 0.0982        0.86129 | 159.35    1.00000 | 0.2823        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.2942    1.00000 | 0.1026        0.93692 | 122.60    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.2942    1.00000 | 0.0716        0.93692 | 122.60    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 1.8542    1.00000 | 0.8673        0.98626 | 448.25    1.00000 | 0.0162        
[exSoftmax13] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0376    1.00000 | 0.0227        0.98979 | 15.946    1.00000 | 0.1759        
[exMatMul] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1501    1.00000 | 0.0337        0.88793 | 59.482    1.00000 | 0.0011        
[Reshape] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1501    1.00000 | 0.0190        0.88793 | 59.482    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0866    1.00000 | 0.0269        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.4495    1.00000 | 0.1099        0.85918 | 223.08    1.00000 | 0.0824        
[exNorm] /up_blocks.3/attentions.0/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.6851    1.00000 | 0.1334        0.68841 | 336.54    1.00000 | 0.4834        
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.6466    1.00000 | 0.3913        0.84115 | 802.52    1.00000 | 0.0132        
[Split] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 1.2674    1.00000 | 0.1699        0.77994 | 608.86    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 1.0511    1.00000 | 0.1935        0.88738 | 522.81    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.7937    1.00000 | 0.2336        0.89355 | 415.55    1.00000 | 0.7165        
[Mul] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.6280    1.00000 | 0.1084        0.63913 | 352.96    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.0/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.5786    1.00000 | 0.1007        
[Add] /up_blocks.3/attentions.0/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.7269    1.00000 | 0.1278        0.73228 | 366.34    1.00000 | 0.1512        
[Conv] /up_blocks.3/attentions.0/Transpose_1_output_0_sw                                                1.00000 | 1.1800    1.00000 | 0.2087        0.72299 | 595.55    1.00000 | 0.0067        
[Reshape] /up_blocks.3/attentions.0/proj_out/Conv_output_0                                              1.00000 | 1.1800    1.00000 | 0.1398        0.72299 | 595.55    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.0/Add_output_0                                                            1.00000 | 1.4738    1.00000 | 0.3727        0.81830 | 756.86    1.00000 | 0.0           
[Concat] /up_blocks.3/Concat_1_output_0                                                                 1.00000 | 1.5136    1.00000 | 0.2555        0.83779 | 782.71    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.1/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 1.5136    1.00000 | 0.2555        0.83779 | 782.71    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.1/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 1.3630    1.00000 | 0.3616        0.78133 | 1223.5    0.89298 | 989.56        
[Reshape] /up_blocks.3/resnets.1/norm1/Reshape_1_output_0                                               1.00000 | 1.3630    1.00000 | 0.2525        0.78133 | 1223.5    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.1/norm1/Add_output_0                                          1.00000 | 0.3815    1.00000 | 0.1131        0.84591 | 363.34    1.00000 | 0.1910        
[exSwish] /up_blocks.3/resnets.1/act/Mul_output_0                                                       1.00000 | 0.1708    1.00000 | 0.0355        0.67181 | 141.76    0.99999 | 0.7500        
[Conv] /up_blocks.3/resnets.1/conv1/Conv_output_0                                                       1.00000 | 0.4382    1.00000 | 0.1493        0.91723 | 335.09    1.00000 | 0.0100        
[Add] /up_blocks.3/resnets.1/Add_output_0                                                               1.00000 | 0.5475    1.00000 | 0.2695        0.95661 | 334.85    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.1/norm2/Reshape_output_0_rs                                              1.00000 | 0.5475    1.00000 | 0.1935        0.95661 | 334.85    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.1/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.5174    1.00000 | 0.2558        0.89349 | 468.84    0.93180 | 389.60        
[Reshape] /up_blocks.3/resnets.1/norm2/Reshape_1_output_0                                               1.00000 | 0.5174    1.00000 | 0.1808        0.89349 | 468.84    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.1/norm2/Add_output_0                                          1.00000 | 0.3553    1.00000 | 0.1577        0.87393 | 307.98    1.00000 | 0.2153        
[exSwish] /up_blocks.3/resnets.1/act_1/Mul_output_0                                                     1.00000 | 0.1451    1.00000 | 0.0409        0.79054 | 117.28    1.00000 | 0.1673        
[Conv] /up_blocks.3/resnets.1/conv2/Conv_output_0                                                       1.00000 | 0.3690    1.00000 | 0.1354        
[Conv] /up_blocks.3/resnets.1/conv_shortcut/Conv_output_0                                               1.00000 | 0.5098    1.00000 | 0.2227        0.96475 | 213.29    1.00000 | 0.0074        
[Add] /up_blocks.3/resnets.1/Add_1_output_0                                                             1.00000 | 0.6514    1.00000 | 0.2759        0.93063 | 387.90    1.00000 | 0.2886        
[Reshape] /up_blocks.3/attentions.1/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.6514    1.00000 | 0.1955        0.93063 | 387.90    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.1/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.7508    1.00000 | 0.2600        0.84944 | 567.14    0.93373 | 408.28        
[Reshape] /up_blocks.3/attentions.1/norm/Reshape_1_output_0                                             1.00000 | 0.7508    1.00000 | 0.1800        0.84944 | 567.14    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/proj_in/Conv_output_0                                                  1.00000 | 0.3766    1.00000 | 0.1399        0.89295 | 223.15    1.00000 | 0.0066        
[Reshape] /up_blocks.3/attentions.1/Reshape_output_0_rs#1_tp                                            1.00000 | 0.3766    1.00000 | 0.0943        0.89295 | 223.15    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.1/Reshape_output_0_tp-rs                                              1.00000 | 0.3766    1.00000 | 0.0943        0.89295 | 223.15    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.5532    1.00000 | 0.1595        0.79927 | 304.76    1.00000 | 0.5418        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.6008    1.00000 | 0.1287        0.69770 | 350.05    1.00000 | 0.0041        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.6008    1.00000 | 0.0811        0.69770 | 350.05    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.6008    1.00000 | 0.0811        0.69770 | 350.05    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.5483    1.00000 | 0.5226        0.94139 | 672.20    1.00000 | 0.0158        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.5483    1.00000 | 0.4159        0.94139 | 672.20    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.3004    1.00000 | 0.3673        0.89027 | 667.27    1.00000 | 0.0118        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.3004    1.00000 | 0.2849        0.89027 | 667.27    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 39.356    1.00000 | 35.475        0.99720 | 10374.    1.00000 | 0.7943        
[exSoftmax13] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0297    0.99999 | 0.0248        0.77125 | 4.0997    1.00000 | 0.0084        
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.2523    1.00000 | 0.0537        0.65684 | 273.48    1.00000 | 0.0036        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.2523    1.00000 | 0.0535        0.65684 | 273.48    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.2424    1.00000 | 0.1111        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.3925    1.00000 | 0.1511        0.80553 | 262.07    1.00000 | 0.1466        
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.3184    1.00000 | 0.1227        0.85196 | 176.75    1.00000 | 0.3577        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.3203    1.00000 | 0.1294        0.90665 | 193.67    1.00000 | 0.0034        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.3203    1.00000 | 0.0929        0.90665 | 193.67    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 2.1644    1.00000 | 1.2615        0.95146 | 1192.3    1.00000 | 0.0284        
[exSoftmax13] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0279    1.00000 | 0.0196        0.98907 | 19.590    1.00000 | 0.1797        
[exMatMul] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1515    1.00000 | 0.0237        0.33942 | 105.58    1.00000 | 0.0004        
[Reshape] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1515    1.00000 | 0.0129        0.33942 | 105.58    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.1019    1.00000 | 0.0195        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.4152    1.00000 | 0.1143        0.79118 | 269.27    1.00000 | 0.0647        
[exNorm] /up_blocks.3/attentions.1/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.5691    1.00000 | 0.1362        0.66527 | 346.79    1.00000 | 0.5101        
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.3241    1.00000 | 0.3528        0.76480 | 803.66    1.00000 | 0.0114        
[Split] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.9976    1.00000 | 0.1447        0.69805 | 618.98    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.8707    1.00000 | 0.1654        0.82204 | 512.58    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.5291    1.00000 | 0.1618        0.83885 | 309.00    1.00000 | 0.4964        
[Mul] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.3491    1.00000 | 0.0596        0.52962 | 212.81    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.1/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3494    1.00000 | 0.0628        
[Add] /up_blocks.3/attentions.1/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.5381    1.00000 | 0.1205        0.64647 | 343.73    1.00000 | 0.1161        
[Conv] /up_blocks.3/attentions.1/Transpose_1_output_0_sw                                                1.00000 | 0.6949    1.00000 | 0.1373        0.57822 | 445.65    1.00000 | 0.0047        
[Reshape] /up_blocks.3/attentions.1/proj_out/Conv_output_0                                              1.00000 | 0.6949    1.00000 | 0.0863        0.57822 | 445.65    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.1/Add_output_0                                                            1.00000 | 0.8416    1.00000 | 0.2874        0.87871 | 513.88    1.00000 | 0.0           
[Concat] /up_blocks.3/Concat_2_output_0                                                                 1.00000 | 0.8470    1.00000 | 0.2006        0.88970 | 513.88    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.2/norm1/Reshape_output_0_tp-rs_sw_sw                                     1.00000 | 0.8470    1.00000 | 0.2006        0.88970 | 513.88    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.2/norm1/InstanceNormalization_output_0-rs                                 1.00000 | 0.9919    1.00000 | 0.3562        0.86989 | 739.90    0.94646 | 519.84        
[Reshape] /up_blocks.3/resnets.2/norm1/Reshape_1_output_0                                               1.00000 | 0.9919    1.00000 | 0.2507        0.86989 | 739.90    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.2/norm1/Add_output_0                                          1.00000 | 0.2671    1.00000 | 0.0798        0.82832 | 221.61    1.00000 | 0.1101        
[exSwish] /up_blocks.3/resnets.2/act/Mul_output_0                                                       1.00000 | 0.1197    1.00000 | 0.0304        0.76981 | 87.384    1.00000 | 0.2565        
[Conv] /up_blocks.3/resnets.2/conv1/Conv_output_0                                                       1.00000 | 0.3535    1.00000 | 0.1288        0.89335 | 269.24    1.00000 | 0.0078        
[Add] /up_blocks.3/resnets.2/Add_output_0                                                               1.00000 | 0.5657    1.00000 | 0.3101        0.97605 | 268.60    1.00000 | 0.0           
[Reshape] /up_blocks.3/resnets.2/norm2/Reshape_output_0_rs                                              1.00000 | 0.5657    1.00000 | 0.2187        0.97605 | 268.60    1.00000 | 0.0           
[exNorm] /up_blocks.3/resnets.2/norm2/Reshape_output_0_tp-rs_sw                                         1.00000 | 0.4700    1.00000 | 0.2566        0.90923 | 529.62    0.93423 | 479.79        
[Reshape] /up_blocks.3/resnets.2/norm2/Reshape_1_output_0                                               1.00000 | 0.4700    1.00000 | 0.1764        0.90923 | 529.62    1.00000 | 0.0           
[BatchNormalization] /up_blocks.3/resnets.2/norm2/Add_output_0                                          1.00000 | 0.3263    1.00000 | 0.1622        0.91260 | 347.45    1.00000 | 0.2440        
[exSwish] /up_blocks.3/resnets.2/act_1/Mul_output_0                                                     1.00000 | 0.1306    1.00000 | 0.0463        0.82707 | 113.86    1.00000 | 0.1628        
[Conv] /up_blocks.3/resnets.2/conv2/Conv_output_0                                                       1.00000 | 0.4666    1.00000 | 0.3023        
[Conv] /up_blocks.3/resnets.2/conv_shortcut/Conv_output_0                                               1.00000 | 0.5386    1.00000 | 0.3747        0.99217 | 205.96    1.00000 | 0.0143        
[Add] /up_blocks.3/resnets.2/Add_1_output_0                                                             1.00000 | 0.9020    1.00000 | 0.7005        0.98829 | 386.51    1.00000 | 0.7014        
[Reshape] /up_blocks.3/attentions.2/norm/Reshape_output_0_tp-rs_sw_sw                                   1.00000 | 0.9020    1.00000 | 0.5074        0.98829 | 386.51    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.2/norm/InstanceNormalization_output_0-rs                               1.00000 | 0.4519    1.00000 | 0.2655        0.91319 | 439.51    0.93692 | 387.79        
[Reshape] /up_blocks.3/attentions.2/norm/Reshape_1_output_0                                             1.00000 | 0.4519    1.00000 | 0.1792        0.91319 | 439.51    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/proj_in/Conv_output_0                                                  1.00000 | 0.1926    1.00000 | 0.0972        0.80904 | 154.66    1.00000 | 0.0026        
[Reshape] /up_blocks.3/attentions.2/Reshape_output_0_rs#1_tp                                            1.00000 | 0.1926    1.00000 | 0.0426        0.80904 | 154.66    1.00000 | 0.0           
[Reshape] /up_blocks.3/attentions.2/Reshape_output_0_tp-rs                                              1.00000 | 0.1926    1.00000 | 0.0426        0.80904 | 154.66    1.00000 | 0.0           
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm1/ReduceMean_2ln                            1.00000 | 0.5178    1.00000 | 0.1475        0.69519 | 337.98    1.00000 | 0.4650        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_v/MatMul_output_0_mm                     1.00000 | 0.4938    1.00000 | 0.1037        0.70327 | 343.48    1.00000 | 0.0044        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_4_output_0                       1.00000 | 0.4938    1.00000 | 0.0718        0.70327 | 343.48    1.00000 | 0.0           
[Transpose] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_5_output_0_rs                  1.00000 | 0.4938    1.00000 | 0.0718        0.70327 | 343.48    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_k/MatMul_output_0_mm                     1.00000 | 1.1723    1.00000 | 0.5359        0.85913 | 783.40    1.00000 | 0.0131        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Transpose_3_output_0_rs                  1.00000 | 1.1723    1.00000 | 0.3130        0.85913 | 783.40    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_q/MatMul_output_0_mm                     1.00000 | 1.1278    1.00000 | 0.2768        0.73165 | 711.03    1.00000 | 0.0096        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_output_0                         1.00000 | 1.1278    1.00000 | 0.1777        0.73165 | 711.03    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Softmax_output_0-rs_sw                  1.00000 | 39.574    1.00000 | 16.890        0.98470 | 18383.    1.00000 | 0.3098        
[exSoftmax13] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Softmax_output_0_tp-rs               0.99999 | 0.0100    1.00000 | 0.0062        0.75801 | 2.7709    1.00000 | 0.0045        
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/MatMul_1_output_0_mm                    1.00000 | 0.1885    1.00000 | 0.0254        0.34946 | 284.66    1.00000 | 0.0023        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/Reshape_7_output_0_rs_sw                 1.00000 | 0.1885    1.00000 | 0.0253        0.34946 | 284.66    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn1/to_out.0/Add_output_0-rs                    1.00000 | 0.1444    1.00000 | 0.0394        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_output_0-rs                                    1.00000 | 0.2259    1.00000 | 0.0739        0.80437 | 188.41    1.00000 | 0.0914        
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm2/Add_1_output_0_tp-rs                      1.00000 | 0.2612    1.00000 | 0.1084        0.83726 | 176.91    1.00000 | 0.3183        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_q/MatMul_output_0_mm                     1.00000 | 0.2755    1.00000 | 0.1111        0.93279 | 150.24    1.00000 | 0.0035        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_output_0                         1.00000 | 0.2755    1.00000 | 0.0846        0.93279 | 150.24    1.00000 | 0.0           
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Softmax_output_0-rs_sw                  1.00000 | 2.2804    1.00000 | 1.0735        0.95749 | 947.74    1.00000 | 0.0244        
[exSoftmax13] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Softmax_output_0_tp-rs               1.00000 | 0.0318    1.00000 | 0.0222        0.99477 | 13.859    1.00000 | 0.1994        
[exMatMul] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/MatMul_1_output_0_mm                    1.00000 | 0.1218    1.00000 | 0.0261        0.29165 | 80.437    1.00000 | 0.0004        
[Reshape] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/Reshape_7_output_0_rs_sw                 1.00000 | 0.1218    1.00000 | 0.0121        0.29165 | 80.437    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/attn2/to_out.0/Add_output_0-rs                    1.00000 | 0.0670    1.00000 | 0.0121        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_1_output_0-rs                                  1.00000 | 0.2426    1.00000 | 0.0767        0.79460 | 197.96    1.00000 | 0.0465        
[exNorm] /up_blocks.3/attentions.2/transformer_blocks.0/norm3/Add_1_output_0_tp-rs                      1.00000 | 0.4379    1.00000 | 0.1133        0.66474 | 327.39    1.00000 | 0.5158        
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/proj/MatMul_output_0_mm_tp_sw            1.00000 | 1.1340    1.00000 | 0.3274        0.81550 | 762.80    1.00000 | 0.0128        
[Split] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Slice_output_0-rs_rewrite_graph         1.00000 | 0.8439    1.00000 | 0.1263        0.73147 | 577.39    1.00000 | 0.0           
[Split] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Slice_1_output_0-rs_rewrite_graph       1.00000 | 0.7574    1.00000 | 0.1860        0.86997 | 498.48    1.00000 | 0.0           
[exGelu] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Mul_3_output_0-rs_rewrite_graph        1.00000 | 0.3740    1.00000 | 0.1314        0.85581 | 256.69    1.00000 | 0.4210        
[Mul] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.0/Mul_4_output_0-rs_tp4                     1.00000 | 0.2483    1.00000 | 0.0441        0.41029 | 238.33    1.00000 | 0.0           
[Conv] /up_blocks.3/attentions.2/transformer_blocks.0/ff/net.2/Add_output_0-rs                          1.00000 | 0.3048    1.00000 | 0.0578        
[Add] /up_blocks.3/attentions.2/transformer_blocks.0/Add_2_output_0-rs_tp_tp                            1.00000 | 0.3949    1.00000 | 0.1166        0.70021 | 369.61    1.00000 | 0.1572        
[Conv] /up_blocks.3/attentions.2/Transpose_1_output_0_sw                                                1.00000 | 0.6315    1.00000 | 0.2756        0.91999 | 501.48    1.00000 | 0.0123        
[Reshape] /up_blocks.3/attentions.2/proj_out/Conv_output_0                                              1.00000 | 0.6315    1.00000 | 0.2450        0.91999 | 501.48    1.00000 | 0.0           
[Add] /up_blocks.3/attentions.2/Add_output_0                                                            1.00000 | 1.2570    1.00000 | 0.8952        0.98283 | 586.88    1.00000 | 0.0           
[Reshape] /conv_norm_out/Reshape_output_0_rs                                                            1.00000 | 1.2570    1.00000 | 0.6420        0.98283 | 586.88    1.00000 | 0.0           
[exNorm] /conv_norm_out/Reshape_output_0_tp-rs_sw                                                       1.00000 | 0.4223    1.00000 | 0.2598        0.87377 | 601.97    0.89414 | 566.55        
[Reshape] /conv_norm_out/Reshape_1_output_0                                                             1.00000 | 0.4223    1.00000 | 0.1763        0.87377 | 601.97    1.00000 | 0.0           
[BatchNormalization] /conv_norm_out/Add_output_0                                                        1.00000 | 0.7759    1.00000 | 0.5661        0.94678 | 951.81    1.00000 | 0.5998        
[exSwish] /act/Mul_output_0                                                                             1.00000 | 0.0511    1.00000 | 0.0187        0.84222 | 51.931    0.99924 | 3.6078        
[Conv] out_sample                                                                                       1.00000 | 0.0234    1.00000 | 0.0200        0.99670 | 22.932    1.00000 | 0.0009

您好，请教一下是怎么对比各layer的精度的？请问有相关命令或教程吗？谢谢

yuyun2000 commented 1 month ago

看文档，有个analy开头的接口，python文档

airockchip / rknn-toolkit2

NPU运行LayerNorm算子掉精度严重 #149