nebuly-ai / optimate

A collection of libraries to optimise AI model performances
https://www.nebuly.com/
Apache License 2.0
8.37k stars 643 forks source link

Why the time consumming is increased after using nebullvm in the GPT2 jupyter script? #55

Closed mali19064 closed 1 year ago

mali19064 commented 2 years ago

When I run the GPT2 jupyter script in https://github.com/nebuly-ai/nebullvm/blob/main/resources/notebooks/Accelerate-Hugging-Face-GPT2-and-BERT-with-nebullvm.ipynb, I have got the output below:

Hello, I'm username! I've tested nebullvm on the following setup: Hardware: Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz CPU and Tesla V100-SXM2-32GB GPU. Model: GPT2 - HuggingFace Tokens: 10

This is my environment: CUDA Version: 11.2 Python 3.7.5 numpy 1.19.0 torch 1.11.0 onnxruntime 1.11.1 nvidia-tensorrt 8.4.0.6 GPU: Tesla V100

This is all the information in the console after runing the scrpit:

runfile('/data/nlp/li.ma/CPM-Generate-Pytorch/nebullvm_GPT_demo.py', wdir='/data/nlp/li.ma/CPM-Generate-Pytorch') Average response time for GPT2: (10 tokens): 25.121240615844727 ms Average response time for GPT2: (181 tokens): 73.49021196365356 ms RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd ImportError: numpy.core.multiarray failed to import The above exception was the direct cause of the following exception: SystemError: returned a result with an error set /usr/local/lib/python3.7/dist-packages/defusedxml/init.py:30: DeprecationWarning: defusedxml.cElementTree is deprecated, import from defusedxml.ElementTree instead. from . import cElementTree Using pad_token, but it is not set yet. Ignore MatMul due to non constant B: /[MatMul_113] Ignore MatMul due to non constant B: /[MatMul_138] Ignore MatMul due to non constant B: /[MatMul_311] Ignore MatMul due to non constant B: /[MatMul_336] Ignore MatMul due to non constant B: /[MatMul_509] Ignore MatMul due to non constant B: /[MatMul_534] Ignore MatMul due to non constant B: /[MatMul_707] Ignore MatMul due to non constant B: /[MatMul_732] Ignore MatMul due to non constant B: /[MatMul_905] Ignore MatMul due to non constant B: /[MatMul_930] Ignore MatMul due to non constant B: /[MatMul_1103] Ignore MatMul due to non constant B: /[MatMul_1128] Ignore MatMul due to non constant B: /[MatMul_1301] Ignore MatMul due to non constant B: /[MatMul_1326] Ignore MatMul due to non constant B: /[MatMul_1499] Ignore MatMul due to non constant B: /[MatMul_1524] Ignore MatMul due to non constant B: /[MatMul_1697] Ignore MatMul due to non constant B: /[MatMul_1722] Ignore MatMul due to non constant B: /[MatMul_1895] Ignore MatMul due to non constant B: /[MatMul_1920] Ignore MatMul due to non constant B: /[MatMul_2093] Ignore MatMul due to non constant B: /[MatMul_2118] Ignore MatMul due to non constant B: /[MatMul_2291] Ignore MatMul due to non constant B: /[MatMul_2316] 2022-05-24 11:16:42.711719365 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1429_ReduceMax 2022-05-24 11:16:42.711826854 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1429_ReduceMin 2022-05-24 11:16:42.725020430 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.43_ReduceMax 2022-05-24 11:16:42.725076130 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.43_ReduceMin 2022-05-24 11:16:42.725096945 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2018_ReduceMax 2022-05-24 11:16:42.725118940 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2018_ReduceMin 2022-05-24 11:16:42.725139125 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_394_ReduceMax 2022-05-24 11:16:42.725160207 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_394_ReduceMin 2022-05-24 11:16:42.725179652 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2454_ReduceMax 2022-05-24 11:16:42.725199205 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2454_ReduceMin 2022-05-24 11:16:42.725221431 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_833_ReduceMax 2022-05-24 11:16:42.725240934 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_833_ReduceMin 2022-05-24 11:16:42.725580809 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3214_ReduceMax 2022-05-24 11:16:42.725602648 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3214_ReduceMin 2022-05-24 11:16:42.725619617 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2293_ReduceMax 2022-05-24 11:16:42.725672329 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2293_ReduceMin 2022-05-24 11:16:42.725691544 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2455_ReduceMax 2022-05-24 11:16:42.725709226 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2455_ReduceMin 2022-05-24 11:16:42.725730943 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2417_ReduceMax 2022-05-24 11:16:42.725749796 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2417_ReduceMin 2022-05-24 11:16:42.725767675 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1745_ReduceMax 2022-05-24 11:16:42.725794756 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1745_ReduceMin 2022-05-24 11:16:42.726284695 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3216_ReduceMax 2022-05-24 11:16:42.726634945 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3216_ReduceMin 2022-05-24 11:16:42.726675637 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.39_ReduceMax 2022-05-24 11:16:42.726710786 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.39_ReduceMin 2022-05-24 11:16:42.728635870 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3259_ReduceMax 2022-05-24 11:16:42.728695197 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3259_ReduceMin 2022-05-24 11:16:42.728741807 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.119_ReduceMax 2022-05-24 11:16:42.728776025 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.119_ReduceMin 2022-05-24 11:16:42.728820008 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_411_ReduceMax 2022-05-24 11:16:42.728848003 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_411_ReduceMin 2022-05-24 11:16:42.728909427 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1216_ReduceMax 2022-05-24 11:16:42.728993414 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1216_ReduceMin 2022-05-24 11:16:42.729034381 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3219_ReduceMax 2022-05-24 11:16:42.729065276 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3219_ReduceMin 2022-05-24 11:16:42.729102523 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_998_ReduceMax 2022-05-24 11:16:42.729142896 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_998_ReduceMin 2022-05-24 11:16:42.729172489 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_745_ReduceMax 2022-05-24 11:16:42.729206179 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_745_ReduceMin 2022-05-24 11:16:42.729238932 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2453_ReduceMax 2022-05-24 11:16:42.729270579 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2453_ReduceMin 2022-05-24 11:16:42.729311674 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.191_ReduceMax 2022-05-24 11:16:42.729352025 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.191_ReduceMin 2022-05-24 11:16:42.729385139 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_453_ReduceMax 2022-05-24 11:16:42.729434303 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_453_ReduceMin 2022-05-24 11:16:42.729473471 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2022_ReduceMax 2022-05-24 11:16:42.729502892 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2022_ReduceMin 2022-05-24 11:16:42.729532305 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1560_ReduceMax 2022-05-24 11:16:42.729565870 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1560_ReduceMin 2022-05-24 11:16:42.729595267 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3001_ReduceMax 2022-05-24 11:16:42.729643676 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3001_ReduceMin 2022-05-24 11:16:42.729695220 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.75_ReduceMax 2022-05-24 11:16:42.729729601 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.75_ReduceMin 2022-05-24 11:16:42.729764271 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3253_ReduceMax 2022-05-24 11:16:42.729801913 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3253_ReduceMin 2022-05-24 11:16:42.729843200 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3256_ReduceMax 2022-05-24 11:16:42.729886452 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3256_ReduceMin 2022-05-24 11:16:42.729930466 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.71_ReduceMax 2022-05-24 11:16:42.729959024 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.71_ReduceMin 2022-05-24 11:16:42.729989811 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.87_ReduceMax 2022-05-24 11:16:42.730021286 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.87_ReduceMin 2022-05-24 11:16:42.730051087 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2196_ReduceMax 2022-05-24 11:16:42.730078110 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2196_ReduceMin 2022-05-24 11:16:42.730130610 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2548_ReduceMax 2022-05-24 11:16:42.730171916 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2548_ReduceMin 2022-05-24 11:16:42.730202144 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2532_ReduceMax 2022-05-24 11:16:42.730233303 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2532_ReduceMin 2022-05-24 11:16:42.730268977 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_491_ReduceMax 2022-05-24 11:16:42.730299408 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_491_ReduceMin 2022-05-24 11:16:42.730331042 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.167_ReduceMax 2022-05-24 11:16:42.730362034 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.167_ReduceMin 2022-05-24 11:16:42.730396715 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.139_ReduceMax 2022-05-24 11:16:42.730428105 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.139_ReduceMin 2022-05-24 11:16:42.730461962 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1924_ReduceMax 2022-05-24 11:16:42.730493382 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1924_ReduceMin 2022-05-24 11:16:42.730530299 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1142_ReduceMax 2022-05-24 11:16:42.730561732 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1142_ReduceMin 2022-05-24 11:16:42.731305425 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3296_ReduceMax 2022-05-24 11:16:42.731351437 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3296_ReduceMin 2022-05-24 11:16:42.731385630 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1180_ReduceMax 2022-05-24 11:16:42.731417700 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1180_ReduceMin 2022-05-24 11:16:42.731447254 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2785_ReduceMax 2022-05-24 11:16:42.731478607 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2785_ReduceMin 2022-05-24 11:16:42.731513880 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1255_ReduceMax 2022-05-24 11:16:42.731545336 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1255_ReduceMin 2022-05-24 11:16:42.731578068 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3258_ReduceMax 2022-05-24 11:16:42.731615346 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3258_ReduceMin 2022-05-24 11:16:42.731657916 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.23_ReduceMax 2022-05-24 11:16:42.731689191 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.23_ReduceMin 2022-05-24 11:16:42.731718118 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2620_ReduceMax 2022-05-24 11:16:42.731750255 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2620_ReduceMin 2022-05-24 11:16:42.731801297 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.3_ReduceMax 2022-05-24 11:16:42.731835508 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.3_ReduceMin 2022-05-24 11:16:42.731867357 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_670_ReduceMax 2022-05-24 11:16:42.731909135 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_670_ReduceMin 2022-05-24 11:16:42.731943637 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_492_ReduceMax 2022-05-24 11:16:42.731974344 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_492_ReduceMin 2022-05-24 11:16:42.732004121 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.39_ReduceMax 2022-05-24 11:16:42.732038104 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.39_ReduceMin 2022-05-24 11:16:42.732085793 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1510_ReduceMax 2022-05-24 11:16:42.732138324 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1510_ReduceMin 2022-05-24 11:16:42.732173234 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_814_ReduceMax 2022-05-24 11:16:42.732210203 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_814_ReduceMin 2022-05-24 11:16:42.732260671 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.19_ReduceMax 2022-05-24 11:16:42.732294998 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.19_ReduceMin 2022-05-24 11:16:42.732328105 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.23_ReduceMax 2022-05-24 11:16:42.732356049 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.23_ReduceMin 2022-05-24 11:16:42.732394123 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.23_ReduceMax 2022-05-24 11:16:42.732428118 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.23_ReduceMin 2022-05-24 11:16:42.732457833 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1088_ReduceMax 2022-05-24 11:16:42.732490766 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1088_ReduceMin 2022-05-24 11:16:42.732519858 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3199_ReduceMax 2022-05-24 11:16:42.732550731 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3199_ReduceMin 2022-05-24 11:16:42.732580471 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1002_ReduceMax 2022-05-24 11:16:42.732610079 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1002_ReduceMin 2022-05-24 11:16:42.732638359 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_432_ReduceMax 2022-05-24 11:16:42.732682523 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_432_ReduceMin 2022-05-24 11:16:42.732720310 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1981_ReduceMax 2022-05-24 11:16:42.732763698 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1981_ReduceMin 2022-05-24 11:16:42.732819275 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.39_ReduceMax 2022-05-24 11:16:42.732856522 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.39_ReduceMin 2022-05-24 11:16:42.732886188 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_3162_ReduceMax 2022-05-24 11:16:42.732913684 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_3162_ReduceMin 2022-05-24 11:16:42.732949775 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_490_ReduceMax 2022-05-24 11:16:42.732980844 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_490_ReduceMin 2022-05-24 11:16:42.733013047 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1720_ReduceMax 2022-05-24 11:16:42.733058880 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1720_ReduceMin 2022-05-24 11:16:42.733099172 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2494_ReduceMax 2022-05-24 11:16:42.733153138 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2494_ReduceMin 2022-05-24 11:16:42.733189719 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2233_ReduceMax 2022-05-24 11:16:42.733237123 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2233_ReduceMin 2022-05-24 11:16:42.733296009 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2483_ReduceMax 2022-05-24 11:16:42.733344885 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2483_ReduceMin 2022-05-24 11:16:42.733386667 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1174_ReduceMax 2022-05-24 11:16:42.733413581 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1174_ReduceMin 2022-05-24 11:16:42.733443021 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2471_ReduceMax 2022-05-24 11:16:42.733471936 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2471_ReduceMin 2022-05-24 11:16:42.733514602 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2451_ReduceMax 2022-05-24 11:16:42.733541155 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2451_ReduceMin 2022-05-24 11:16:42.733571666 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1978_ReduceMax 2022-05-24 11:16:42.733621565 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1978_ReduceMin 2022-05-24 11:16:42.733661554 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1538_ReduceMax 2022-05-24 11:16:42.733702014 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1538_ReduceMin 2022-05-24 11:16:42.733736660 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_709_ReduceMax 2022-05-24 11:16:42.733786020 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_709_ReduceMin 2022-05-24 11:16:42.733822075 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.235_ReduceMax 2022-05-24 11:16:42.733854267 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.235_ReduceMin 2022-05-24 11:16:42.733899838 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.227_ReduceMax 2022-05-24 11:16:42.733931280 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.227_ReduceMin 2022-05-24 11:16:42.733966369 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2485_ReduceMax 2022-05-24 11:16:42.734015804 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2485_ReduceMin 2022-05-24 11:16:42.734063435 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2235_ReduceMax 2022-05-24 11:16:42.734123940 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2235_ReduceMin 2022-05-24 11:16:42.734166677 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2709_ReduceMax 2022-05-24 11:16:42.734200459 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2709_ReduceMin 2022-05-24 11:16:42.734247417 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2766_ReduceMax 2022-05-24 11:16:42.734279950 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2766_ReduceMin 2022-05-24 11:16:42.734309105 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_981_ReduceMax 2022-05-24 11:16:42.734341544 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_981_ReduceMin 2022-05-24 11:16:42.734370958 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_835_ReduceMax 2022-05-24 11:16:42.734402362 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_835_ReduceMin 2022-05-24 11:16:42.734459236 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.55_ReduceMax 2022-05-24 11:16:42.734480882 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.55_ReduceMin 2022-05-24 11:16:42.734502519 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1669_ReduceMax 2022-05-24 11:16:42.734525424 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1669_ReduceMin 2022-05-24 11:16:42.734547851 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3042_ReduceMax 2022-05-24 11:16:42.734567650 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3042_ReduceMin 2022-05-24 11:16:42.734587036 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.7_ReduceMax 2022-05-24 11:16:42.734609837 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.7_ReduceMin 2022-05-24 11:16:42.734629078 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_451_ReduceMax 2022-05-24 11:16:42.734672365 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_451_ReduceMin 2022-05-24 11:16:42.734700323 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2804_ReduceMax 2022-05-24 11:16:42.734732758 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2804_ReduceMin 2022-05-24 11:16:42.734755826 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_960_ReduceMax 2022-05-24 11:16:42.734791013 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_960_ReduceMin 2022-05-24 11:16:42.734818848 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2599_ReduceMax 2022-05-24 11:16:42.734842563 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2599_ReduceMin 2022-05-24 11:16:42.734861880 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.27_ReduceMax 2022-05-24 11:16:42.734885888 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.27_ReduceMin 2022-05-24 11:16:42.734907710 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_3068_ReduceMax 2022-05-24 11:16:42.734937195 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_3068_ReduceMin 2022-05-24 11:16:42.734974712 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2162_ReduceMax 2022-05-24 11:16:42.734995801 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2162_ReduceMin 2022-05-24 11:16:42.735015284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2493_ReduceMax 2022-05-24 11:16:42.735053333 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2493_ReduceMin 2022-05-24 11:16:42.735094956 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2907_ReduceMax 2022-05-24 11:16:42.735156540 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2907_ReduceMin 2022-05-24 11:16:42.735183309 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2689_ReduceMax 2022-05-24 11:16:42.735207268 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2689_ReduceMin 2022-05-24 11:16:42.735227793 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_285_ReduceMax 2022-05-24 11:16:42.735253442 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_285_ReduceMin 2022-05-24 11:16:42.735278405 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2491_ReduceMax 2022-05-24 11:16:42.735313214 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2491_ReduceMin 2022-05-24 11:16:42.735346271 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_233_ReduceMax 2022-05-24 11:16:42.735363954 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_233_ReduceMin 2022-05-24 11:16:42.735383516 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3252_ReduceMax 2022-05-24 11:16:42.735410125 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3252_ReduceMin 2022-05-24 11:16:42.735439901 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_3255_ReduceMax 2022-05-24 11:16:42.735468893 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_3255_ReduceMin 2022-05-24 11:16:42.735497612 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.31_ReduceMax 2022-05-24 11:16:42.735516148 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.31_ReduceMin 2022-05-24 11:16:42.735537066 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1632_ReduceMax 2022-05-24 11:16:42.735555775 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1632_ReduceMin 2022-05-24 11:16:42.735582690 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1793_ReduceMax 2022-05-24 11:16:42.735616665 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1793_ReduceMin 2022-05-24 11:16:42.735639297 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3058_ReduceMax 2022-05-24 11:16:42.735661789 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3058_ReduceMin 2022-05-24 11:16:42.735686207 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1962_ReduceMax 2022-05-24 11:16:42.735732475 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1962_ReduceMin 2022-05-24 11:16:42.735757944 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.7_ReduceMax 2022-05-24 11:16:42.735792785 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.7_ReduceMin 2022-05-24 11:16:42.735816730 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2142_ReduceMax 2022-05-24 11:16:42.735835090 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2142_ReduceMin 2022-05-24 11:16:42.735856375 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2020_ReduceMax 2022-05-24 11:16:42.735878346 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2020_ReduceMin 2022-05-24 11:16:42.735902347 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.3_ReduceMax 2022-05-24 11:16:42.735924822 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.3_ReduceMin 2022-05-24 11:16:42.735947062 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.203_ReduceMax 2022-05-24 11:16:42.735970553 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.203_ReduceMin 2022-05-24 11:16:42.735994802 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1091_ReduceMax 2022-05-24 11:16:42.736013314 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1091_ReduceMin 2022-05-24 11:16:42.736034520 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2344_ReduceMax 2022-05-24 11:16:42.736057169 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2344_ReduceMin 2022-05-24 11:16:42.736076469 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.11_ReduceMax 2022-05-24 11:16:42.736095599 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.11_ReduceMin 2022-05-24 11:16:42.736130401 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2982_ReduceMax 2022-05-24 11:16:42.736168797 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2982_ReduceMin 2022-05-24 11:16:42.736195193 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.43_ReduceMax 2022-05-24 11:16:42.736218005 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.43_ReduceMin 2022-05-24 11:16:42.736240047 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1668_ReduceMax 2022-05-24 11:16:42.736260507 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1668_ReduceMin 2022-05-24 11:16:42.736282170 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.135_ReduceMax 2022-05-24 11:16:42.736304597 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.135_ReduceMin 2022-05-24 11:16:42.736332586 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1688_ReduceMax 2022-05-24 11:16:42.736355768 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1688_ReduceMin 2022-05-24 11:16:42.736378646 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_454_ReduceMax 2022-05-24 11:16:42.736414528 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_454_ReduceMin 2022-05-24 11:16:42.736438704 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_666_ReduceMax 2022-05-24 11:16:42.736456714 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_666_ReduceMin 2022-05-24 11:16:42.736477681 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1907_ReduceMax 2022-05-24 11:16:42.736497142 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1907_ReduceMin 2022-05-24 11:16:42.736516157 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1690_ReduceMax 2022-05-24 11:16:42.736536500 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1690_ReduceMin 2022-05-24 11:16:42.736555015 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_235_ReduceMax 2022-05-24 11:16:42.736576280 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_235_ReduceMin 2022-05-24 11:16:42.736596935 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3040_ReduceMax 2022-05-24 11:16:42.736620049 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3040_ReduceMin 2022-05-24 11:16:42.736649954 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2995_ReduceMax 2022-05-24 11:16:42.736687072 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2995_ReduceMin 2022-05-24 11:16:42.736715410 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2959_ReduceMax 2022-05-24 11:16:42.736733369 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2959_ReduceMin 2022-05-24 11:16:42.736762056 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.175_ReduceMax 2022-05-24 11:16:42.736786698 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.175_ReduceMin 2022-05-24 11:16:42.736805838 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2228_ReduceMax 2022-05-24 11:16:42.736846494 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2228_ReduceMin 2022-05-24 11:16:42.736876642 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2787_ReduceMax 2022-05-24 11:16:42.736896308 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2787_ReduceMin 2022-05-24 11:16:42.736916155 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.47_ReduceMax 2022-05-24 11:16:42.736939465 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.47_ReduceMin 2022-05-24 11:16:42.736959869 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1090_ReduceMax 2022-05-24 11:16:42.736982499 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1090_ReduceMin 2022-05-24 11:16:42.737004433 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2490_ReduceMax 2022-05-24 11:16:42.737040298 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2490_ReduceMin 2022-05-24 11:16:42.737073821 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.87_ReduceMax 2022-05-24 11:16:42.737095681 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.87_ReduceMin 2022-05-24 11:16:42.737126869 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_617_ReduceMax 2022-05-24 11:16:42.737150115 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_617_ReduceMin 2022-05-24 11:16:42.737176622 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.99_ReduceMax 2022-05-24 11:16:42.737199711 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.99_ReduceMin 2022-05-24 11:16:42.737236801 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1471_ReduceMax 2022-05-24 11:16:42.737273876 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1471_ReduceMin 2022-05-24 11:16:42.737300961 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_3000_ReduceMax 2022-05-24 11:16:42.737344727 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_3000_ReduceMin 2022-05-24 11:16:42.737376817 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.67_ReduceMax 2022-05-24 11:16:42.737399937 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.67_ReduceMin 2022-05-24 11:16:42.737423008 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query_ReduceMax 2022-05-24 11:16:42.737446255 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query_ReduceMin 2022-05-24 11:16:42.737468321 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1598_ReduceMax 2022-05-24 11:16:42.737490663 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1598_ReduceMin 2022-05-24 11:16:42.737514783 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.51_ReduceMax 2022-05-24 11:16:42.737537441 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.51_ReduceMin 2022-05-24 11:16:42.737561672 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.195_ReduceMax 2022-05-24 11:16:42.737584087 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.195_ReduceMin 2022-05-24 11:16:42.737608069 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_443_ReduceMax 2022-05-24 11:16:42.737646241 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_443_ReduceMin 2022-05-24 11:16:42.737672807 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.115_ReduceMax 2022-05-24 11:16:42.737694825 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.115_ReduceMin 2022-05-24 11:16:42.737717349 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.47_ReduceMax 2022-05-24 11:16:42.737741628 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.47_ReduceMin 2022-05-24 11:16:42.737772452 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1723_ReduceMax 2022-05-24 11:16:42.737808063 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1723_ReduceMin 2022-05-24 11:16:42.737839631 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2688_ReduceMax 2022-05-24 11:16:42.737859053 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2688_ReduceMin 2022-05-24 11:16:42.737877871 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2781_ReduceMax 2022-05-24 11:16:42.737895545 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2781_ReduceMin 2022-05-24 11:16:42.737929433 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.11_ReduceMax 2022-05-24 11:16:42.737953313 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.11_ReduceMin 2022-05-24 11:16:42.737975388 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2048_ReduceMax 2022-05-24 11:16:42.738004667 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2048_ReduceMin 2022-05-24 11:16:42.738027589 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.155_ReduceMax 2022-05-24 11:16:42.738049654 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.155_ReduceMin 2022-05-24 11:16:42.738069770 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1746_ReduceMax 2022-05-24 11:16:42.738092968 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1746_ReduceMin 2022-05-24 11:16:42.738117931 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2961_ReduceMax 2022-05-24 11:16:42.738136623 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2961_ReduceMin 2022-05-24 11:16:42.738165112 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_648_ReduceMax 2022-05-24 11:16:42.738192709 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_648_ReduceMin 2022-05-24 11:16:42.738212788 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.127_ReduceMax 2022-05-24 11:16:42.738237383 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.127_ReduceMin 2022-05-24 11:16:42.738260510 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_904_ReduceMax 2022-05-24 11:16:42.738283019 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_904_ReduceMin 2022-05-24 11:16:42.738306709 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1256_ReduceMax 2022-05-24 11:16:42.738329506 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1256_ReduceMin 2022-05-24 11:16:42.738352924 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1761_ReduceMax 2022-05-24 11:16:42.738371308 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1761_ReduceMin 2022-05-24 11:16:42.738391334 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2997_ReduceMax 2022-05-24 11:16:42.738427089 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2997_ReduceMin 2022-05-24 11:16:42.738457022 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.55_ReduceMax 2022-05-24 11:16:42.738486213 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.55_ReduceMin 2022-05-24 11:16:42.738506485 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.63_ReduceMax 2022-05-24 11:16:42.738530437 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.63_ReduceMin 2022-05-24 11:16:42.738553386 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1601_ReduceMax 2022-05-24 11:16:42.738571973 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1601_ReduceMin 2022-05-24 11:16:42.738592897 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2835_ReduceMax 2022-05-24 11:16:42.738615855 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2835_ReduceMin 2022-05-24 11:16:42.738636476 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.7_ReduceMax 2022-05-24 11:16:42.738661911 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.7_ReduceMin 2022-05-24 11:16:42.738684264 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2255_ReduceMax 2022-05-24 11:16:42.738715091 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2255_ReduceMin 2022-05-24 11:16:42.738739710 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2746_ReduceMax 2022-05-24 11:16:42.738773661 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2746_ReduceMin 2022-05-24 11:16:42.738802317 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.55_ReduceMax 2022-05-24 11:16:42.738822238 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.55_ReduceMin 2022-05-24 11:16:42.738844181 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_632_ReduceMax 2022-05-24 11:16:42.738863880 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_632_ReduceMin 2022-05-24 11:16:42.738886010 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.95_ReduceMax 2022-05-24 11:16:42.738907743 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.95_ReduceMin 2022-05-24 11:16:42.738928151 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_964_ReduceMax 2022-05-24 11:16:42.738962459 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_964_ReduceMin 2022-05-24 11:16:42.738990837 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1208_ReduceMax 2022-05-24 11:16:42.739026657 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1208_ReduceMin 2022-05-24 11:16:42.739066014 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2001_ReduceMax 2022-05-24 11:16:42.739089282 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2001_ReduceMin 2022-05-24 11:16:42.739117640 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.15_ReduceMax 2022-05-24 11:16:42.739141676 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.15_ReduceMin 2022-05-24 11:16:42.739164820 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3250_ReduceMax 2022-05-24 11:16:42.739192134 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3250_ReduceMin 2022-05-24 11:16:42.739229474 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1686_ReduceMax 2022-05-24 11:16:42.739247259 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1686_ReduceMin 2022-05-24 11:16:42.739269198 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.67_ReduceMax 2022-05-24 11:16:42.739292458 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.67_ReduceMin 2022-05-24 11:16:42.739318096 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_664_ReduceMax 2022-05-24 11:16:42.739336071 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_664_ReduceMin 2022-05-24 11:16:42.739355558 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_509_ReduceMax 2022-05-24 11:16:42.739389184 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_509_ReduceMin 2022-05-24 11:16:42.739412668 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3220_ReduceMax 2022-05-24 11:16:42.739432395 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3220_ReduceMin 2022-05-24 11:16:42.739451457 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2743_ReduceMax 2022-05-24 11:16:42.739486261 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2743_ReduceMin 2022-05-24 11:16:42.739520224 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_518_ReduceMax 2022-05-24 11:16:42.739543328 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_518_ReduceMin 2022-05-24 11:16:42.739574970 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.151_ReduceMax 2022-05-24 11:16:42.739594137 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.151_ReduceMin 2022-05-24 11:16:42.739614921 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_415_ReduceMax 2022-05-24 11:16:42.739636382 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_415_ReduceMin 2022-05-24 11:16:42.739656258 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2657_ReduceMax 2022-05-24 11:16:42.739675289 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2657_ReduceMin 2022-05-24 11:16:42.739695467 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.27_ReduceMax 2022-05-24 11:16:42.739717064 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.27_ReduceMin 2022-05-24 11:16:42.739738975 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.39_ReduceMax 2022-05-24 11:16:42.739761286 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.39_ReduceMin 2022-05-24 11:16:42.739783022 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1707_ReduceMax 2022-05-24 11:16:42.739820577 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1707_ReduceMin 2022-05-24 11:16:42.739844970 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1722_ReduceMax 2022-05-24 11:16:42.739878866 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1722_ReduceMin 2022-05-24 11:16:42.739919482 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1491_ReduceMax 2022-05-24 11:16:42.739943577 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1491_ReduceMin 2022-05-24 11:16:42.739964099 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1856_ReduceMax 2022-05-24 11:16:42.739983039 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1856_ReduceMin 2022-05-24 11:16:42.740010229 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.59_ReduceMax 2022-05-24 11:16:42.740034108 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.59_ReduceMin 2022-05-24 11:16:42.740058471 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_764_ReduceMax 2022-05-24 11:16:42.740089836 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_764_ReduceMin 2022-05-24 11:16:42.740119054 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_686_ReduceMax 2022-05-24 11:16:42.740139555 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_686_ReduceMin 2022-05-24 11:16:42.740175104 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3248_ReduceMax 2022-05-24 11:16:42.740202041 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3248_ReduceMin 2022-05-24 11:16:42.740233393 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1122_ReduceMax 2022-05-24 11:16:42.740252492 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1122_ReduceMin 2022-05-24 11:16:42.740273195 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2217_ReduceMax 2022-05-24 11:16:42.740312188 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2217_ReduceMin 2022-05-24 11:16:42.740337005 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2238_ReduceMax 2022-05-24 11:16:42.740370565 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2238_ReduceMin 2022-05-24 11:16:42.740399182 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.31_ReduceMax 2022-05-24 11:16:42.740417626 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.31_ReduceMin 2022-05-24 11:16:42.740438942 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.207_ReduceMax 2022-05-24 11:16:42.740461344 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.207_ReduceMin 2022-05-24 11:16:42.740485282 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.143_ReduceMax 2022-05-24 11:16:42.740507686 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.143_ReduceMin 2022-05-24 11:16:42.740530350 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.3_ReduceMax 2022-05-24 11:16:42.740551462 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.3_ReduceMin 2022-05-24 11:16:42.740572237 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1018_ReduceMax 2022-05-24 11:16:42.740593200 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1018_ReduceMin 2022-05-24 11:16:42.740635648 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2397_ReduceMax 2022-05-24 11:16:42.740660546 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2397_ReduceMin 2022-05-24 11:16:42.740682046 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2472_ReduceMax 2022-05-24 11:16:42.740717659 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2472_ReduceMin 2022-05-24 11:16:42.740741637 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_508_ReduceMax 2022-05-24 11:16:42.740760678 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_508_ReduceMin 2022-05-24 11:16:42.740782342 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.23_ReduceMax 2022-05-24 11:16:42.740816215 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.23_ReduceMin 2022-05-24 11:16:42.740844005 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.11_ReduceMax 2022-05-24 11:16:42.740862821 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.11_ReduceMin 2022-05-24 11:16:42.740882453 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_708_ReduceMax 2022-05-24 11:16:42.740918383 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_708_ReduceMin 2022-05-24 11:16:42.740944617 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1251_ReduceMax 2022-05-24 11:16:42.740962447 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1251_ReduceMin 2022-05-24 11:16:42.740981266 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.11_ReduceMax 2022-05-24 11:16:42.741016291 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.11_ReduceMin 2022-05-24 11:16:42.741040256 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_702_ReduceMax 2022-05-24 11:16:42.741075521 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_702_ReduceMin 2022-05-24 11:16:42.741102644 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_581_ReduceMax 2022-05-24 11:16:42.741129135 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_581_ReduceMin 2022-05-24 11:16:42.741150426 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value_ReduceMax 2022-05-24 11:16:42.741174533 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value_ReduceMin 2022-05-24 11:16:42.741193843 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights_ReduceMax 2022-05-24 11:16:42.741212366 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights_ReduceMin 2022-05-24 11:16:42.741237838 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1853_ReduceMax 2022-05-24 11:16:42.741261477 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1853_ReduceMin 2022-05-24 11:16:42.741280345 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_414_ReduceMax 2022-05-24 11:16:42.741305330 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_414_ReduceMin 2022-05-24 11:16:42.741326256 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1765_ReduceMax 2022-05-24 11:16:42.741347748 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1765_ReduceMin 2022-05-24 11:16:42.741372443 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2111_ReduceMax 2022-05-24 11:16:42.741391156 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2111_ReduceMin 2022-05-24 11:16:42.741412387 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2511_ReduceMax 2022-05-24 11:16:42.741436200 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2511_ReduceMin 2022-05-24 11:16:42.741456031 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1343_ReduceMax 2022-05-24 11:16:42.741477296 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1343_ReduceMin 2022-05-24 11:16:42.741504067 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_961_ReduceMax 2022-05-24 11:16:42.741538580 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_961_ReduceMin 2022-05-24 11:16:42.741565764 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_488_ReduceMax 2022-05-24 11:16:42.741583350 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_488_ReduceMin 2022-05-24 11:16:42.741602430 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_362_ReduceMax 2022-05-24 11:16:42.741624823 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_362_ReduceMin 2022-05-24 11:16:42.741646441 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2434_ReduceMax 2022-05-24 11:16:42.741668492 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2434_ReduceMin 2022-05-24 11:16:42.741692493 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2927_ReduceMax 2022-05-24 11:16:42.741712851 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2927_ReduceMin 2022-05-24 11:16:42.741731927 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1377_ReduceMax 2022-05-24 11:16:42.741750623 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1377_ReduceMin 2022-05-24 11:16:42.741771409 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.11_ReduceMax 2022-05-24 11:16:42.741795219 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.11_ReduceMin 2022-05-24 11:16:42.741823995 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2944_ReduceMax 2022-05-24 11:16:42.741847582 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2944_ReduceMin 2022-05-24 11:16:42.741866967 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2786_ReduceMax 2022-05-24 11:16:42.741890153 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2786_ReduceMin 2022-05-24 11:16:42.741914694 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_471_ReduceMax 2022-05-24 11:16:42.741935991 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_471_ReduceMin 2022-05-24 11:16:42.741989752 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2740_ReduceMax 2022-05-24 11:16:42.742039874 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2740_ReduceMin 2022-05-24 11:16:42.742069997 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2365_ReduceMax 2022-05-24 11:16:42.742095649 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2365_ReduceMin 2022-05-24 11:16:42.742129345 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2200_ReduceMax 2022-05-24 11:16:42.742150713 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2200_ReduceMin 2022-05-24 11:16:42.742171468 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_669_ReduceMax 2022-05-24 11:16:42.742196919 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_669_ReduceMin 2022-05-24 11:16:42.742220066 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3109_ReduceMax 2022-05-24 11:16:42.742242750 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3109_ReduceMin 2022-05-24 11:16:42.742263759 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3038_ReduceMax 2022-05-24 11:16:42.742282373 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3038_ReduceMin 2022-05-24 11:16:42.742308722 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.31_ReduceMax 2022-05-24 11:16:42.742334195 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.31_ReduceMin 2022-05-24 11:16:42.742357167 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2039_ReduceMax 2022-05-24 11:16:42.742389351 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2039_ReduceMin 2022-05-24 11:16:42.742505446 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1019_ReduceMax 2022-05-24 11:16:42.742538653 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1019_ReduceMin 2022-05-24 11:16:42.742562356 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.7_ReduceMax 2022-05-24 11:16:42.742584636 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.7_ReduceMin 2022-05-24 11:16:42.742604393 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.79_ReduceMax 2022-05-24 11:16:42.742625704 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.79_ReduceMin 2022-05-24 11:16:42.742645331 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1763_ReduceMax 2022-05-24 11:16:42.742662433 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1763_ReduceMin 2022-05-24 11:16:42.742682248 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1435_ReduceMax 2022-05-24 11:16:42.742702773 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1435_ReduceMin 2022-05-24 11:16:42.742722086 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.103_ReduceMax 2022-05-24 11:16:42.742745229 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.103_ReduceMin 2022-05-24 11:16:42.742767137 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1511_ReduceMax 2022-05-24 11:16:42.742789125 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1511_ReduceMin 2022-05-24 11:16:42.742811450 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.163_ReduceMax 2022-05-24 11:16:42.742834980 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.163_ReduceMin 2022-05-24 11:16:42.742864021 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2038_ReduceMax 2022-05-24 11:16:42.742885721 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2038_ReduceMin 2022-05-24 11:16:42.742908855 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1197_ReduceMax 2022-05-24 11:16:42.742942000 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1197_ReduceMin 2022-05-24 11:16:42.742981002 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_445_ReduceMax 2022-05-24 11:16:42.743019196 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_445_ReduceMin 2022-05-24 11:16:42.743045636 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_649_ReduceMax 2022-05-24 11:16:42.743067470 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_649_ReduceMin 2022-05-24 11:16:42.743091345 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2621_ReduceMax 2022-05-24 11:16:42.743116937 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2621_ReduceMin 2022-05-24 11:16:42.743140897 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2558_ReduceMax 2022-05-24 11:16:42.743175076 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2558_ReduceMin 2022-05-24 11:16:42.743198392 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1235_ReduceMax 2022-05-24 11:16:42.743230752 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1235_ReduceMin 2022-05-24 11:16:42.743255525 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Mul_218_ReduceMax 2022-05-24 11:16:42.743273649 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Mul_218_ReduceMin 2022-05-24 11:16:42.743293420 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2108_ReduceMax 2022-05-24 11:16:42.743315401 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2108_ReduceMin 2022-05-24 11:16:42.743335000 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1512_ReduceMax 2022-05-24 11:16:42.743354802 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1512_ReduceMin 2022-05-24 11:16:42.743386905 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2876_ReduceMax 2022-05-24 11:16:42.743401626 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2876_ReduceMin 2022-05-24 11:16:42.743419835 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.171_ReduceMax 2022-05-24 11:16:42.743435412 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.171_ReduceMin 2022-05-24 11:16:42.743452946 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2216_ReduceMax 2022-05-24 11:16:42.743468685 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2216_ReduceMin 2022-05-24 11:16:42.743487175 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1467_ReduceMax 2022-05-24 11:16:42.743519689 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1467_ReduceMin 2022-05-24 11:16:42.743546605 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_612_ReduceMax 2022-05-24 11:16:42.743561501 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_612_ReduceMin 2022-05-24 11:16:42.743577581 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2256_ReduceMax 2022-05-24 11:16:42.743594544 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2256_ReduceMin 2022-05-24 11:16:42.743612795 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2021_ReduceMax 2022-05-24 11:16:42.743631423 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2021_ReduceMin 2022-05-24 11:16:42.743649739 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2854_ReduceMax 2022-05-24 11:16:42.743672274 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2854_ReduceMin 2022-05-24 11:16:42.743691681 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1689_ReduceMax 2022-05-24 11:16:42.743711584 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1689_ReduceMin 2022-05-24 11:16:42.743730298 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1834_ReduceMax 2022-05-24 11:16:42.743749176 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1834_ReduceMin 2022-05-24 11:16:42.743767994 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.87_ReduceMax 2022-05-24 11:16:42.743787478 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.87_ReduceMin 2022-05-24 11:16:42.743803596 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.231_ReduceMax 2022-05-24 11:16:42.743818592 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.231_ReduceMin 2022-05-24 11:16:42.743835382 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1980_ReduceMax 2022-05-24 11:16:42.743866449 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1980_ReduceMin 2022-05-24 11:16:42.743889291 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3218_ReduceMax 2022-05-24 11:16:42.743908077 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3218_ReduceMin 2022-05-24 11:16:42.743925905 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1766_ReduceMax 2022-05-24 11:16:42.743946575 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1766_ReduceMin 2022-05-24 11:16:42.743971603 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1213_ReduceMax 2022-05-24 11:16:42.744006051 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1213_ReduceMin 2022-05-24 11:16:42.744027818 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2749_ReduceMax 2022-05-24 11:16:42.744054247 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2749_ReduceMin 2022-05-24 11:16:42.744074842 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_3131_ReduceMax 2022-05-24 11:16:42.744089383 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_3131_ReduceMin 2022-05-24 11:16:42.744113719 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_304_ReduceMax 2022-05-24 11:16:42.744133502 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_304_ReduceMin 2022-05-24 11:16:42.744149626 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3293_ReduceMax 2022-05-24 11:16:42.744164582 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_3293_ReduceMin 2022-05-24 11:16:42.744179914 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1983_ReduceMax 2022-05-24 11:16:42.744214005 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1983_ReduceMin 2022-05-24 11:16:42.744235975 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.3_ReduceMax 2022-05-24 11:16:42.744266242 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.3_ReduceMin 2022-05-24 11:16:42.744285567 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1000_ReduceMax 2022-05-24 11:16:42.744306218 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1000_ReduceMin 2022-05-24 11:16:42.744326045 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.19_ReduceMax 2022-05-24 11:16:42.744342033 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.19_ReduceMin 2022-05-24 11:16:42.744362524 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.211_ReduceMax 2022-05-24 11:16:42.744378340 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.211_ReduceMin 2022-05-24 11:16:42.744400881 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.31_ReduceMax 2022-05-24 11:16:42.744421290 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.31_ReduceMin 2022-05-24 11:16:42.744441450 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2277_ReduceMax 2022-05-24 11:16:42.744457772 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2277_ReduceMin 2022-05-24 11:16:42.744479245 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1473_ReduceMax 2022-05-24 11:16:42.744511623 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1473_ReduceMin 2022-05-24 11:16:42.744535373 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2433_ReduceMax 2022-05-24 11:16:42.744551340 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2433_ReduceMin 2022-05-24 11:16:42.744567061 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2738_ReduceMax 2022-05-24 11:16:42.744598973 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2738_ReduceMin 2022-05-24 11:16:42.744621691 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_743_ReduceMax 2022-05-24 11:16:42.744635969 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_743_ReduceMin 2022-05-24 11:16:42.744651613 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2303_ReduceMax 2022-05-24 11:16:42.744681127 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2303_ReduceMin 2022-05-24 11:16:42.744699299 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_741_ReduceMax 2022-05-24 11:16:42.744714080 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_741_ReduceMin 2022-05-24 11:16:42.744729022 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1474_ReduceMax 2022-05-24 11:16:42.744756020 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1474_ReduceMin 2022-05-24 11:16:42.744775265 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1975_ReduceMax 2022-05-24 11:16:42.744805092 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1975_ReduceMin 2022-05-24 11:16:42.744827355 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1178_ReduceMax 2022-05-24 11:16:42.744846295 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1178_ReduceMin 2022-05-24 11:16:42.744864506 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.35_ReduceMax 2022-05-24 11:16:42.744884255 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.35_ReduceMin 2022-05-24 11:16:42.744905782 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_357_ReduceMax 2022-05-24 11:16:42.744920786 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_357_ReduceMin 2022-05-24 11:16:42.744936446 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1465_ReduceMax 2022-05-24 11:16:42.744969604 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1465_ReduceMin 2022-05-24 11:16:42.745000373 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_231_ReduceMax 2022-05-24 11:16:42.745014524 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_231_ReduceMin 2022-05-24 11:16:42.745029923 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_953_ReduceMax 2022-05-24 11:16:42.745064165 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_953_ReduceMin 2022-05-24 11:16:42.745085662 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.63_ReduceMax 2022-05-24 11:16:42.745104326 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.63_ReduceMin 2022-05-24 11:16:42.745135985 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.91_ReduceMax 2022-05-24 11:16:42.745157330 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.91_ReduceMin 2022-05-24 11:16:42.745177518 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1176_ReduceMax 2022-05-24 11:16:42.745216376 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1176_ReduceMin 2022-05-24 11:16:42.745233101 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2742_ReduceMax 2022-05-24 11:16:42.745269057 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2742_ReduceMin 2022-05-24 11:16:42.745292467 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2236_ReduceMax 2022-05-24 11:16:42.745326324 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2236_ReduceMin 2022-05-24 11:16:42.745348183 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1028_ReduceMax 2022-05-24 11:16:42.745376013 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1028_ReduceMin 2022-05-24 11:16:42.745397020 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1855_ReduceMax 2022-05-24 11:16:42.745416206 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1855_ReduceMin 2022-05-24 11:16:42.745435392 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_668_ReduceMax 2022-05-24 11:16:42.745453433 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_668_ReduceMin 2022-05-24 11:16:42.745471546 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1212_ReduceMax 2022-05-24 11:16:42.745503824 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1212_ReduceMin 2022-05-24 11:16:42.745525528 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.71_ReduceMax 2022-05-24 11:16:42.745543874 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.71_ReduceMin 2022-05-24 11:16:42.745561737 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.15_ReduceMax 2022-05-24 11:16:42.745595582 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.15_ReduceMin 2022-05-24 11:16:42.745620414 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_963_ReduceMax 2022-05-24 11:16:42.745656376 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_963_ReduceMin 2022-05-24 11:16:42.745678615 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1468_ReduceMax 2022-05-24 11:16:42.745714263 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1468_ReduceMin 2022-05-24 11:16:42.745737087 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2998_ReduceMax 2022-05-24 11:16:42.745766832 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2998_ReduceMin 2022-05-24 11:16:42.745820515 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2813_ReduceMax 2022-05-24 11:16:42.745847724 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_2813_ReduceMin 2022-05-24 11:16:42.745874736 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.7_ReduceMax 2022-05-24 11:16:42.745898455 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.7_ReduceMin 2022-05-24 11:16:42.745917206 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2402_ReduceMax 2022-05-24 11:16:42.745933109 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2402_ReduceMin 2022-05-24 11:16:42.745973151 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3291_ReduceMax 2022-05-24 11:16:42.745988795 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3291_ReduceMin 2022-05-24 11:16:42.746008238 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2179_ReduceMax 2022-05-24 11:16:42.746029592 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2179_ReduceMin 2022-05-24 11:16:42.746047099 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1652_ReduceMax 2022-05-24 11:16:42.746062823 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1652_ReduceMin 2022-05-24 11:16:42.746078861 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2528_ReduceMax 2022-05-24 11:16:42.746092961 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2528_ReduceMin 2022-05-24 11:16:42.746115609 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.27_ReduceMax 2022-05-24 11:16:42.746150685 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.27_ReduceMin 2022-05-24 11:16:42.746172401 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2232_ReduceMax 2022-05-24 11:16:42.746204270 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2232_ReduceMin 2022-05-24 11:16:42.746230199 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1324_ReduceMax 2022-05-24 11:16:42.746250818 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1324_ReduceMin 2022-05-24 11:16:42.746267495 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3036_ReduceMax 2022-05-24 11:16:42.746281804 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3036_ReduceMin 2022-05-24 11:16:42.746305848 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states_ReduceMax 2022-05-24 11:16:42.746340563 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states_ReduceMin 2022-05-24 11:16:42.746366195 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_941_ReduceMax 2022-05-24 11:16:42.746383353 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_941_ReduceMin 2022-05-24 11:16:42.746409661 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2993_ReduceMax 2022-05-24 11:16:42.746439015 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2993_ReduceMin 2022-05-24 11:16:42.746462179 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1728_ReduceMax 2022-05-24 11:16:42.746493452 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1728_ReduceMin 2022-05-24 11:16:42.746515650 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2981_ReduceMax 2022-05-24 11:16:42.746532240 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2981_ReduceMin 2022-05-24 11:16:42.746547199 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.43_ReduceMax 2022-05-24 11:16:42.746570694 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.43_ReduceMin 2022-05-24 11:16:42.746589845 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_705_ReduceMax 2022-05-24 11:16:42.746632913 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_705_ReduceMin 2022-05-24 11:16:42.746654397 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1726_ReduceMax 2022-05-24 11:16:42.746687524 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1726_ReduceMin 2022-05-24 11:16:42.746714491 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1815_ReduceMax 2022-05-24 11:16:42.746739105 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1815_ReduceMin 2022-05-24 11:16:42.746757861 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.7_ReduceMax 2022-05-24 11:16:42.746778259 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.7_ReduceMin 2022-05-24 11:16:42.746794128 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2275_ReduceMax 2022-05-24 11:16:42.746814501 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2275_ReduceMin 2022-05-24 11:16:42.746837352 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2549_ReduceMax 2022-05-24 11:16:42.746864088 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2549_ReduceMin 2022-05-24 11:16:42.746885635 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1470_ReduceMax 2022-05-24 11:16:42.746918364 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1470_ReduceMin 2022-05-24 11:16:42.746941009 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1600_ReduceMax 2022-05-24 11:16:42.746965418 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1600_ReduceMin 2022-05-24 11:16:42.746986408 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.23_ReduceMax 2022-05-24 11:16:42.747006075 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.23_ReduceMin 2022-05-24 11:16:42.747023995 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3021_ReduceMax 2022-05-24 11:16:42.747042797 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3021_ReduceMin 2022-05-24 11:16:42.747058351 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_747_ReduceMax 2022-05-24 11:16:42.747075178 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_747_ReduceMin 2022-05-24 11:16:42.747091240 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3128_ReduceMax 2022-05-24 11:16:42.747116692 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3128_ReduceMin 2022-05-24 11:16:42.747135118 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2510_ReduceMax 2022-05-24 11:16:42.747158158 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2510_ReduceMin 2022-05-24 11:16:42.747180522 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1706_ReduceMax 2022-05-24 11:16:42.747196697 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1706_ReduceMin 2022-05-24 11:16:42.747217626 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1196_ReduceMax 2022-05-24 11:16:42.747234316 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1196_ReduceMin 2022-05-24 11:16:42.747252937 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.71_ReduceMax 2022-05-24 11:16:42.747271364 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.71_ReduceMin 2022-05-24 11:16:42.747286896 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2325_ReduceMax 2022-05-24 11:16:42.747308732 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2325_ReduceMin 2022-05-24 11:16:42.747324447 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.183_ReduceMax 2022-05-24 11:16:42.747347859 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.183_ReduceMin 2022-05-24 11:16:42.747366144 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2943_ReduceMax 2022-05-24 11:16:42.747381688 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2943_ReduceMin 2022-05-24 11:16:42.747396490 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3041_ReduceMax 2022-05-24 11:16:42.747414564 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_3041_ReduceMin 2022-05-24 11:16:42.747433802 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_236_ReduceMax 2022-05-24 11:16:42.747454580 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_236_ReduceMin 2022-05-24 11:16:42.747471277 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_540_ReduceMax 2022-05-24 11:16:42.747491480 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_540_ReduceMin 2022-05-24 11:16:42.747517122 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.27_ReduceMax 2022-05-24 11:16:42.747536052 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.27_ReduceMin 2022-05-24 11:16:42.747553037 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.47_ReduceMax 2022-05-24 11:16:42.747572391 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.47_ReduceMin 2022-05-24 11:16:42.747588870 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_706_ReduceMax 2022-05-24 11:16:42.747618607 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_706_ReduceMin 2022-05-24 11:16:42.747661039 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3198_ReduceMax 2022-05-24 11:16:42.747677299 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3198_ReduceMin 2022-05-24 11:16:42.747693425 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.63_ReduceMax 2022-05-24 11:16:42.747711431 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.63_ReduceMin 2022-05-24 11:16:42.747726640 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1783_ReduceMax 2022-05-24 11:16:42.747746117 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1783_ReduceMin 2022-05-24 11:16:42.747761491 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2710_ReduceMax 2022-05-24 11:16:42.747777079 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2710_ReduceMin 2022-05-24 11:16:42.747792231 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1273_ReduceMax 2022-05-24 11:16:42.747808752 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1273_ReduceMin 2022-05-24 11:16:42.747824257 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2726_ReduceMax 2022-05-24 11:16:42.747839178 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2726_ReduceMin 2022-05-24 11:16:42.747857596 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2230_ReduceMax 2022-05-24 11:16:42.747890834 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2230_ReduceMin 2022-05-24 11:16:42.747912369 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1973_ReduceMax 2022-05-24 11:16:42.747943800 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1973_ReduceMin 2022-05-24 11:16:42.747966487 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.123_ReduceMax 2022-05-24 11:16:42.747984538 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.123_ReduceMin 2022-05-24 11:16:42.748002949 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1215_ReduceMax 2022-05-24 11:16:42.748036794 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1215_ReduceMin 2022-05-24 11:16:42.748058317 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3237_ReduceMax 2022-05-24 11:16:42.748079777 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3237_ReduceMin 2022-05-24 11:16:42.748101870 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_925_ReduceMax 2022-05-24 11:16:42.748125204 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_925_ReduceMin 2022-05-24 11:16:42.748154855 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1941_ReduceMax 2022-05-24 11:16:42.748170618 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1941_ReduceMin 2022-05-24 11:16:42.748186966 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.55_ReduceMax 2022-05-24 11:16:42.748206232 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.55_ReduceMin 2022-05-24 11:16:42.748224541 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key_ReduceMax 2022-05-24 11:16:42.748244230 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key_ReduceMin 2022-05-24 11:16:42.748262349 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_323_ReduceMax 2022-05-24 11:16:42.748280755 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_323_ReduceMin 2022-05-24 11:16:42.748298218 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.39_ReduceMax 2022-05-24 11:16:42.748314186 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.39_ReduceMin 2022-05-24 11:16:42.748331629 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1253_ReduceMax 2022-05-24 11:16:42.748346125 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1253_ReduceMin 2022-05-24 11:16:42.748364767 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1725_ReduceMax 2022-05-24 11:16:42.748399310 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_1725_ReduceMin 2022-05-24 11:16:42.748421429 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2363_ReduceMax 2022-05-24 11:16:42.748437795 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2363_ReduceMin 2022-05-24 11:16:42.748456404 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.83_ReduceMax 2022-05-24 11:16:42.748476748 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.83_ReduceMin 2022-05-24 11:16:42.748493023 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2727_ReduceMax 2022-05-24 11:16:42.748526945 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2727_ReduceMin 2022-05-24 11:16:42.748550429 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2531_ReduceMax 2022-05-24 11:16:42.748573543 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2531_ReduceMin 2022-05-24 11:16:42.748595339 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_996_ReduceMax 2022-05-24 11:16:42.748610080 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_996_ReduceMin 2022-05-24 11:16:42.748626200 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2765_ReduceMax 2022-05-24 11:16:42.748648687 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2765_ReduceMin 2022-05-24 11:16:42.748674785 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Reshape_3297_ReduceMax 2022-05-24 11:16:42.748699977 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Reshape_3297_ReduceMin 2022-05-24 11:16:42.748718280 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3090_ReduceMax 2022-05-24 11:16:42.748738336 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_3090_ReduceMin 2022-05-24 11:16:42.748757244 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.35_ReduceMax 2022-05-24 11:16:42.748777226 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.35_ReduceMin 2022-05-24 11:16:42.748796508 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_409_ReduceMax 2022-05-24 11:16:42.748810681 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_409_ReduceMin 2022-05-24 11:16:42.748827539 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.35_ReduceMax 2022-05-24 11:16:42.748846310 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.35_ReduceMin 2022-05-24 11:16:42.748872586 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2875_ReduceMax 2022-05-24 11:16:42.748891936 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2875_ReduceMin 2022-05-24 11:16:42.748910071 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2194_ReduceMax 2022-05-24 11:16:42.748924893 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2194_ReduceMin 2022-05-24 11:16:42.748943313 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_698_ReduceMax 2022-05-24 11:16:42.748979747 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_698_ReduceMin 2022-05-24 11:16:42.749000829 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_393_ReduceMax 2022-05-24 11:16:42.749016400 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_393_ReduceMin 2022-05-24 11:16:42.749032172 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_957_ReduceMax 2022-05-24 11:16:42.749065810 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_957_ReduceMin 2022-05-24 11:16:42.749087608 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2580_ReduceMax 2022-05-24 11:16:42.749112498 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2580_ReduceMin 2022-05-24 11:16:42.749132133 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.31_ReduceMax 2022-05-24 11:16:42.749151751 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.31_ReduceMin 2022-05-24 11:16:42.749168541 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_3167_ReduceMax 2022-05-24 11:16:42.749185973 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_3167_ReduceMin 2022-05-24 11:16:42.749214515 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_470_ReduceMax 2022-05-24 11:16:42.749240302 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_470_ReduceMin 2022-05-24 11:16:42.749264919 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1463_ReduceMax 2022-05-24 11:16:42.749297863 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1463_ReduceMin 2022-05-24 11:16:42.749319313 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2963_ReduceMax 2022-05-24 11:16:42.749338663 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2963_ReduceMin 2022-05-24 11:16:42.749357496 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1508_ReduceMax 2022-05-24 11:16:42.749371973 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1508_ReduceMin 2022-05-24 11:16:42.749388275 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2803_ReduceMax 2022-05-24 11:16:42.749403823 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2803_ReduceMin 2022-05-24 11:16:42.749422939 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2873_ReduceMax 2022-05-24 11:16:42.749443599 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2873_ReduceMin 2022-05-24 11:16:42.749458885 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.43_ReduceMax 2022-05-24 11:16:42.749478051 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.43_ReduceMin 2022-05-24 11:16:42.749496585 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_919_ReduceMax 2022-05-24 11:16:42.749510565 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_919_ReduceMin 2022-05-24 11:16:42.749526329 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2271_ReduceMax 2022-05-24 11:16:42.749540046 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2271_ReduceMin 2022-05-24 11:16:42.749555802 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3295_ReduceMax 2022-05-24 11:16:42.749573230 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3295_ReduceMin 2022-05-24 11:16:42.749592239 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_887_ReduceMax 2022-05-24 11:16:42.749615786 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_887_ReduceMin 2022-05-24 11:16:42.749632479 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_237_ReduceMax 2022-05-24 11:16:42.749652293 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_237_ReduceMin 2022-05-24 11:16:42.749668111 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2366_ReduceMax 2022-05-24 11:16:42.749683252 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_2366_ReduceMin 2022-05-24 11:16:42.749700166 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_450_ReduceMax 2022-05-24 11:16:42.749732130 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_450_ReduceMin 2022-05-24 11:16:42.749753257 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1382_ReduceMax 2022-05-24 11:16:42.749771442 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1382_ReduceMin 2022-05-24 11:16:42.749787033 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1977_ReduceMax 2022-05-24 11:16:42.749820033 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1977_ReduceMin 2022-05-24 11:16:42.749842106 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_263_ReduceMax 2022-05-24 11:16:42.749868054 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_263_ReduceMin 2022-05-24 11:16:42.749888120 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1939_ReduceMax 2022-05-24 11:16:42.749902623 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1939_ReduceMin 2022-05-24 11:16:42.749918735 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.15_ReduceMax 2022-05-24 11:16:42.749936313 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.15_ReduceMin 2022-05-24 11:16:42.749963357 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1434_ReduceMax 2022-05-24 11:16:42.749985969 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1434_ReduceMin 2022-05-24 11:16:42.750004104 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1528_ReduceMax 2022-05-24 11:16:42.750022453 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1528_ReduceMin 2022-05-24 11:16:42.750040979 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_253_ReduceMax 2022-05-24 11:16:42.750056823 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_253_ReduceMin 2022-05-24 11:16:42.750073747 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1179_ReduceMax 2022-05-24 11:16:42.750093637 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1179_ReduceMin 2022-05-24 11:16:42.750123143 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_687_ReduceMax 2022-05-24 11:16:42.750159605 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_687_ReduceMin 2022-05-24 11:16:42.750181408 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2530_ReduceMax 2022-05-24 11:16:42.750200002 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2530_ReduceMin 2022-05-24 11:16:42.750218340 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2526_ReduceMax 2022-05-24 11:16:42.750232609 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2526_ReduceMin 2022-05-24 11:16:42.750248070 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_903_ReduceMax 2022-05-24 11:16:42.750263925 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_903_ReduceMin 2022-05-24 11:16:42.750279586 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.27_ReduceMax 2022-05-24 11:16:42.750299471 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.27_ReduceMin 2022-05-24 11:16:42.750325117 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2016_ReduceMax 2022-05-24 11:16:42.750339284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2016_ReduceMin 2022-05-24 11:16:42.750356352 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1767_ReduceMax 2022-05-24 11:16:42.750371375 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1767_ReduceMin 2022-05-24 11:16:42.750393054 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.79_ReduceMax 2022-05-24 11:16:42.750410976 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.79_ReduceMin 2022-05-24 11:16:42.750429216 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2488_ReduceMax 2022-05-24 11:16:42.750463500 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2488_ReduceMin 2022-05-24 11:16:42.750491520 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1944_ReduceMax 2022-05-24 11:16:42.750510657 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1944_ReduceMin 2022-05-24 11:16:42.750533934 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1961_ReduceMax 2022-05-24 11:16:42.750550526 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1961_ReduceMin 2022-05-24 11:16:42.750565958 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.111_ReduceMax 2022-05-24 11:16:42.750580667 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.111_ReduceMin 2022-05-24 11:16:42.750596647 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_700_ReduceMax 2022-05-24 11:16:42.750628103 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_700_ReduceMin 2022-05-24 11:16:42.750649251 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_325_ReduceMax 2022-05-24 11:16:42.750667968 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_325_ReduceMin 2022-05-24 11:16:42.750685100 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.19_ReduceMax 2022-05-24 11:16:42.750703085 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.19_ReduceMin 2022-05-24 11:16:42.750720639 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_413_ReduceMax 2022-05-24 11:16:42.750740668 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_413_ReduceMin 2022-05-24 11:16:42.750757903 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.91_ReduceMax 2022-05-24 11:16:42.750773611 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.91_ReduceMin 2022-05-24 11:16:42.750793516 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.23_ReduceMax 2022-05-24 11:16:42.750811292 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.23_ReduceMin 2022-05-24 11:16:42.750828277 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_377_ReduceMax 2022-05-24 11:16:42.750843879 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_377_ReduceMin 2022-05-24 11:16:42.750869480 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1784_ReduceMax 2022-05-24 11:16:42.750895179 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1784_ReduceMin 2022-05-24 11:16:42.750914994 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.19_ReduceMax 2022-05-24 11:16:42.750932674 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output.19_ReduceMin 2022-05-24 11:16:42.750949983 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2000_ReduceMax 2022-05-24 11:16:42.750976281 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2000_ReduceMin 2022-05-24 11:16:42.750999045 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_773_ReduceMax 2022-05-24 11:16:42.751025284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_773_ReduceMin 2022-05-24 11:16:42.751045110 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.71_ReduceMax 2022-05-24 11:16:42.751064160 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.71_ReduceMin 2022-05-24 11:16:42.751079367 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1305_ReduceMax 2022-05-24 11:16:42.751098246 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1305_ReduceMin 2022-05-24 11:16:42.751121718 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.15_ReduceMax 2022-05-24 11:16:42.751138435 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.15_ReduceMin 2022-05-24 11:16:42.751155121 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_448_ReduceMax 2022-05-24 11:16:42.751189067 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_448_ReduceMin 2022-05-24 11:16:42.751210831 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2294_ReduceMax 2022-05-24 11:16:42.751238509 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_2294_ReduceMin 2022-05-24 11:16:42.751264616 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3275_ReduceMax 2022-05-24 11:16:42.751286340 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3275_ReduceMin 2022-05-24 11:16:42.751310244 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1637_ReduceMax 2022-05-24 11:16:42.751326689 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1637_ReduceMin 2022-05-24 11:16:42.751350637 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.59_ReduceMax 2022-05-24 11:16:42.751370670 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.59_ReduceMin 2022-05-24 11:16:42.751393482 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.247_ReduceMax 2022-05-24 11:16:42.751412217 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.247_ReduceMin 2022-05-24 11:16:42.751429823 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2110_ReduceMax 2022-05-24 11:16:42.751450483 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_2110_ReduceMin 2022-05-24 11:16:42.751467797 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_703_ReduceMax 2022-05-24 11:16:42.751498819 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_703_ReduceMin 2022-05-24 11:16:42.751520335 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1529_ReduceMax 2022-05-24 11:16:42.751547890 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1529_ReduceMin 2022-05-24 11:16:42.751567776 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_867_ReduceMax 2022-05-24 11:16:42.751583119 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_867_ReduceMin 2022-05-24 11:16:42.751599926 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1579_ReduceMax 2022-05-24 11:16:42.751620045 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1579_ReduceMin 2022-05-24 11:16:42.751636316 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_559_ReduceMax 2022-05-24 11:16:42.751658894 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_559_ReduceMin 2022-05-24 11:16:42.751681336 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.215_ReduceMax 2022-05-24 11:16:42.751700533 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.215_ReduceMin 2022-05-24 11:16:42.751719618 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_3130_ReduceMax 2022-05-24 11:16:42.751739229 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_3130_ReduceMin 2022-05-24 11:16:42.751758049 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2618_ReduceMax 2022-05-24 11:16:42.751781788 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2618_ReduceMin 2022-05-24 11:16:42.751804773 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_447_ReduceMax 2022-05-24 11:16:42.751839216 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_447_ReduceMin 2022-05-24 11:16:42.751860508 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.7_ReduceMax 2022-05-24 11:16:42.751875553 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.7_ReduceMin 2022-05-24 11:16:42.751891529 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2449_ReduceMax 2022-05-24 11:16:42.751906422 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2449_ReduceMin 2022-05-24 11:16:42.751922547 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.39_ReduceMax 2022-05-24 11:16:42.751938124 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.39_ReduceMin 2022-05-24 11:16:42.751955826 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.223_ReduceMax 2022-05-24 11:16:42.751974192 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.223_ReduceMin 2022-05-24 11:16:42.751992963 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1892_ReduceMax 2022-05-24 11:16:42.752009068 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1892_ReduceMin 2022-05-24 11:16:42.752025142 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_795_ReduceMax 2022-05-24 11:16:42.752045099 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_795_ReduceMin 2022-05-24 11:16:42.752066580 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_578_ReduceMax 2022-05-24 11:16:42.752086761 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_578_ReduceMin 2022-05-24 11:16:42.752109512 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_923_ReduceMax 2022-05-24 11:16:42.752130166 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_923_ReduceMin 2022-05-24 11:16:42.752148657 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1945_ReduceMax 2022-05-24 11:16:42.752164999 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1945_ReduceMin 2022-05-24 11:16:42.752183795 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1210_ReduceMax 2022-05-24 11:16:42.752217006 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1210_ReduceMin 2022-05-24 11:16:42.752238541 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.75_ReduceMax 2022-05-24 11:16:42.752256742 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.75_ReduceMin 2022-05-24 11:16:42.752273003 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2070_ReduceMax 2022-05-24 11:16:42.752293680 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2070_ReduceMin 2022-05-24 11:16:42.752311350 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1923_ReduceMax 2022-05-24 11:16:42.752332014 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1923_ReduceMin 2022-05-24 11:16:42.752351116 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1050_ReduceMax 2022-05-24 11:16:42.752370530 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1050_ReduceMin 2022-05-24 11:16:42.752391727 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2199_ReduceMax 2022-05-24 11:16:42.752413339 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2199_ReduceMin 2022-05-24 11:16:42.752431252 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1431_ReduceMax 2022-05-24 11:16:42.752446191 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_1431_ReduceMin 2022-05-24 11:16:42.752461545 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1219_ReduceMax 2022-05-24 11:16:42.752485780 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1219_ReduceMin 2022-05-24 11:16:42.752506324 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_763_ReduceMax 2022-05-24 11:16:42.752522420 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_763_ReduceMin 2022-05-24 11:16:42.752540392 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1274_ReduceMax 2022-05-24 11:16:42.752567516 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1274_ReduceMin 2022-05-24 11:16:42.752586657 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_580_ReduceMax 2022-05-24 11:16:42.752605601 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_580_ReduceMin 2022-05-24 11:16:42.752623973 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.107_ReduceMax 2022-05-24 11:16:42.752642486 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.107_ReduceMin 2022-05-24 11:16:42.752661124 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_872_ReduceMax 2022-05-24 11:16:42.752677284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_872_ReduceMin 2022-05-24 11:16:42.752694394 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.19_ReduceMax 2022-05-24 11:16:42.752728845 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.19_ReduceMin 2022-05-24 11:16:42.752754675 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3059_ReduceMax 2022-05-24 11:16:42.752782938 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3059_ReduceMin 2022-05-24 11:16:42.752804705 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.79_ReduceMax 2022-05-24 11:16:42.752824974 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.79_ReduceMin 2022-05-24 11:16:42.752842559 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_836_ReduceMax 2022-05-24 11:16:42.752862509 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_836_ReduceMin 2022-05-24 11:16:42.752883378 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_221_ReduceMax 2022-05-24 11:16:42.752902032 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_221_ReduceMin 2022-05-24 11:16:42.752929456 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_726_ReduceMax 2022-05-24 11:16:42.752947415 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_726_ReduceMin 2022-05-24 11:16:42.752965311 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.87_ReduceMax 2022-05-24 11:16:42.752983849 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.87_ReduceMin 2022-05-24 11:16:42.753004104 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2706_ReduceMax 2022-05-24 11:16:42.753018529 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2706_ReduceMin 2022-05-24 11:16:42.753034427 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2672_ReduceMax 2022-05-24 11:16:42.753050124 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2672_ReduceMin 2022-05-24 11:16:42.753079330 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.31_ReduceMax 2022-05-24 11:16:42.753121446 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.31_ReduceMin 2022-05-24 11:16:42.753143789 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1346_ReduceMax 2022-05-24 11:16:42.753164047 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_1346_ReduceMin 2022-05-24 11:16:42.753181091 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1490_ReduceMax 2022-05-24 11:16:42.753205740 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1490_ReduceMin 2022-05-24 11:16:42.753243316 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1236_ReduceMax 2022-05-24 11:16:42.753262827 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1236_ReduceMin 2022-05-24 11:16:42.753281001 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_222_ReduceMax 2022-05-24 11:16:42.753299248 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_222_ReduceMin 2022-05-24 11:16:42.753316780 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3004_ReduceMax 2022-05-24 11:16:42.753339389 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3004_ReduceMin 2022-05-24 11:16:42.753359231 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1452_ReduceMax 2022-05-24 11:16:42.753390399 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1452_ReduceMin 2022-05-24 11:16:42.753410889 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2276_ReduceMax 2022-05-24 11:16:42.753433881 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2276_ReduceMin 2022-05-24 11:16:42.753452420 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_725_ReduceMax 2022-05-24 11:16:42.753481474 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_725_ReduceMin 2022-05-24 11:16:42.753502775 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.179_ReduceMax 2022-05-24 11:16:42.753524056 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.179_ReduceMin 2022-05-24 11:16:42.753543228 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attention_mask_ReduceMax 2022-05-24 11:16:42.753557946 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attention_mask_ReduceMin 2022-05-24 11:16:42.753577672 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_921_ReduceMax 2022-05-24 11:16:42.753595485 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_921_ReduceMin 2022-05-24 11:16:42.753612164 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1257_ReduceMax 2022-05-24 11:16:42.753628489 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1257_ReduceMin 2022-05-24 11:16:42.753645988 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.243_ReduceMax 2022-05-24 11:16:42.753667355 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.243_ReduceMin 2022-05-24 11:16:42.753686724 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2965_ReduceMax 2022-05-24 11:16:42.753702743 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2965_ReduceMin 2022-05-24 11:16:42.753721229 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.239_ReduceMax 2022-05-24 11:16:42.753741866 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.239_ReduceMin 2022-05-24 11:16:42.753759553 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.31_ReduceMax 2022-05-24 11:16:42.753778778 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.31_ReduceMin 2022-05-24 11:16:42.753796595 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_746_ReduceMax 2022-05-24 11:16:42.753814838 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_746_ReduceMin 2022-05-24 11:16:42.753832378 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2178_ReduceMax 2022-05-24 11:16:42.753849870 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_2178_ReduceMin 2022-05-24 11:16:42.753865869 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1943_ReduceMax 2022-05-24 11:16:42.753885673 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1943_ReduceMin 2022-05-24 11:16:42.753904284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1069_ReduceMax 2022-05-24 11:16:42.753923158 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_1069_ReduceMin 2022-05-24 11:16:42.753940478 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output_ReduceMax 2022-05-24 11:16:42.753959449 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_output_ReduceMin 2022-05-24 11:16:42.753976916 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.15_ReduceMax 2022-05-24 11:16:42.753995191 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.15_ReduceMin 2022-05-24 11:16:42.754015180 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.219_ReduceMax 2022-05-24 11:16:42.754035321 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.219_ReduceMin 2022-05-24 11:16:42.754053115 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2704_ReduceMax 2022-05-24 11:16:42.754067576 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2704_ReduceMin 2022-05-24 11:16:42.754082937 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1127_ReduceMax 2022-05-24 11:16:42.754102085 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_1127_ReduceMin 2022-05-24 11:16:42.754126117 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.15_ReduceMax 2022-05-24 11:16:42.754146078 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output key.15_ReduceMin 2022-05-24 11:16:42.754163712 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1984_ReduceMax 2022-05-24 11:16:42.754184404 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1984_ReduceMin 2022-05-24 11:16:42.754206024 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_955_ReduceMax 2022-05-24 11:16:42.754239815 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_955_ReduceMin 2022-05-24 11:16:42.754261211 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1414_ReduceMax 2022-05-24 11:16:42.754281232 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1414_ReduceMin 2022-05-24 11:16:42.754299021 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2964_ReduceMax 2022-05-24 11:16:42.754318067 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2964_ReduceMin 2022-05-24 11:16:42.754343233 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1283_ReduceMax 2022-05-24 11:16:42.754369294 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Split_1283_ReduceMin 2022-05-24 11:16:42.754390323 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2089_ReduceMax 2022-05-24 11:16:42.754413825 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Transpose_2089_ReduceMin 2022-05-24 11:16:42.754432052 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_942_ReduceMax 2022-05-24 11:16:42.754465211 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_942_ReduceMin 2022-05-24 11:16:42.754490971 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_326_ReduceMax 2022-05-24 11:16:42.754507304 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Div_326_ReduceMin 2022-05-24 11:16:42.754524541 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1001_ReduceMax 2022-05-24 11:16:42.754545777 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1001_ReduceMin 2022-05-24 11:16:42.754563410 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2487_ReduceMax 2022-05-24 11:16:42.754597103 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_2487_ReduceMin 2022-05-24 11:16:42.754618445 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.159_ReduceMax 2022-05-24 11:16:42.754640235 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.159_ReduceMin 2022-05-24 11:16:42.754658396 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.39_ReduceMax 2022-05-24 11:16:42.754691655 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output hidden_states.39_ReduceMin 2022-05-24 11:16:42.754713717 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.131_ReduceMax 2022-05-24 11:16:42.754729160 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.131_ReduceMin 2022-05-24 11:16:42.754745340 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2745_ReduceMax 2022-05-24 11:16:42.754781690 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Tanh_2745_ReduceMin 2022-05-24 11:16:42.754803957 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.35_ReduceMax 2022-05-24 11:16:42.754819295 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.35_ReduceMin 2022-05-24 11:16:42.754836339 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.35_ReduceMax 2022-05-24 11:16:42.754855468 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.35_ReduceMin 2022-05-24 11:16:42.754873963 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2147_ReduceMax 2022-05-24 11:16:42.754890820 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2147_ReduceMin 2022-05-24 11:16:42.754908827 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1159_ReduceMax 2022-05-24 11:16:42.754926631 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_1159_ReduceMin 2022-05-24 11:16:42.754943562 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.147_ReduceMax 2022-05-24 11:16:42.754966537 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.147_ReduceMin 2022-05-24 11:16:42.755001989 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1413_ReduceMax 2022-05-24 11:16:42.755018405 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1413_ReduceMin 2022-05-24 11:16:42.755034136 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.51_ReduceMax 2022-05-24 11:16:42.755049476 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output input.51_ReduceMin 2022-05-24 11:16:42.755065252 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1433_ReduceMax 2022-05-24 11:16:42.755084495 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1433_ReduceMin 2022-05-24 11:16:42.755101968 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_958_ReduceMax 2022-05-24 11:16:42.755147669 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_958_ReduceMin 2022-05-24 11:16:42.755169075 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3020_ReduceMax 2022-05-24 11:16:42.755189333 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3020_ReduceMin 2022-05-24 11:16:42.755226074 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2783_ReduceMax 2022-05-24 11:16:42.755241597 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2783_ReduceMin 2022-05-24 11:16:42.755277645 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3003_ReduceMax 2022-05-24 11:16:42.755312822 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_3003_ReduceMin 2022-05-24 11:16:42.755335744 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2198_ReduceMax 2022-05-24 11:16:42.755354216 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2198_ReduceMin 2022-05-24 11:16:42.755376696 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2239_ReduceMax 2022-05-24 11:16:42.755403830 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_2239_ReduceMin 2022-05-24 11:16:42.755425323 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1718_ReduceMax 2022-05-24 11:16:42.755460255 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1718_ReduceMin 2022-05-24 11:16:42.755481217 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_254_ReduceMax 2022-05-24 11:16:42.755510726 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_254_ReduceMin 2022-05-24 11:16:42.755534812 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3236_ReduceMax 2022-05-24 11:16:42.755550479 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_3236_ReduceMin 2022-05-24 11:16:42.755568128 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.23_ReduceMax 2022-05-24 11:16:42.755587696 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.23_ReduceMin 2022-05-24 11:16:42.755604220 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_486_ReduceMax 2022-05-24 11:16:42.755619500 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_486_ReduceMin 2022-05-24 11:16:42.755635174 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2273_ReduceMax 2022-05-24 11:16:42.755649300 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Sqrt_2273_ReduceMin 2022-05-24 11:16:42.755664852 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.43_ReduceMax 2022-05-24 11:16:42.755680789 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output attn_weights.43_ReduceMin 2022-05-24 11:16:42.755697451 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1729_ReduceMax 2022-05-24 11:16:42.755723444 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1729_ReduceMin 2022-05-24 11:16:42.755744813 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_924_ReduceMax 2022-05-24 11:16:42.755762874 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_924_ReduceMin 2022-05-24 11:16:42.755785351 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1684_ReduceMax 2022-05-24 11:16:42.755800885 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1684_ReduceMin 2022-05-24 11:16:42.755816911 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1345_ReduceMax 2022-05-24 11:16:42.755837860 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::MatMul_1345_ReduceMin 2022-05-24 11:16:42.755855546 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_431_ReduceMax 2022-05-24 11:16:42.755872351 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_431_ReduceMin 2022-05-24 11:16:42.755891299 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.187_ReduceMax 2022-05-24 11:16:42.755910419 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.187_ReduceMin 2022-05-24 11:16:42.755928646 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.15_ReduceMax 2022-05-24 11:16:42.755947082 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.15_ReduceMin 2022-05-24 11:16:42.755968283 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2652_ReduceMax 2022-05-24 11:16:42.755985591 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_2652_ReduceMin 2022-05-24 11:16:42.756005301 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2708_ReduceMax 2022-05-24 11:16:42.756026653 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2708_ReduceMin 2022-05-24 11:16:42.756052280 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.83_ReduceMax 2022-05-24 11:16:42.756072249 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output query.83_ReduceMin 2022-05-24 11:16:42.756093686 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2912_ReduceMax 2022-05-24 11:16:42.756119052 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Shape_2912_ReduceMin 2022-05-24 11:16:42.756142721 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1451_ReduceMax 2022-05-24 11:16:42.756159066 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1451_ReduceMin 2022-05-24 11:16:42.756182542 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.63_ReduceMax 2022-05-24 11:16:42.756201629 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output query.63_ReduceMin 2022-05-24 11:16:42.756218970 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1158_ReduceMax 2022-05-24 11:16:42.756235524 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_1158_ReduceMin 2022-05-24 11:16:42.756258096 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.199_ReduceMax 2022-05-24 11:16:42.756276119 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output input.199_ReduceMin 2022-05-24 11:16:42.756293667 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1397_ReduceMax 2022-05-24 11:16:42.756310247 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_1397_ReduceMin 2022-05-24 11:16:42.756327927 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2748_ReduceMax 2022-05-24 11:16:42.756363284 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_2748_ReduceMin 2022-05-24 11:16:42.756384442 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.47_ReduceMax 2022-05-24 11:16:42.756402797 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.47_ReduceMin 2022-05-24 11:16:42.756423286 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3276_ReduceMax 2022-05-24 11:16:42.756440005 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Reshape_3276_ReduceMin 2022-05-24 11:16:42.756457702 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.79_ReduceMax 2022-05-24 11:16:42.756476194 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output value.79_ReduceMin 2022-05-24 11:16:42.756494455 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1887_ReduceMax 2022-05-24 11:16:42.756510437 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1,1} for output onnx::Add_1887_ReduceMin 2022-05-24 11:16:42.756526956 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3182_ReduceMax 2022-05-24 11:16:42.756543001 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Shape_3182_ReduceMin 2022-05-24 11:16:42.756560856 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1506_ReduceMax 2022-05-24 11:16:42.756575821 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Add_1506_ReduceMin 2022-05-24 11:16:42.756594666 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1218_ReduceMax 2022-05-24 11:16:42.756629927 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1,1} for output onnx::Mul_1218_ReduceMin 2022-05-24 11:16:42.756651463 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_980_ReduceMax 2022-05-24 11:16:42.756678942 [W:onnxruntime:, execution_frame.cc:806 VerifyOutputSizes] Expected shape from model of {} does not match actual shape of {1,1} for output onnx::Gemm_980_ReduceMin Model Optimizer arguments: Common parameters:

Hello, I'm username! I've tested nebullvm on the following setup: Hardware: Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz CPU and Tesla V100-SXM2-32GB GPU. Model: GPT2 - HuggingFace Tokens: 10

ukdsvl commented 2 years ago

same here, for https://github.com/nebuly-ai/nebullvm/blob/main/resources/notebooks/Accelerate-PyTorch-YOLO-with-nebullvm.ipynb as well, I am not getting any improvements, rather the same/or more latency.

diegofiori commented 2 years ago

Hi @mali19064! Thank you for reaching out! Regarding your problem, I think it is due to the fact that nebullvm optimizes the model by considering the largest possible input size. This can lead to lower performance when using small input sizes. We are thinking of adding an extra parameter where the user can specify the target size, but we are open to any kind of ideas/suggestions to improve the library!

diegofiori commented 2 years ago

same here, for https://github.com/nebuly-ai/nebullvm/blob/main/resources/notebooks/Accelerate-PyTorch-YOLO-with-nebullvm.ipynb as well, I am not getting any improvements, rather the same/or more latency.

Hello @ukdsvl, could you please share with us your hardware configuration and OS? In this way we can investigate in depth the issue. Thank you!

ukdsvl commented 2 years ago

@morgoth95

Machine/ OS details: Virtualization: microsoft Operating System: Ubuntu 18.04.6 LTS Kernel: Linux 5.4.0-1078-azure Architecture: x86-64

vCPUs = 16 RAM=128 GB

More context: I am trying to optimize inference time using https://github.com/chensnathan/YOLOF (detectron2 framework) for 2 variants: i) YOLOF_R_50_C5_1x and ii) YOLOF_CSP_D_53_DC5_9x_stage2_3x AND by using wrappers as mentioned by you here. Actually, there are three model components (backbone, encoder, decoder) and I am optimizing all three using 3 different wrappers as suggested by you in the link above, and then reassigning them.

Observation: i) For higher resolution (1200x1200) I got only 1.6x speed ii) For lower resolutions (<800x800) speed boost is not seen iii) Boosts observed in i)-ii) are only for Res50 backbone in YOLOF_R_50_C5_1x. For YOLOF_CSP_D_53_DC5_9x_stage2_3x with DarkNet53 backbone, I am in fact getting error due to inconsistency in expected and actual tensor data types. For YOLOF_CSP_D_53_DC5_9x_stage2_3x optimization is happening though. iv) Option B2/3 does not necessarily lead to better performance, even after specifying different thresholds, and rather take more time to optimize. v) To verify that I am not making any mistake, I ran https://github.com/nebuly-ai/nebullvm/blob/main/resources/notebooks/Accelerate-PyTorch-YOLO-with-nebullvm.ipynb but even there is no improvement. vi) I saw that only .onnx files are generated, while I was hoping for .xml and .bin as well. Does this mean that nebullvm things that onnx-rt is the better option.

ukdsvl commented 2 years ago

@morgoth95 tried reinstalling from source and ran the yolov5 tutorial again, but still there is no improvement in latency. please have a look at my version of the notebook here https://github.com/ukdsvl/dl_accelerate/blob/main/Accelerate-PyTorch-YOLO-with-nebullvm.ipynb . Let me know if I am missing something.

As you can see, got: [ INFO ] Optimizing with ONNXOptimizer and q_type: QuantizationType.STATIC. Compilation failed with ONNXOptimizer. Got error expected np.ndarray (got NoneType). The optimizer will be skipped. [ WARNING ] Compilation failed with ONNXOptimizer. Got error expected np.ndarray (got NoneType). The optimizer will be skipped.

Also, for another use case, got: [ WARNING ] Compilation failed with ONNXOptimizer. Got error 'NoneType' object has no attribute 'get_inputs_example'. The optimizer will be skipped.

Thanks in advance!