Open trajepl opened 9 months ago
This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.
Any ideas?
Describe the issue
Parity check failed when run optimization with above cmd.
batch_size=4, encode_sequence_length=11, past_decode_sequence_length=3, max_diff=1.1168098 batch_size=1, encode_sequence_length=2, past_decode_sequence_length=5, max_diff=0.71538544 batch_size=3, encode_sequence_length=1, past_decode_sequence_length=1, max_diff=3.5321946 batch_size=8, encode_sequence_length=5, past_decode_sequence_length=2, max_diff=11.911711 PyTorch and OnnxRuntime results max difference = 11.911710739135742 PyTorch and OnnxRuntime results are NOT close
To reproduce
See the description of this issue.
Urgency
No response
Platform
Linux
OS Version
Ubuntu 20.04.5 LTS
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.16.2
ONNX Runtime API
Python
Architecture
X64
Execution Provider
CUDA
Execution Provider Library Version
CUDA
Model File
No response
Is this a quantized model?
No