Inconsistent inference accuracy of pytorch model caused by cuda version

[zhangchen98]

When I use the gpu version of pytorch for model inference, I found that the output tensor accuracy is inconsistent, as follows:

When I switch to cpu, this problem does not occur. Furthermore, I can also get consistent results when using lower cuda versions (11.6->11.3).

Environment:

• pytorch: 1.12
• linux