search

pytorch / xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)
https://pytorch.org/xla
Other
2.49k stars 480 forks source link

Fix op test for `nn.functional.scaled_dot_product_attention"nn.functi… #8025

Closed guyao closed 2 months ago

guyao commented 2 months ago

…onal.scaled_dot_product_attention`

Dropout is not deterministic. In the test cases dropout_p can be 0.0 or 0.5. For testcase with dropout_p = 0.5 we should not check the output value.