ROCm / torch_migraphx

Libraries integrating migraphx with pytorch
BSD 3-Clause "New" or "Revised" License
5 stars 1 forks source link

Op Support: aten._scaled_dot_product_flash_attention.default #184

Closed shivadbhavsar closed 1 month ago

shivadbhavsar commented 1 month ago

High level op: https://pytorch.org/docs/stable/generated/torch.nn.functional.scaled_dot_product_attention.html

shivadbhavsar commented 1 month ago

Used in TIMM models:

Note: requires rocm/pytorch:rocm6.2_ubuntu22.04_py3.10_pytorch_release_2.3.0 for aten export to include this op