RuntimeError: Unknown builtin op: aten::scaled_dot_product_attention.

[zeng798473532]

I run python -m apps.infer with pytorch==1.13, python==3.8, and get the below error:

  File "/nfs/codes/PIFu-series/ECON/apps/infer.py", line 193, in <module>
    sapiens_normal = sapiens_normal_net.process_image(
  File "/nfs/codes/PIFu-series/ECON/apps/sapiens.py", line 65, in process_image
    normal_model = ModelManager.load_model(Config.CHECKPOINTS[normal_model_name], self.device)
  File "/nfs/codes/PIFu-series/ECON/apps/sapiens.py", line 37, in load_model
    model = torch.jit.load(checkpoint_path)
  File "/home/zlz/miniconda3/envs/econ/lib/python3.8/site-packages/torch/jit/_serialization.py", line 162, in load
    cpp_module = torch._C.import_ir_module(cu, str(f), map_location, _extra_files)
RuntimeError: 
Unknown builtin op: aten::scaled_dot_product_attention.
Here are some suggestions: 
        aten::_scaled_dot_product_attention

The original call is:
  File "code/__torch__/mmpretrain/models/utils/attention.py", line 29
    k = torch.select(qkv0, 0, 1)
    v = torch.select(qkv0, 0, 2)
    x = torch.scaled_dot_product_attention(q, k, v)
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ <--- HERE
    input = torch.reshape(torch.transpose(x, 1, 2), [_0, _2, 1536])
    _5 = (proj_drop).forward((proj).forward(input, ), )

how to solve it?

[YuliangXiu]

@zeng798473532 You can check the installation document of https://github.com/facebookresearch/sapiens

[learning-mamba]

I encountered the same issue. Do you have a solution?

[chill781]

You shouldn't use PyTorch 1.13.1; you need at least PyTorch 2.0 or higher because the scaled_dot_product_attention function is only available in version 2.0. Additionally, you need to update your CUDA and PyTorch3D versions so that they are compatible with each other, and that should fix the issue.