Open hecmay opened 3 years ago
Hi,I'm facing the same issue. Have you found the solution?
Removing pyprof from my code fixed this for me.
I am facing the same issue. I am not using pyprof in my code.
Looks like apex doesn't build this extension by default.
https://github.com/NVIDIA/apex/blob/6b7e77b0c34ca2be4243d495423e17d49090b49e/setup.py#L371
https://github.com/NVIDIA/apex/blob/6b7e77b0c34ca2be4243d495423e17d49090b49e/setup.py#L301
adding --global-option="--fast_multihead_attn"
when installing apex fixed the problem for me. (I'm running pyprof, and I get this exception during pyprof.init()
)
Hi, Iwas trying run the fast-MHA example here: https://github.com/NVIDIA/apex/tree/master/apex/contrib/multihead_attn
I got the following errors when running the performance:
The Apex packaged is installed with CPP and CUDA extension turned on. And I was not able to find the definition of this missing function anywhere.