facebookresearch / xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

https://facebookresearch.github.io/xformers/

Other

8.41k stars 597 forks source link

Open volcverse opened 1 month ago

volcverse commented 1 month ago

❓ Questions and Help

Thanks for the great work!

I would like to get Q @ K^T similarity. But I checked the tutorials and didn't find a solution. So is it feasible to get the Q @ K^T?

I'm not sure if I missed it. Any response will be greatly appreciated!