Open RuiFilipeCampos opened 5 months ago
this is actually critical to get the performance out of it, without a custom implementation the layer is actually slower than the scaled dot product
this is actually critical to get the performance out of it, without a custom implementation the layer is actually slower than the scaled dot product