search

matrix97317 / OneTensor

This is a simple and easy-to-use Tensor Library.
5 stars 1 forks source link

add naive softmax kernel implement #17

Open ThompsonHe opened 4 months ago

matrix97317 commented 4 months ago
  1. 可以探索下exp，expf 的区别
  2. 可以尝试增加safe softmax 算法
  3. 可以尝试在safe softmax算法上找出性能瓶颈