search

DeepLink-org / DeepLinkExt

BSD 3-Clause "New" or "Revised" License
11 stars 0 forks source link

refactor: RMSNorm #59

Closed zhangzefeng92 closed 5 months ago

zhangzefeng92 commented 5 months ago

refactor rms norm op, and rotary_embeding and mha.

lljbash commented 5 months ago

common 叫 ops 比较好吧

yangbofun commented 5 months ago

common 叫 ops 比较好吧

这个等后续看看，感觉common意思还更直观。