search

linkedin / Liger-Kernel

Efficient Triton Kernels for LLM Training
BSD 2-Clause "Simplified" License
2.89k stars 138 forks source link

[kernel] add layer norm #138

Closed ByronHsu closed 2 weeks ago

ByronHsu commented 2 weeks ago

🚀 The feature, motivation and pitch

as title

Alternatives

No response

Additional context

No response

ByronHsu commented 2 weeks ago

we had an version made by @lancerts but haven't oss yet. @lancerts can you make a pr?

ByronHsu commented 2 weeks ago

cc @AndreSlavescu who is interested. andre can optimize on top

lancerts commented 2 weeks ago

https://github.com/linkedin/Liger-Kernel/pull/169 merged