search

linkedin / Liger-Kernel

Efficient Triton Kernels for LLM Training
https://arxiv.org/pdf/2410.10989
BSD 2-Clause "Simplified" License
3.38k stars 190 forks source link

minor refactor of rms and layernorm #213

Closed lancerts closed 2 months ago

lancerts commented 2 months ago

minor refactor of rms and layernorm