Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
389 stars 55 forks source link

Use new implement of rms_norm #427

Closed leaves-zwx closed 1 year ago

xiezipeng-ML commented 1 year ago

wenxiao, 已同步:https://github.com/Oneflow-Inc/libai/pull/419/commits/8a30a809661044a1b5a8716191a7bdeef1506984