search

Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
389 stars 55 forks source link

Use fused gelu mul #420

Closed leaves-zwx closed 1 year ago

xiezipeng-ML commented 1 year ago

我编译fuse_gelu_mul测了一下没问题，这个需要合并吗，还是先到这里修改clean_mt5

chengtbf commented 1 year ago

我编译fuse_gelu_mul测了一下没问题，这个需要合并吗，还是先到这里修改clean_mt5

需要，不过依赖着 OneFlow ： https://github.com/Oneflow-Inc/oneflow/pull/9377 的合并