search

Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
391 stars 55 forks source link

Clean mt5 #419

Open xiezipeng-ML opened 2 years ago

xiezipeng-ML commented 2 years ago

clean mt5，默认fuse_multihead_att和fuse_softmax，注释了model_type='t5'相关内容

strint commented 2 years ago

这个和之前那个分支的关系是什么，需要测评么；

对性能有提升作用不。