search

Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
391 stars 55 forks source link

Dev baichuan #520

Closed xiezipeng-ML closed 1 year ago

xiezipeng-ML commented 1 year ago

baichuan的模型代码没有添加到transformers库里，是在权重文件这里实现的，用的时候需要把baichuan-inc/Baichuan-7B放到libai/projects/mock_transformers/Baichuan里，然后通过from Baichuan import modeling_baichuan来替换libai的layer