Oneflow-Inc / libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
https://libai.readthedocs.io
Apache License 2.0
389 stars 55 forks source link

可否支持读取pytorch model进行训练 #414

Closed frankxyy closed 1 year ago

frankxyy commented 1 year ago

RT

xiezipeng-ML commented 1 year ago

可以的:https://github.com/Oneflow-Inc/libai/tree/main/libai/models/utils/model_utils

相关文档:https://libai.readthedocs.io/en/latest/notes/How_to_load_huggingface%27s_pretrained_model_in_libai.html

xiezipeng-ML commented 1 year ago

@frankxyy

frankxyy commented 1 year ago

收到,感谢哈