OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
405 stars 58 forks source link

fix: ColliePipelineEngine has no attribute using_bf16_optimizer #168

Closed KYLN24 closed 4 months ago

KYLN24 commented 4 months ago
KaiLv69 commented 4 months ago

逻辑上有些问题。ColliePipelineEngine的init大多数与PipelineEngine相同,所以之前调用的是DeepSpeedEngine的init。

为了动态匹配ds的更新,可以改成直接用PipelineEngine的init方法,之后注册一些collie需要用到的属性。