请问pp异构并行训练时，划分模型层列表是否只能通过手动设置？

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.

Other

132 stars 40 forks source link

Open JinXiaozhao opened 2 months ago

aoyulong commented 2 months ago

Yes, users currently have to set them manually. However, this can be avoided once we support auto-tuning for heterogeneous training.

JinXiaozhao commented 2 months ago

感谢回复，请问自动划分pp异构列表是否有计划？预计什么时间点支持？