search

alibaba / Pai-Megatron-Patch

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Apache License 2.0
674 stars 94 forks source link

Channel Loss支持 #316

Open echo-valor opened 1 month ago

echo-valor commented 1 month ago

您好，请问Pai-Megatron在Channel loss上何时进行支持？谢谢

jerryli1981 commented 1 month ago

您好，有相关材料吗？我们可以先调研下