search

alibaba / Pai-Megatron-Patch

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Apache License 2.0
674 stars 94 forks source link

mixtral checkpoint converter - grouped gemm for experts MLP support #218

Open vlad-karpuhin opened 5 months ago

CLAassistant commented 5 months ago

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 2 committers have signed the CLA.

:x: shamanez
:x: vlad-karpuhin
You have signed the CLA already but the status is still pending? Let us recheck it.

jerryli1981 commented 4 months ago

您好，方便加下钉钉群，然后加下我钉钉：李鹏(同润)，咱们沟通下？