DeepSeek-V2-MoE transformer config adapt to mcore0.6.0

[one-game]

DeepSeek-V2-MoE transformer config adapt to mcore0.6.0

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

---

one_game seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}