Transformers inference supports implementation

ymcui / Chinese-Mixtral

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

https://arxiv.org/abs/2403.01851

Apache License 2.0

582 stars 44 forks source link

Closed iMountTai closed 9 months ago

iMountTai commented 9 months ago

This PR implements support for Transformers inference.

None

copilot:walkthrough