hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible
https://www.colossalai.org
Apache License 2.0
38.28k stars 4.3k forks source link

[FEATURE]: Support Command-R model #5831

Closed GuangyaoZhang closed 1 week ago

GuangyaoZhang commented 1 week ago

Describe the feature

Support the Command-R model developed by: Cohere and Cohere For AI

C4AI Command-R is a research release of a 35 billion parameter highly performant generative model. Command-R is a large language model with open weights optimized for a variety of use cases including reasoning, summarization, and question answering. Command-R has the capability for multilingual generation evaluated in 10 languages and highly performant RAG capabilities.

Corresponding huggingface page: c4ai-command-r-v01