search

sanjaybip / llm-frameworks-libraries

Most popular and active frameworks or libraries used to develop LLMs application.
0 stars 0 forks source link

Recommendation: Colossal-AI for Powerful LLM Training and Inferencing #1

Open Yanjia0 opened 7 months ago

Yanjia0 commented 7 months ago

Dear community,

I'm excited to share Colossal-AI, a deep learning framework for training and inference tasks in large language models (LLMs).

Colossal-AI stands out for its exceptional speed, surpassing many benchmarks in the field. You can get more details from https://github.com/hpcaitech/ColossalAI/tree/main

We have successfully utilized Colossal-AI to build several applications, including ColossalChat, Colossal-LLaMA-2 and FastFold.

If you find this work interesting, please add it and try it yourself.

Thank you for your attention.

sanjaybip commented 7 months ago

@Yanjia0 This list contains framework or library only used to develop Generative AI application (Like RAG, ChatBot). Colossal is for training and inferencing right?