binmakeswell / ColossalChat

ColossalChat is the project to implement LLM with RLHF, powered by the Colossal-AI project.
https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat
Apache License 2.0
61 stars 17 forks source link

Energon-AI Inference Optimization #1

Open sharlec opened 1 year ago

sharlec commented 1 year ago

Does it Energon-AI support this project for inference optimization?

binmakeswell commented 1 year ago

hi @sharlec Yes. This repo is a fork of https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat