search

lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.59k stars 4.52k forks source link

Support codellama 70B #3012

Open pydaxing opened 8 months ago

pydaxing commented 8 months ago

the codellama 70B is different from 7B 14B，can codellama 70B be supported?

pydaxing commented 8 months ago

codellama 70B 部署起来之后输出重复或者胡言乱语，能否改进下。

chatglm3-6b-128k也是的，官网部署的结果不一致

infwinston commented 8 months ago

could you help to send a PR to fix this? thanks! details: https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf#chat-prompt

sekhar-hari commented 6 months ago

Is Codellama-70B-Instruct-hf now supported?