search

huggingface / chat-ui

Open source codebase powering the HuggingChat app
https://huggingface.co/chat
Apache License 2.0
7.1k stars 1.02k forks source link

Command-R-plus model parameters #1329

Closed li-ruijie closed 1 month ago

li-ruijie commented 1 month ago

I have tried to replicate the behaviour of Command-R-plus locally with TGI and chat-ui but could not get anywhere near the length of answer that huggingchat provides. May I know the parameters used for serving the command-r and command-r-plus models?

nsarrazin commented 1 month ago

Hi! Yes our config is fully open-source, you can find the details here: https://github.com/huggingface/chat-ui/blob/b5a0f56b00d3feaf663b576857005abdad149fe1/chart/env/prod.yaml#L41-L67