search

lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
35.57k stars 4.37k forks source link

Cohere models #2753

Open frameadvisors opened 7 months ago

frameadvisors commented 7 months ago

It would be great to see the cohere models compared to the other commercial chatbots. Here is the website with the pricing:

https://cohere.com/pricing

It would also be great as others have said to see some metrics of latency (i.e. time to first token) to be captured as well.

This is an amazing project by the way.

infwinston commented 7 months ago

thanks to our community contribution, it's in this PR https://github.com/lm-sys/FastChat/pull/2759. could you also help reviewing it?