[feature] tokens/sec - Githubissues

yportne13 / chatbot-ui-llama.cpp

A static web ui for llama.cpp server. The llama.cpp chat interface for everyone. base on chatbot-ui

https://chatbotui.com

MIT License

14 stars 1 forks source link

[feature] tokens/sec #2

Open 0wwafa opened 1 month ago

0wwafa commented 1 month ago

On the last line of the chat window, where you wrote "ChatBot UI. Chatbot UI is an advanced chatbot kit for OpenAI's chat models aiming to mimic ChatGPT's interface and functionality." It would be nice to have the tokens/second