lobehub / lobe-chat

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.
https://chat-preview.lobehub.com
Other
40.95k stars 9.34k forks source link

希望增加Token/s显示功能[Request] #2894

Closed eric0095 closed 3 weeks ago

eric0095 commented 3 months ago

🥰 需求描述

openwebui,是有这个功能的,感觉很多时候很有必要,实现起来相对简单。 每次聊天后可以看到token/s统计,方便观察生成性能。因为很多人都是自己搭建的本地模型,这个信息对于模型比较,硬件升级,上下文长度控制都有很大帮助。

🧐 解决方案

openwebui,是有这个功能的,感觉很多时候很有必要,实现起来相对简单。 每次聊天后可以看到token/s统计,方便观察生成性能。因为很多人都是自己搭建的本地模型,这个信息对于模型比较,硬件升级,上下文长度控制都有很大帮助。

📝 补充信息

No response

lobehubbot commented 3 months ago

👀 @eric0095

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. Please make sure you have given us as much context as possible.\ 非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

lobehubbot commented 3 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


🥰 Description of requirements

openwebui has this function, which I feel is necessary in many cases, and is relatively simple to implement. You can see the token/s statistics after each chat, making it easy to observe the generation performance. Because many people build their own local models, this information is very helpful for model comparison, hardware upgrades, and context length control.

🧐 Solution

openwebui has this function, which I feel is necessary in many cases, and is relatively simple to implement. You can see the token/s statistics after each chat, making it easy to observe the generation performance. Because many people build their own local models, this information is very helpful for model comparison, hardware upgrades, and context length control.

📝 Supplementary information

No response

arvinxx commented 3 weeks ago

duplicate of https://github.com/lobehub/lobe-chat/issues/2129

lobehubbot commented 3 weeks ago

✅ @eric0095

This issue is closed, If you have any questions, you can comment and reply.\ 此问题已经关闭。如果您有任何问题,可以留言并回复。