ymcui / Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Apache License 2.0
7.06k stars 578 forks source link

为什么同样的模型在命令行执行对话返回很快,但使用text-generation-webui就很慢 #482

Closed skysea82410 closed 8 months ago

skysea82410 commented 9 months ago

提交前必须检查以下项目

问题类型

效果问题

基础模型

Chinese-Alpaca-2 (7B/13B)

操作系统

macOS

详细描述问题

为什么同样的模型在命令行执行对话返回很快,但使用text-generation-webui就很慢

依赖情况(代码类问题务必提供)

# 请在此处粘贴依赖情况(请粘贴在本代码块里)

运行日志或截图

# 请在此处粘贴运行日志(请粘贴在本代码块里)
iMountTai commented 9 months ago

排除一下:命令行执行走的是GPU,text-generation-webui走的是CPU

github-actions[bot] commented 8 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 8 months ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.