wenda-LLM / wenda

闻达:一个LLM调用平台。目标为针对特定环境的高效内容生成,同时考虑个人和中小企业的计算资源局限性,以及知识安全和私密性问题
GNU Affero General Public License v3.0
6.22k stars 809 forks source link

用官方源码部署 baichuan2-13B-chat的效果和 wenda部署 baichuan2-13B-chat的效果差距很大 #506

Open ExpressGit opened 9 months ago

ExpressGit commented 9 months ago

Describe the bug A clear and concise description of what the bug is.

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Smartphone (please complete the following information):

Additional context 用官方源码部署 baichuan2-13B-chat的效果和 wenda部署 baichuan2-13B-chat的效果差距很大

baicahun2官方部署: image

wenda2部署: image

wenda.py设置参数:

image

baichaun官方源码 和 wenda源码 部署在同一台 PC 上。

config.yml设置: image

想咨询一下可能是什么原因导致的

l15y commented 9 months ago

看起来你通过python程序中的缺省值设置参数,但参数在运行中由前端提供