ymcui / Chinese-LLaMA-Alpaca-2

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Apache License 2.0
7.01k stars 571 forks source link

怎么启动chinese llama #451

Closed dongziyu1016 closed 6 months ago

dongziyu1016 commented 7 months ago

提交前必须检查以下项目

问题类型

模型推理

基础模型

Chinese-LLaMA-2 (7B/13B)

操作系统

Linux

详细描述问题

# 请在此处粘贴运行代码(请粘贴在本代码块里)
 ./main -m zh-models/7B/ggml-model-q4_0.gguf --color -ins -c 2048 --temp 0.2 -n 256 --repeat_penalty 1.3

您好,我用这个命令启动llama2-7B模型。但是模型没有生成任何内容

微信图片_20231208150707

请问是不是我的启动方式不对,我应该怎么办?

依赖情况(代码类问题务必提供)

# 请在此处粘贴依赖情况(请粘贴在本代码块里)

运行日志或截图

# 请在此处粘贴运行日志(请粘贴在本代码块里)
ymcui commented 7 months ago

命令没有什么大问题。不排除是你的terminal的问题。另外llama不是用来对话的。

dongziyu1016 commented 7 months ago

好的,非常感谢

github-actions[bot] commented 7 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 6 months ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.