chinese pro 7b一旦输入中文，推理程序自动关闭

ibmxiang commented 11 months ago

提交前必须检查以下项目

[X] 请确保使用的是仓库最新代码（git pull），一些问题已被解决和修复。
[X] 由于相关依赖频繁更新，请确保按照Wiki中的相关步骤执行
[X] 我已阅读FAQ章节并且已在Issue中对问题进行了搜索，没有找到相似问题和解决方案
[X] 第三方插件问题：例如llama.cpp、text-generation-webui、LlamaChat等，同时建议到对应的项目中查找解决方案
[X] 模型正确性检查：务必检查模型的SHA256.md，模型不对的情况下无法保证效果和正常运行

问题类型

模型推理

基础模型

Alpaca-7B

操作系统

Linux

详细描述问题

进行7b模型的hf转换，进行了模型的合并代码分别为:
python310 /usr/local/python310/lib/python3.10/site-packages/llam \
    --input_dir /root/llama_models/ \
    --model_size 7B \
    --output_dir /root/llama_alpha_modesl/hf-chinese-alpaca-pro-lora-7b

python310 scripts/merge_llama_with_chinese_lora_low_mem.py \
    --base_model /root/llama_alpha_modesl/hf-chinese-alpaca-pro-lora-7b \
    --lora_model /root/llama_alpha_modesl/chinese_llama_plus_lora_7b,/root/llama_alpha_modesl/chinese_alpaca_pro_lora_7b \
    --output_type huggingface \
    --output_dir /root/llama_alpha_modesl/chinese_new_models_7b

python310 scripts/inference/inference_hf.py \
    --base_model /root/llama_alpha_modesl/chinese_new_models_7b \
    --with_prompt --interactive

依赖情况（代码类问题务必提供）

# 请在此处粘贴依赖情况

运行日志或截图

=====================================================================================
+ 该模式下仅支持单轮问答，无多轮对话能力。
+ 如要进行多轮对话，请使用llama.cpp或llamachat工具。
-------------------------------------------------------------------------------------
+ This mode only supports single-turn QA.
+ If you want to experience multi-turn dialogue, please use llama.cpp or llamachat.
=====================================================================================
Input:woshishui
Response:  Woshishui is not a recognized word or phrase in English. Could you please provide more context or clarify what you are asking for?

Input: who are you
Response:  As an AI language model, I am not an individual with personal identity or experiences. Instead, I am designed to generate text based on input provided by users and use natural language processing techniques to understand and respond to their queries. My purpose is to assist and provide information in various ways, such as answering questions, generating content, and performing other tasks.

Input:^Hni^H^H^H
Response:  I'm sorry, but I don't understand what you are trying to say. Could you please provide more context or clarify your message?

Input:shi^H^H^H^H^H^H
Response:  I'm sorry, I don't understand what you are trying to say. Could you please provide more context or clarify your question?

Input:

github-actions[bot] commented 11 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.