Closed neal668 closed 10 months ago
--base_model
输入的是lora还是合并后的模型?如果是合并后的模型,是自己合并的还是直接下载的全量权重
可能是解码策略的问题,generation_config
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.
Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.
@neal668 你好,请问你解决了吗
提交前必须检查以下项目
问题类型
模型推理
基础模型
Chinese-Alpaca-2-16K (7B/13B)
操作系统
Linux
详细描述问题
依赖情况(代码类问题务必提供)
运行日志或截图