airockchip / rknn-llm

Other
417 stars 36 forks source link

矩阵乘法算子提交错误 failed to submit!, op id: 0, op name: MatMul, flags: 0x5, task start: 0, task number: 1, run task counter: 0, int status: 0x200 #85

Open yuunnn-w opened 3 months ago

yuunnn-w commented 3 months ago

操作系统:Ubuntu Jammy 内核版本:Linux 6.1.43 硬件:OrangePi 5 max RK3588 RKNPU驱动版本:0.9.6

问题描述: 运行llm_demo的时候出现如下错误,完整xshell日志如下:

root@orangepi5max:~/Code/rknn-llm# ./llm_demo ./Qwen2.rkllm
rkllm init start
rkllm-runtime version: 1.0.1, rknpu driver version: 0.9.6, platform: RK3588
rkllm init success

**********************可输入以下问题对应序号获取回答/或自定义输入********************

[0] 把下面的现代文翻译成文言文:到了春风和煦,阳光明媚的时候,湖面平静,没有惊涛骇浪,天色湖光相连,一片碧绿,广阔无际;沙洲上的鸥鸟,时而飞翔,时而停歇,美丽的鱼游来游去,岸上与小洲上的花草,青翠欲滴。
[1] 以咏梅为题目,帮我写一首古诗,要求包含梅花、白雪等元素。
[2] 上联: 江边惯看千帆过
[3] 把这句话翻译成中文:Knowledge can be acquired from many sources. These include books, teachers and practical experience, and each has its own advantages. The knowledge we gain from books and formal education enables us to learn about things that we have no opportunity to experience in daily life. We can also develop our analytical skills and learn how to view and interpret the world around us in different ways. Furthermore, we can learn from the past by reading books. In this way, we won't repeat the mistakes of others and can build on their achievements.
[4] 把这句话翻译成英文:RK3588是新一代高端处理器,具有高算力、低功耗、超强多媒体、丰富数据接口等特点

*************************************************************************

user: 4
把这句话翻译成英文:RK3588是新一代高端处理器,具有高算力、低功耗、超强多媒体、丰富数据接口等特点
robot: 。 RK3588 is a new generation of highE RKNN: [11:34:30.235] failed to submit!, op id: 0, op name: MatMul, flags: 0x5, task start: 0, task number: 1, run task counter: 0, int status: 0x200, If using rknn, update to the latest toolkit2 and runtime from: https://console.zbox.filez.com/l/I00fc3 (PWD: rknn). If using rknn-llm, update from: https://github.com/airockchip/rknn-llm

matmul run failed-end processors with high computing power, low power consumption, strong multimedia capabilities, and rich data interfaces.
Socket error Event: 32 Error: 10053.
Connection closing...Socket close.

Connection closed by foreign host.

Disconnected from remote host(5 max) at 11:35:36.

Type `help' to learn how to use Xshell prompt.

使用的模型是Qwen2-1.5B-Instruct,经过转换得到Qwen2.rkllm,转换脚本参数与官方仓库中的test.py脚本参数一致,未修改。

其中llm_demo是通过在build-linux.sh脚本中设置GCC编译器为GCC_COMPILER_PATH=/usr/bin/aarch64-linux-gnu,然后在开发板直接运行bash build-linux.sh得到的,未经过交叉编译。

在出现上述报错后,操作系统直接崩溃,无法再链接上开发板,只能重启。如果可以请rknn-llm团队排查下是硬件问题还是软件问题。