airockchip / rknn-llm

Other
417 stars 36 forks source link

GGML_ASSERT(view_src == NULL || data_size == 0 || data_size + view_offs <= ggml_nbytes(view_src)) failed #119

Open sdrzmgy opened 1 week ago

sdrzmgy commented 1 week ago

在运行rkllm时,user内容输入后,robot回答报错: robot: :0: GGML_ASSERT(view_src == NULL || data_size == 0 || data_size + view_offs <= ggml_nbytes(view_src)) failed /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x1c7e34)[0x7f84da7e34] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x1c9480)[0x7f84da9480] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x1e82a8)[0x7f84dc82a8] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x116454)[0x7f84cf6454] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x11923c)[0x7f84cf923c] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x17a5f8)[0x7f84d5a5f8] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x11eb08)[0x7f84cfeb08] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0x12e774)[0x7f84d0e774] /home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64/librkllmrt.so(+0xaaab4)[0x7f84c8aab4] ./llm_demo_1[0x402304] /lib/aarch64-linux-gnu/libc.so.6(+0x273fc)[0x7f847373fc] /lib/aarch64-linux-gnu/libc.so.6(__libc_start_main+0x98)[0x7f847374cc] ./llm_demo_1[0x4025dc] run.sh: line 2: 5963 Aborted (core dumped) ./llm_demo_1 Qwen.rkllm 2048 2048

我的命令为:export LD_LIBRARY_PATH=/home/orangepi/rknn-llm/rkllm-runtime/runtime/Linux/librkllm_api/aarch64 ./llm_demo_1 Qwen.rkllm 2048 2048

sdrzmgy commented 1 week ago

NPU驱动版本为RKNPU driver: v0.9.6;llm_demo用的示例,没有进行修改