search

UbiquitousLearning / mllm

Fast Multimodal LLM on Mobile Devices
https://ubiquitouslearning.github.io/mllm_website
MIT License
389 stars 47 forks source link

运行时出现merge file is broken #133

Closed mailonghua closed 2 weeks ago

mailonghua commented 2 weeks ago

运行时出现如下问题： $ adb shell "cd /data/local/tmp/mllm/bin && export LD_LIBRARY_PATH=/data/local/tmp/mllm/qnn-lib && export ADSP_LIBRARY_PATH=/data/local/tmp/mllm/qnn-lib && ./main_qwen_npu -s 64 -c 1"
merge file is broken

chenghuaWang commented 2 weeks ago

The error is occurred here

https://github.com/UbiquitousLearning/mllm/blob/4f6da8d48d8e03a2cba863a64a93c16ff8a29259/src/models/qwen/tokenization_qwen.hpp#L84

Did you push the merge file to your device before running it?

mailonghua commented 2 weeks ago

The error is occurred here

https://github.com/UbiquitousLearning/mllm/blob/4f6da8d48d8e03a2cba863a64a93c16ff8a29259/src/models/qwen/tokenization_qwen.hpp#L84

Did you push the merge file to your device before running it?

感谢回复，确实是忘记将qwen_merges.txt进行Push