UbiquitousLearning / mllm

Fast Multimodal LLM on Mobile Devices
https://ubiquitouslearning.github.io/mllm_website
MIT License
390 stars 47 forks source link

./run_qwen-npu.sh failed #124

Closed zcxo closed 3 weeks ago

zcxo commented 3 weeks ago

./run_qwen-npu.sh failed. I checked and found that there is no Qualcomm SDK directory (which can be downloaded and modified by myself), but there is no build directory under LLaMAPacket, so it is missing LLaMAPackage_CPU.so and/libQnLLAMPackage_CTP.so.

LIBPATH=../src/backends/qnn/qualcomm_ai_engine_direct_220/ ANDR_LIB=$LIBPATH/lib/aarch64-android OP_PATH=../src/backends/qnn/LLaMAOpPackageHtp/LLaMAPackage/build DEST=/data/local/tmp/mllm/qnn-lib

adb push $ANDR_LIB/libQnnHtp.so $DEST adb push $ANDR_LIB/libQnnHtpV75Stub.so $DEST adb push $ANDR_LIB/libQnnHtpPrepare.so $DEST adb push $ANDR_LIB/libQnnHtpProfilingReader.so $DEST adb push $ANDR_LIB/libQnnHtpOptraceProfilingReader.so $DEST adb push $ANDR_LIB/libQnnHtpV75CalculatorStub.so $DEST adb push $LIBPATH/lib/hexagon-v75/unsigned/libQnnHtpV75Skel.so $DEST adb push $OP_PATH/aarch64-android/libQnnLLaMAPackage.so $DEST/libQnnLLaMAPackage_CPU.so adb push $OP_PATH/hexagon-v75/libQnnLLaMAPackage.so $DEST/libQnnLLaMAPackage_HTP.so

oreomaker commented 3 weeks ago

Have you performed the QNN Op Package Compiling? After setting up the QNN env, you should compile the QNN Op Package first.

zcxo commented 3 weeks ago

Get 。 Thanks!