Open taeyeonlee opened 2 days ago
Hi @taeyeonlee,
Something is happening that is causing the converter to abruptly exit before it has finished. I think the scripts should check for exit status before it tries to proceed, so we should fix that on our end. However, that will only make the failure reason more clear, it won't solve why it is failing.
The qnn-onnx-converter
step should end with outputs like this:
2024-05-14 19:12:07,107 - 235 - INFO - Model CPP saved at: [...].cpp
2024-05-14 19:12:07,108 - 235 - INFO - Model BIN saved at: [...].bin
2024-05-14 19:12:07,136 - 235 - INFO - Conversion complete!
A few things to try:
Let us know what that yields and we'll take it from there. Sorry again about this!
Dear Qualcomm,
It fails to generate genie-compatible QNN binaries, according to the guide (https://github.com/quic/ai-hub-models/tree/main/qai_hub_models/models/llama_v2_7b_chat_quantized/gen_ondevice_llama) The error log is following.
FileNotFoundError: Unable to find the model source file, invalid path: /mnt/hdd/QCT_AI_Hub/ai-hub-models/qai_hub_models/models/llama_v2_7b_chat_quantized/gen_ondevice_llama/export/intermediate_data/cpp_models/Llama2_PromptProcessor_1_Quantized.cpp
Error log
Best regards,