Closed kingrmb closed 7 months ago
Hey @kingrmb, you also need to add the model to model_list
property. Something like this:
"model_list": [
{
"model_url": "<HF link to model>",
"model_id": "Llama-2-7b-chat-hf",
"model_lib": "llama_q4f16_1",
"estimated_vram_bytes": 4348727787
},
"model_lib_path_for_prepare_libs": {
"llama_q4f16_1": "prebuilt_libs/Llama-2-7b-chat-hf/Llama-2-7b-chat-hf-q4f16_1-android.tar"
}
}
To download the model weights, either
model_url
adb
Closing this issue due to inactivity. You are welcome to open a new issue for further questions.
❓ General Questions
i compiled FlagAlpha/Llama2-Chinese-7b-Chat model,and get -- Llama2-Chinese-7b-Chat-q4f16_1-android.tar ......and then sh ./prepare_libs.sh get: -- /mlc-llm/android/library/build/output/tvm4j_core.jar -- /mlc-llm/android/library/build/output/arm64-v8a/libtvm4j_runtime_packed.so i never used this two output file, there must be something wrong~~
steps: 1、first,i open ./android project by Android Studio, and run gradle sync success 2、i try to config app-config.json this way: this does not work, so how should i do, absolute path?
{ "model_list": [], "model_lib_path_for_prepare_libs": { "llama_q4f16_1": "prebuilt_libs/Llama-2-7b-chat-hf/Llama-2-7b-chat-hf-q4f16_1-android.tar" } }
thanks so much