Open View999888 opened 2 months ago
问题 1 :如何获取到app_config.json 中的model_lib_path_for_prepare_libs中的模型文件 问题 2 :apk 怎么和模型文件相互联系的
I had the same issue running on both emulator and device.
@View999888 Good day, if you try 7 or 8b models you need 8 gb ram. @abhishekdewan101 Mlc llm working on device only.
ERROR: No module named ‘tvm’
How to generate 'tvm' ? Please have a workaround address
Hi folks, we just did an android build flow refactor yesterday. The new android build flow requires fewer steps. The documentation has been revamped to the new flow https://llm.mlc.ai/docs/deploy/android.html. Could you check out and try again?
Before doing that, please also upgrade your mlc-llm and tvm to use the latest nightly by following instructions in https://llm.mlc.ai/docs/install/mlc_llm.html.
ERROR: No module named ‘tvm’
How to generate 'tvm' ? Please have a workaround address
@View999888 You need to install tvm by following https://llm.mlc.ai/docs/install/mlc_llm.html.
@View999888 你的已经ok了吗 我发现demo apk都有问题
How can this error be resolved?
Stack trace: org.apache.tvm.Base$TVMError: InternalError: Check failed: (chat_ != nullptr) is false: Chat is not initialized via reload Stack trace: File "/Users/rageshantonyd/Documents/working_prj/mlc-llm/cpp/llm_chat.cc", line 1744
Error message: InternalError: Check failed: (chat_ != nullptr) is false: Chat is not initialized via reload Stack trace: File "/Users/rageshantonyd/Documents/working_prj/mlc-llm/cpp/llm_chat.cc", line 1744