mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.23k stars 1.58k forks source link

[Question] How to export MLCChat .apk with weight bundled/included? #3013

Closed lifelongeeek closed 1 week ago

lifelongeeek commented 2 weeks ago

❓ General Questions

Hello. I want to share MLCChat .apk including the model weights. I successfully follow 'bundle weight' guideline in (https://llm.mlc.ai/docs/deploy/android.html#bundle-model-weights), and try to export .apk afterward. However, the exported .apk does not include the model weight inside. The size of the .apk is about 105MB, and my MLC model is about 4GB.

How to export MLCChat .apk with weight bundled/included?

Mawriyo commented 2 weeks ago

https://github.com/mlc-ai/mlc-llm/issues/2733