wangzhaode / mnn-llm

llm deploy project based mnn.
Apache License 2.0
1.41k stars 154 forks source link

HELP! 安卓端版mnn-llm.apk加载chatglm3-6b-mnn无法操作 #138

Closed forhonourlx closed 7 months ago

forhonourlx commented 8 months ago

大佬, 安卓端版mnn-llm.apk加载chatglm3-6b-mnn无法操作,按照https://github.com/wangzhaode/mnn-llm/releases/tag/mnn-llm-apk adb传入模型后,“选择模型文件夹”有目录选项,但点击“加载模型”后,显示的还是24.56M的block块下载,如图请问如何处理啊? Screenshot_20240105_134307 Screenshot_20240105_134325

by VIVO X100 PRO

提前谢过!

wangzhaode commented 8 months ago

请问你有没有按照提示把模型文件放置到指定位置呢

forhonourlx commented 8 months ago

我使用了如下adb命令:

adb shell mkdir /data/local/tmp/mnn-llm
adb push ./chatglm3-6b-mnn  /data/local/tmp/mnn-llm
adb push ./baichuan2-7b-chat-mnn  /data/local/tmp/mnn-llm
adb push ./codegeex2-6b-mnn  /data/local/tmp/mnn-llm

然后刚才我又重新运行了一遍,得到如下返回:

(base) PS D:\LLM\mnn-llm> adb shell mkdir /data/local/tmp/mnn-llm
* daemon not running; starting now at tcp:5037
* daemon started successfully
mkdir: '/data/local/tmp/mnn-llm': File exists
(base) PS D:\LLM\mnn-llm> adb push ./chatglm3-6b-mnn  /data/local/tmp/mnn-llm
./chatglm3-6b-mnn\: 31 files pushed, 0 skipped. 47.0 MB/s (3537967643 bytes in 71.720s)

比如选择chatglm3-6b-mnn模型后,点加载模型,然后就到了可能是qwen-1.8b-mnn的下载页面(每个分块24.56M),没有加载模型。。。

wangzhaode commented 8 months ago

我看了下是模型检测的问题,我写的例子打开了DISK_EMBEDDING需要embeddings_bf16.bin 文件

forhonourlx commented 8 months ago

恳请大佬修复~感恩!

github-actions[bot] commented 7 months ago

Marking as stale. No activity in 30 days.