wangzhaode mnn-llm issues

wangzhaode / mnn-llm

llm deploy project based mnn.

Apache License 2.0

1.45k stars 159 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

使用vulkan后端进行qwen1.5b的推理时，报Don't support type [Attention], Attention/Reshape_8_output_0错误

#224 RisingEntropy opened 4 days ago
0
Feature/add docs

#223 ddbbcc closed 2 weeks ago
0
mnn-llm 使用cuda 后端执行时，每次结果都是不一样的。

#222 BaofengZan opened 3 weeks ago
3
lmm.weight和lmm.json如何生成呢？

#221 BaofengZan closed 3 weeks ago
0
[feat] add docs.

#220 wangzhaode closed 1 month ago
0
在Android 上加载Gamma2 2B的时候Demo App 闪退

#219 chenminjun-web opened 1 month ago
1
在 Android 上用 OpenCL 跑 Qwen-VL 报空指针

#218 GJYWorld closed 6 days ago
1
2024.9.18，是否支持当前最新版本的mnn的master分支

#217 tianmala closed 1 week ago
1
LLM sample with temperature parameters

#216 Ma-Dan opened 1 month ago
0
安卓14 编译完成后，运行demo 报错

#215 ddbbcc closed 3 weeks ago
1
clone 了最新的代码，然后安装了apk，下载了模型，然后push进去了，app闪退了

#214 1eas7 closed 3 weeks ago
7
Android App Crashed -“std::out_of_range: unordered_map::at: key not found”

#213 FranzKafkaYu closed 3 weeks ago
1
Qwen1.5-1.8B模型转换问题

#212 robben225 closed 3 months ago
3
ARM linux开发板Qwen2 1.5B加载成功，推理报错terminate called after throwing an instance of 'std::out_of_range' what(): _Map_base::at

#211 MosRat closed 2 months ago
2
cli_demo android test failed

#210 WenguoLi closed 3 months ago
1
qwen2-1.5B get wront results on windows

#209 ddbbcc closed 2 months ago
1
您好，能不能提供一下 armv8a 支持在 gpu 运行的 MMN 的 so

#208 GJYWorld closed 3 months ago
0
android端推理crash

#207 robben225 closed 3 months ago
1
config.json中的字段是否修改过，android工程无法运行

#206 LHB116 closed 3 months ago
1
请问whisper、paraformer等语音识别模型能用mnn-llm跑吗？

#205 niusmall closed 3 months ago
1
Android arm平台 Llama-2-7b-chat-MNN输出乱码

#204 xiaoxiaoyuwen closed 2 months ago
2
[feat] add ios ci.

#203 wangzhaode closed 4 months ago
0
[refactor] refact ios project.

#202 wangzhaode closed 4 months ago
0
[feat] add python ci.

#201 wangzhaode closed 4 months ago
0
qwen2-1.5B get wront results on x86 and macos

#200 xingjinglu closed 2 months ago
9
2024.6.12 master分支Android构建报错

#199 bulletProofCat closed 3 months ago
1
[refactor] refactor build script and ci.

#198 wangzhaode closed 4 months ago
0
Refactor tokenizer, add config.json.

#197 wangzhaode closed 4 months ago
0
iOS运行闪退

#196 hadesh closed 4 months ago
1
"Killed" when loading a model.

#195 GrantLau1226 closed 5 months ago
0
iphone上运行闪退

#193 hadesh closed 4 months ago
1
llama2-7b回复错误与重复

#192 QIANXUNZDL123 closed 3 months ago
10
It's very good! But...

#191 GrantLau1226 closed 5 months ago
3
解决amr windows下一些文件编译失败的错误

#190 dignfei closed 2 months ago
1
llama3 model can not answer

#189 hyperbolic-c closed 4 months ago
2
修改Llama2_7b参数，导出mnn模型后在android设备上咯啊的、

#188 CarryFun closed 4 months ago
2
[Feature]支持MiniCPM

#187 zkh2016 closed 4 months ago
1
A: libc++abi: terminating due to uncaught exception of type std::out_of_range: unordered_map::at: key not found [1] 58628 abort ./cli_demo ../qwen1.5-0.5b-chat

#186 CoderXXLee closed 4 months ago
3
[1] 46941 segmentation fault ./cli_demo ../qwen-1.8b ../resource/prompt.txt

#185 CoderXXLee closed 4 months ago
1
Support MPI distribute computation over machine cluster

#184 hyperbolic-c closed 5 months ago
1
Missing a file for the llama3-8b-instruct-mnn model

#183 ghost closed 5 months ago
3
DeepSeek-coder Model Support

#182 hyperbolic-c closed 5 months ago
1
Support for Lora adapter layers for LLM inference

#181 TejasRavichandran1995 closed 5 months ago
3
生成参数

#180 Vincent131499 closed 5 months ago
1
android qwen1.5-0.5b: terminating with uncaught exception of type std::out_of_range: unordered_map::at: key not found

#179 DataXujing closed 6 months ago
2
How to Install and Use "Python Wrapper"? 如何安装使用Python版本？

#178 nlceyes closed 5 months ago
1
memory budget reduction

#177 huangzhengxiang closed 5 months ago
1
update by some optim

#176 triple-Mu closed 6 months ago
2
android手机对话时点发送闪退

#175 darengking closed 6 months ago
1
support python wrapper

#174 wangzhaode closed 7 months ago
0