issues
search
wangzhaode
/
mnn-llm
llm deploy project based mnn.
Apache License 2.0
1.45k
stars
159
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
使用vulkan后端进行qwen1.5b的推理时,报Don't support type [Attention], Attention/Reshape_8_output_0错误
#224
RisingEntropy
opened
4 days ago
0
Feature/add docs
#223
ddbbcc
closed
2 weeks ago
0
mnn-llm 使用cuda 后端执行时,每次结果都是不一样的。
#222
BaofengZan
opened
3 weeks ago
3
lmm.weight和lmm.json如何生成呢?
#221
BaofengZan
closed
3 weeks ago
0
[feat] add docs.
#220
wangzhaode
closed
1 month ago
0
在Android 上加载Gamma2 2B的时候Demo App 闪退
#219
chenminjun-web
opened
1 month ago
1
在 Android 上用 OpenCL 跑 Qwen-VL 报空指针
#218
GJYWorld
closed
6 days ago
1
2024.9.18,是否支持当前最新版本的mnn的master分支
#217
tianmala
closed
1 week ago
1
LLM sample with temperature parameters
#216
Ma-Dan
opened
1 month ago
0
安卓14 编译完成后 ,运行demo 报错
#215
ddbbcc
closed
3 weeks ago
1
clone 了最新的代码, 然后安装了apk,下载了模型,然后push进去了,app闪退了
#214
1eas7
closed
3 weeks ago
7
Android App Crashed -“std::out_of_range: unordered_map::at: key not found”
#213
FranzKafkaYu
closed
3 weeks ago
1
Qwen1.5-1.8B模型转换问题
#212
robben225
closed
3 months ago
3
ARM linux开发板Qwen2 1.5B加载成功,推理报错terminate called after throwing an instance of 'std::out_of_range' what(): _Map_base::at
#211
MosRat
closed
2 months ago
2
cli_demo android test failed
#210
WenguoLi
closed
3 months ago
1
qwen2-1.5B get wront results on windows
#209
ddbbcc
closed
2 months ago
1
您好,能不能提供一下 armv8a 支持在 gpu 运行的 MMN 的 so
#208
GJYWorld
closed
3 months ago
0
android端推理crash
#207
robben225
closed
3 months ago
1
config.json中的字段是否修改过,android工程无法运行
#206
LHB116
closed
3 months ago
1
请问whisper、paraformer等语音识别模型能用mnn-llm跑吗?
#205
niusmall
closed
3 months ago
1
Android arm平台 Llama-2-7b-chat-MNN输出乱码
#204
xiaoxiaoyuwen
closed
2 months ago
2
[feat] add ios ci.
#203
wangzhaode
closed
4 months ago
0
[refactor] refact ios project.
#202
wangzhaode
closed
4 months ago
0
[feat] add python ci.
#201
wangzhaode
closed
4 months ago
0
qwen2-1.5B get wront results on x86 and macos
#200
xingjinglu
closed
2 months ago
9
2024.6.12 master分支Android构建报错
#199
bulletProofCat
closed
3 months ago
1
[refactor] refactor build script and ci.
#198
wangzhaode
closed
4 months ago
0
Refactor tokenizer, add config.json.
#197
wangzhaode
closed
4 months ago
0
iOS运行闪退
#196
hadesh
closed
4 months ago
1
"Killed" when loading a model.
#195
GrantLau1226
closed
5 months ago
0
iphone上运行闪退
#193
hadesh
closed
4 months ago
1
llama2-7b回复错误与重复
#192
QIANXUNZDL123
closed
3 months ago
10
It's very good! But...
#191
GrantLau1226
closed
5 months ago
3
解决amr windows下一些文件编译失败的错误
#190
dignfei
closed
2 months ago
1
llama3 model can not answer
#189
hyperbolic-c
closed
4 months ago
2
修改Llama2_7b参数,导出mnn模型后在android设备上咯啊的、
#188
CarryFun
closed
4 months ago
2
[Feature]支持MiniCPM
#187
zkh2016
closed
4 months ago
1
A: libc++abi: terminating due to uncaught exception of type std::out_of_range: unordered_map::at: key not found [1] 58628 abort ./cli_demo ../qwen1.5-0.5b-chat
#186
CoderXXLee
closed
4 months ago
3
[1] 46941 segmentation fault ./cli_demo ../qwen-1.8b ../resource/prompt.txt
#185
CoderXXLee
closed
4 months ago
1
Support MPI distribute computation over machine cluster
#184
hyperbolic-c
closed
5 months ago
1
Missing a file for the llama3-8b-instruct-mnn model
#183
ghost
closed
5 months ago
3
DeepSeek-coder Model Support
#182
hyperbolic-c
closed
5 months ago
1
Support for Lora adapter layers for LLM inference
#181
TejasRavichandran1995
closed
5 months ago
3
生成参数
#180
Vincent131499
closed
5 months ago
1
android qwen1.5-0.5b: terminating with uncaught exception of type std::out_of_range: unordered_map::at: key not found
#179
DataXujing
closed
6 months ago
2
How to Install and Use "Python Wrapper"? 如何安装使用Python版本?
#178
nlceyes
closed
5 months ago
1
memory budget reduction
#177
huangzhengxiang
closed
5 months ago
1
update by some optim
#176
triple-Mu
closed
6 months ago
2
android手机对话时点发送闪退
#175
darengking
closed
6 months ago
1
support python wrapper
#174
wangzhaode
closed
7 months ago
0
Next