issues
search
MegEngine
/
InferLLM
a lightweight LLM model inference framework
Apache License 2.0
695
stars
86
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
SG2042 服务器 make 出错
#85
JocelynPanPan
opened
3 weeks ago
0
无法加载模型bin或者guff模型
#84
velonica0
opened
2 months ago
0
有打算支持qwen吗
#83
Gooddz1
opened
5 months ago
0
在树莓派3b+上部署，出现无法打开模型的问题
#82
Dominic23331
opened
5 months ago
4
feat(chatglm3-6B): support chatglm3-6B
#81
xyc0123456789
closed
6 months ago
2
这个有windows的部署教程吗
#80
ASHLEYDX
opened
6 months ago
0
[CI] Create CI Flow
#79
QingChuanWS
closed
6 months ago
1
How to build wasm file?
#78
njalan
closed
6 months ago
0
在运行llama2-13b的时候出现以下问题
#77
Wowoho
opened
7 months ago
0
移植问题
#76
yinghuo302
opened
9 months ago
0
请问可以在不支持V扩展的RISC-V CPU上运行吗
#75
TheKiteRunner24
opened
10 months ago
1
可以在RV64指令集的CPU上运行吗
#74
TheKiteRunner24
closed
10 months ago
0
I got the error on centos 7: failed to tokenize string!
#73
Mignet
opened
11 months ago
2
chatglm3有计划支持吗？
#72
sunzhe09
opened
11 months ago
3
arm 平台输出乱码
#71
tanjatang
opened
11 months ago
3
mac os Big Sur 11.7.4 Linking Error , Undefined symbols
#70
junlong
closed
11 months ago
1
请问是否有计划支持Whisper？
#69
nxprxf
closed
1 year ago
1
Corrected small typo in ReadMe
#68
TusharAMD
closed
1 year ago
2
chatglm2 GPU版本的int4、int8量化模型预测结果异常
#67
itfish1990
closed
1 year ago
1
ChatGLM2 效果异常
#66
adf1178
closed
1 year ago
1
能否改为GPU辅助计算
#65
bzy-080408
opened
1 year ago
6
quantizer: refine and support q8
#64
xhebox
closed
1 year ago
1
【new feature】通义千问有没有计划支持
#63
guangyuanyu
opened
1 year ago
2
new thread worker test
#62
xhebox
closed
1 year ago
7
Thread wakening may be bottom neck for large core systems
#61
xhebox
opened
1 year ago
8
O3 optimization are slower on SG2042
#60
xhebox
opened
1 year ago
3
Please support RWKV for refs and compare.
#59
xiaol
opened
1 year ago
0
unsupported relocation 37 on musl libc
#58
xhebox
closed
1 year ago
3
feat: int8 support
#57
xhebox
closed
1 year ago
4
请问一下，这个是不是比python的性能更好？
#56
wuent
opened
1 year ago
1
chore: do not set C(XX)FLAGS for rvv
#55
xhebox
closed
1 year ago
3
make error
#54
forwiat
opened
1 year ago
13
大模型推理中这个推理引擎如何支持 lora，ptuning等私有语料训练插件后的新模型
#53
leoluopy
opened
1 year ago
2
chore: add rvv to README
#52
xhebox
closed
1 year ago
1
请问主循环中的token指代的是什么呢？函数体内部也没有看出来是代表什么
#51
wangxu569
opened
1 year ago
1
目前不支持gpu跑吗？我看代码中有添加对gpu的支持啊
#50
sf9218
opened
1 year ago
2
feat: rvv support
#49
xhebox
closed
1 year ago
2
feat: rvv support
#48
xhebox
closed
1 year ago
0
希望可以封装openai兼容API
#47
nexx5
opened
1 year ago
0
feat: general backend
#46
xhebox
closed
1 year ago
8
some minor improvement
#45
xhebox
closed
1 year ago
3
【feature】baichuan-7b模型能不能使用baichuan-vicuna-chinese-7b模型文件
#44
guangyuanyu
opened
1 year ago
0
Compile error: void inferllm::BaiChuanGraph::constuct_llm()? marked ?override?, but does not override
#43
cjia4
closed
1 year ago
4
ChatGLM 2已经出了，什么时候可以支持一下啊
#42
kungrainbow
opened
1 year ago
10
chatglm-6b下的模型格式不正确
#41
wildkid1024
closed
1 year ago
1
feat: support baichuan model
#40
chenqy4933
closed
1 year ago
0
fix: fix typo
#39
rejoicesyc
closed
1 year ago
1
没有支持最新的llama.cpp的格式吗
#38
AceyKubbo
opened
1 year ago
0
Fixed an undefined variable in a optimized_x86.h file
#37
IanVzs
closed
1 year ago
1
docs(project): add alpaca and chatglm profiling
#36
tpoisonooo
closed
1 year ago
1
Next