pcg-mlp KsanaLLM issues

pcg-mlp / KsanaLLM

Other

286 stars 30 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

关于代码逻辑的理解

#31 gtarcoder closed 1 day ago
2
Update readme for image path of wechat QR Code

#30 ShuZihan closed 2 weeks ago
0
Fix typo error.

#29 spxcds closed 2 months ago
0
Fix typo error.

#28 spxcds closed 2 months ago
0
支持 fp8 量化

#27 sfyumi closed 2 months ago
3
910B2C部署llama2-7b在推理时失败

#26 dengyingxu opened 3 months ago
17
是否是不支持Qwen1.5-7B-Chat？

#25 dengyingxu closed 3 months ago
4
910B2C上运行服务core dump

#24 dengyingxu closed 3 months ago
1
910B上配置项目失败

#23 dengyingxu closed 3 months ago
8
你好，请问有计划支持aarch64架构上的910B吗

#22 yanzhuo77 closed 3 months ago
2
使用WSL2 编译过程中发生异常 error: ‘mha_varlen_fwd’ was not declared in this scope

#21 old-tomato closed 3 months ago
1
A

#20 hadoop2xu-hash closed 3 months ago
0
KsanaLLM在主流模型上的性能和现有的推理框架相比（vllm/lmdeploy/trt-llm/fast-transformer等）性能/吞吐数据如何

#19 Greatpanc opened 3 months ago
10
有计划支持多模态大模型吗？

#18 sfyumi closed 3 months ago
2
ksanallm complile error

#17 chenpinganan closed 3 months ago
1
fatal error: 'type_traits' file not found

#16 unmu closed 3 months ago
1
libtorch_serving导入失败

#15 nihao1997 closed 4 months ago
20
版本问题

#14 nihao1997 closed 5 months ago
2
【紧急】在910B上运行llama2-7b报错

#13 zhaochaoxing closed 5 months ago
9
编译时 undefined reference to `mha_varlen_fwd

#12 lovelynight closed 5 months ago
2
A

#11 lovelynight closed 5 months ago
0
如何在aarch64架构上编译项目

#10 unmu closed 5 months ago
1
Ascend 运行 qwen1.5 segment fault 了

#9 chenqy4933 closed 5 months ago
1
是否支持：idm-vton? SDXL系列的加速呢？

#8 awzhgw closed 5 months ago
1
服务启动失败

#7 yosure closed 5 months ago
2
在A100上跑qwen1.5-72B-chat-tp4会卡住

#6 mjp9527 closed 5 months ago
3
No module named 'libtorch_serving'

#5 LiweiPE closed 5 months ago
5
Support for Qwen-v1.5-110b

#4 Superskyyy closed 5 months ago
6
Fix README inconsistency in terms of wording and formatting

#3 Superskyyy closed 5 months ago
0
A typo on wight

#2 johnshajiang closed 5 months ago
1
error: downloading 'https://mirrors.tencent.com/github.com/jbeder/yaml-cpp/archive/yaml-cpp-0.6.2.tar.gz' failed

#1 WangxuP closed 5 months ago
2