issues
search
shell-nlp
/
gpt_server
gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。
Apache License 2.0
101
stars
11
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
【请教】大佬请教一下config.yaml
#16
taurusduan
opened
1 week ago
4
docker容器运行Qwen2.5-7b报错:TextEncodeInput must be Union
#15
wzs1566
closed
1 week ago
11
qwen2-vl系列模型兼容
#14
aaadrain
opened
2 weeks ago
1
依赖好多
#12
pc-mysql
closed
2 months ago
2
会不会考虑支持多模态模型
#11
ehlxr
closed
3 weeks ago
10
http api 请求 reranker 模型报错
#10
ehlxr
closed
3 months ago
4
纯CPU无法启动
#9
firstjack
closed
2 months ago
2
加载Embedding模型时，指定使用CPU，但还是加载到GPU
#8
lkfs74
closed
3 months ago
2
【求助】构建镜像出错
#7
taurusduan
closed
1 week ago
10
rerank模型能否支持 http://ip:8082/v1/rerank 调用？
#6
edisonzf2020
closed
4 months ago
3
embedding/reranker加速推理
#5
shell-nlp
closed
2 months ago
0
推理后端及接口问题（支持 tools功能 ）
#4
315930399
closed
3 months ago
6
在windows下执行异常
#3
firstjack
closed
5 months ago
14
support vllm
#2
shell-nlp
closed
8 months ago
1
support LMDeploy
#1
shell-nlp
closed
5 months ago
1