issues
search
OpenBMB
/
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
https://docs.vllm.ai
Apache License 2.0
10
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[Installation]: 安装报告找不到numpy，实际nump已经安装好了
#14
qq745639151
opened
3 weeks ago
1
[Installation]: Building wheel for vllm (pyproject.toml) did not run successfully
#13
DiaQusNet
opened
3 weeks ago
1
[Bug]: Model architectures ['MiniCPM3ForCausalLM'] are not supported for now. Supported architectures:
#12
LeoMax-Xiong
opened
3 weeks ago
0
[Usage]: minicpm分支推理多图和视频的时候，跑完一帧会报这个warring就不继续推理了，也没有最终的结果输出。
#11
NaLucia
opened
1 month ago
1
[Bug]: MiniCPM-V-2 does not appear to have a file named preprocessor_config.json
#10
yangJirui
closed
2 months ago
1
[Usage]: openbmb-MiniCPM-Llama3-V-2_5 在vllm上无法多gpu使用
#9
renjingneng
opened
2 months ago
2
[Usage]: openbmb-MiniCPM-Llama3-V-2_5 在vllm的兼容openai接口服务下无法使用
#8
renjingneng
closed
2 months ago
3
[Doc]: minicpmv2 inference
#7
xiaohuihui52309
opened
2 months ago
0
[Usage]: MiniCPM-Llama3-V 2.5 使用vllm 报错：AttributeError: 'list' object has no attribute 'to'
#6
renjingneng
closed
2 months ago
5
多张卡推理Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:3!
#5
lys791227
opened
2 months ago
0
[Usage]: 推理报错
#4
bravelll
opened
2 months ago
1
[Usage]: 请问是否支持batch 推理？
#3
pandaGst
opened
3 months ago
1
[Installation]: NameError: name 'vllm_ops' is not defined
#2
Ajay-Wong
opened
3 months ago
2
[Bug]: ```text The output of `python minicpmv_example.py` ``` File "/data/envs/jh_llava/lib/python3.10/site-packages/vllm/model_executor/model_loader/utils.py", line 35, in get_model_architecture ValueError: Model architectures ['MiniCPMV'] are not supported for now. Supported architectures: 这个问题是环境版本的问题吗？ 如果是的话能提供一下正确的版本吗
#1
zjh908491372
opened
3 months ago
2