OpenBMB vllm issues - Githubissues

OpenBMB / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://docs.vllm.ai

Apache License 2.0

11 stars 5 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Installation]: 安装报告找不到numpy，实际nump已经安装好了

#14 qq745639151 opened 2 months ago
1
[Installation]: Building wheel for vllm (pyproject.toml) did not run successfully

#13 DiaQusNet opened 2 months ago
1
[Bug]: Model architectures ['MiniCPM3ForCausalLM'] are not supported for now. Supported architectures:

#12 LeoMax-Xiong opened 2 months ago
0
[Usage]: minicpm分支推理多图和视频的时候，跑完一帧会报这个warring就不继续推理了，也没有最终的结果输出。

#11 NaLucia opened 2 months ago
1
[Bug]: MiniCPM-V-2 does not appear to have a file named preprocessor_config.json

#10 yangJirui closed 3 months ago
1
[Usage]: openbmb-MiniCPM-Llama3-V-2_5 在vllm上无法多gpu使用

#9 renjingneng opened 3 months ago
2
[Usage]: openbmb-MiniCPM-Llama3-V-2_5 在vllm的兼容openai接口服务下无法使用

#8 renjingneng closed 3 months ago
3
[Doc]: minicpmv2 inference

#7 xiaohuihui52309 opened 4 months ago
0
[Usage]: MiniCPM-Llama3-V 2.5 使用vllm 报错：AttributeError: 'list' object has no attribute 'to'

#6 renjingneng closed 3 months ago
5
多张卡推理Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:3!

#5 lys791227 opened 4 months ago
0
[Usage]: 推理报错

#4 bravelll opened 4 months ago
1
[Usage]: 请问是否支持batch 推理？

#3 pandaGst opened 4 months ago
1
[Installation]: NameError: name 'vllm_ops' is not defined

#2 Ajay-Wong opened 4 months ago
2
[Bug]: ```text The output of `python minicpmv_example.py` ``` File "/data/envs/jh_llava/lib/python3.10/site-packages/vllm/model_executor/model_loader/utils.py", line 35, in get_model_architecture ValueError: Model architectures ['MiniCPMV'] are not supported for now. Supported architectures: 这个问题是环境版本的问题吗？如果是的话能提供一下正确的版本吗

#1 zjh908491372 opened 4 months ago
2