issues
search
EmbeddedLLM
/
vllm
vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
https://vllm.readthedocs.io
Apache License 2.0
89
stars
5
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[Feature]: vllm 0.4.1 in ROCM
#27
linchen111
closed
1 week ago
1
[Installation]: Is Branch v0.4.0.post1-rocm available for rocm-5.7?
#26
fangtaosong
opened
6 months ago
2
Vllm multi lora rocm
#25
tjtanaa
closed
2 weeks ago
0
Support image processing for VLMs and GPT-4V Chat Completions API
#24
DarkLight1337
closed
7 months ago
0
vLLM >= 0.2.4 with ROCm 5.6.1
#23
ekazakos
closed
1 week ago
1
vllm 0.1.4 with ROCm 5.6
#22
ekazakos
closed
8 months ago
0
Unable to load models on RX 6800
#21
nonetrix
opened
9 months ago
3
V0.2.4 rocm codspeed
#20
haoshan98
closed
11 months ago
0
Model architectures ['MixtralForCausalLM'] are not supported for now
#19
FaraneJalaliFarahani
opened
11 months ago
2
Update vLLM Documentations
#18
tjtanaa
closed
11 months ago
0
Merge latest working rocm branch
#17
tjtanaa
closed
11 months ago
0
Breaking API changes from vllm upstream
#16
tjtanaa
closed
11 months ago
0
Checked CUDA ROCm Compatibility
#15
tjtanaa
closed
11 months ago
0
Compatible GPU architectures
#14
TheJKM
closed
11 months ago
3
[Do Not Merge] Change Highlight to Prepare Merging into vLLM Main
#13
tjtanaa
closed
11 months ago
3
Merging with vLLM main branch
#12
zhuohan123
closed
11 months ago
2
benchmark-latncy test bug???
#11
wpf19911118
closed
11 months ago
2
AssertionError assert output == other_output
#10
shangshng
closed
11 months ago
3
ImportError: cannot import name 'cuda_utils' from partially initialized module 'vllm'
#9
wpf19911118
closed
1 year ago
2
Conflicts version of PyTorch on ROCm
#8
JIANGJZ
closed
1 year ago
0
V0.1.4 rocm update readme
#7
kliuae
closed
1 year ago
0
Update README
#6
kliuae
closed
1 year ago
0
Updated docker file
#5
kliuae
closed
1 year ago
0
Roadmap
#4
tjtanaa
opened
1 year ago
4
Update README
#3
kliuae
closed
1 year ago
0
Merge changes from @pcmoritz/vllm-public
#2
tjtanaa
closed
1 year ago
0
ROCm Port
#1
kliuae
closed
1 year ago
0