EmbeddedLLM vllm-rocm issues

EmbeddedLLM / vllm-rocm

vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

https://vllm.readthedocs.io

Apache License 2.0

83 stars 5 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[Feature]: vllm 0.4.1 in ROCM

#27 linchen111 opened 2 months ago
0
[Installation]: Is Branch v0.4.0.post1-rocm available for rocm-5.7?

#26 fangtaosong opened 2 months ago
1
Vllm multi lora rocm

#25 tjtanaa opened 2 months ago
0
Support image processing for VLMs and GPT-4V Chat Completions API

#24 DarkLight1337 closed 2 months ago
0
vLLM >= 0.2.4 with ROCm 5.6.1

#23 ekazakos opened 4 months ago
0
vllm 0.1.4 with ROCm 5.6

#22 ekazakos closed 4 months ago
0
Unable to load models on RX 6800

#21 nonetrix opened 5 months ago
2
V0.2.4 rocm codspeed

#20 haoshan98 closed 6 months ago
0
Model architectures ['MixtralForCausalLM'] are not supported for now

#19 FaraneJalaliFarahani opened 6 months ago
0
Update vLLM Documentations

#18 tjtanaa closed 6 months ago
0
Merge latest working rocm branch

#17 tjtanaa closed 7 months ago
0
Breaking API changes from vllm upstream

#16 tjtanaa closed 7 months ago
0
Checked CUDA ROCm Compatibility

#15 tjtanaa closed 7 months ago
0
Compatible GPU architectures

#14 TheJKM closed 7 months ago
3
[Do Not Merge] Change Highlight to Prepare Merging into vLLM Main

#13 tjtanaa closed 7 months ago
3
Merging with vLLM main branch

#12 zhuohan123 closed 6 months ago
2
benchmark-latncy test bug???

#11 wpf19911118 closed 6 months ago
2
AssertionError assert output == other_output

#10 shangshng closed 7 months ago
3
ImportError: cannot import name 'cuda_utils' from partially initialized module 'vllm'

#9 wpf19911118 closed 7 months ago
2
Conflicts version of PyTorch on ROCm

#8 JIANGJZ closed 7 months ago
0
V0.1.4 rocm update readme

#7 kliuae closed 7 months ago
0
Update README

#6 kliuae closed 7 months ago
0
Updated docker file

#5 kliuae closed 8 months ago
0
Roadmap

#4 tjtanaa opened 8 months ago
4
Update README

#3 kliuae closed 8 months ago
0
Merge changes from @pcmoritz/vllm-public

#2 tjtanaa closed 8 months ago
0
ROCm Port

#1 kliuae closed 8 months ago
0