Closed younseojava closed 3 months ago
Hi @younseojava, thanks for the PR. For 0.5, we have simplify a lot of the internal logics and decided to use vLLM as the current running backend for now. Which means AMD support will come from vLLM.
I will close the PR for now. Looking forward for future collab :)
Actually, there is a code path that we are still using this; I will reopen this.
Can you fix the merge conflict? ths.
This is first attempt to enable ROCm for AMD GPUs. It consists of