-
### What is the issue?
## Issue Description:
From Ollama v0.4.0 onwards, the `libhipblas.so.2` and `libhipblas.so.2.1.60102` files are no longer present in the `ollama-linux-amd64-rocm.tgz` arch…
-
### Your current environment
AMD radon + kubernetes
### Model Input Dumps
`vllm serve mistralai/Mistral-7B-Instruct-v0.3 --trust-remote-code --enable-chunked-prefill --max_num_batch…
-
In CMSSW_14_2_ROCM_X_2024-11-06-2300 we observe multiple Unit test and RelVal failures:
| What failed | Description |
| ----------- | ----------- |
| [DataFormats/SoATemplate/testRocmSoALayout…
-
As I love using Radeons under Linux I would happy to see rocm support.
Do you plan to support rocm/AMD in the future?
-
anyway to add support for ROCM?
-
Hi @hongxiayang @hliuca ,
It seems like float8 training using `torchao.float8` is not support at the moment. Is there a different library or code path I should be using for float8 training or what …
-
I wish I new enough to help with this project. So intially, I want to express appreciation for the effort going into this project. I see that initial CUDA support has been added. Would like to request…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
Expo…
-
Hello!
I work on the `vllm-project`. I worked in the past with FBGEMM for Llama-405B launch in VLLM. As part of our 2025 roadmap planning, we are evaluating options for Fp8 compute on ROCm. I noti…
-
I have a bit of an oddball environment and wanted to document issues with it.
firstly you have to get rocm setup and working. this is a bit off topic but it takes a bit of effort.
Then you can …