-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
Train, Export
### Bug
…
-
### System Info
P4D (A100 40 GB x 8)
### Who can help?
@juney-nvidia @byshiue
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially sup…
vnkc1 updated
2 months ago
-
### What happened + What you expected to happen
I'm testing `num_gpus` feature on a 4 MI210 machine. When running test_amd.py with `ROCR_VISIBLE_DEVICES=0,1` and `num_gpus=1` on task and actors, ta…
-
Hi,
It seems this bug is still there.
Heres the testing code
```
from transformers import AutoModelForCausalLM,AutoTokenizer
import inseq
import torch
model_name = "lmsys/vicuna-7b-v1.1…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and f…
-
Is there a way to either run this on an AMD GPU or run it on the CPU? I get this error now: /convert.py", line 829, in multi_round_qa_to_multi_round_qa_model_by_batch
device = f"cuda:{(idx or 0)…
-
### Your current environment
vllm(0.3.3) on ray(2.10.0) cluster deployed by docker on 2 nodes with 2 GPU(Tesla T4) each.
linux environment
root@ai151:/vllm-workspace# env
NV_LIBCUB…
-
![2024-07-17 09-39-49 的屏幕截图](https://github.com/user-attachments/assets/95b5d65c-dc3e-4f30-a0a2-07d698455434)
-
based projA module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some modul…
-
The RTX 3080 Ti is set with half_precision_backend: 'auto' and fp16=True, but it’s not effective and memory usage is not reduced. What could be the possible reasons?