-
### System Info
P4D (A100 40 GB x 8)
### Who can help?
@juney-nvidia @byshiue
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially sup…
vnkc1 updated
2 months ago
-
Hi,
It seems this bug is still there.
Heres the testing code
```
from transformers import AutoModelForCausalLM,AutoTokenizer
import inseq
import torch
model_name = "lmsys/vicuna-7b-v1.1…
-
Is there a way to either run this on an AMD GPU or run it on the CPU? I get this error now: /convert.py", line 829, in multi_round_qa_to_multi_round_qa_model_by_batch
device = f"cuda:{(idx or 0)…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and f…
-
### Your current environment
vllm(0.3.3) on ray(2.10.0) cluster deployed by docker on 2 nodes with 2 GPU(Tesla T4) each.
linux environment
root@ai151:/vllm-workspace# env
NV_LIBCUB…
-
hello,
when I run code `python mbyolo_train.py --task train --data ultralytics/cfg/datasets/coco.yaml \
--config ultralytics/cfg/models/v8/mamba-yolo.yaml \
--amp --project ./output_dir/mscoco --…
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and [discussions](https://github.com/ultralytics/yolov5/discussions) and found no simi…
-
File "/Mamba-YOLO-main/ultralytics/nn/modules/common_utils_mbyolo.py", line 125, in forward
out, x, *rest = selective_scan_cuda_core.fwd(u, delta, A, B, C, D, delta_bias, delta_softplus, 1)
Run…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I want to use the semantic splitter from llamaindex for document segmentation. Is…
-
### Tested versions
- pyannote-audio 3.1.1
- cuda version 11.8
- torch 2.2.1+cu118
### System information
SUSE Linux 15 SP3 - pyannote.audio-3.1.1 - ALCF Polaris
### Issue description
I tried t…