-
### Describe the bug
We have a model called `elser_model_2_linux-x86_64.pt`. It can be downloaded from https://ml-models.elastic.co/elser_model_2_linux-x86_64.pt. As the name suggests it's been quant…
-
### Your current environment
```text
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC ve…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
_No …
-
### System Info
tensorrt 10.2.0
tensorrt_llm 0.12.0.dev2024072301
A100-80G * 4
### Who can help?
@Tracin
### Information
- [X] The official example scripts
- [ ] My…
-
### 🐛 Describe the bug
Dtensor shard uses more gpu memory than raw tensor.
With test, Shard gpu mem: 21890MiB > Replicate gpu mem: 17448MiB > Raw tensor gpu mem: 16804MiB.
Confused for a long time…
-
### 🐛 Describe the bug
When compiled autograd is enabled and model contains operations preferring inputs in channels last format, gradient and parameters memory layouts are inconsistent:
- parameter…
marok updated
2 weeks ago
-
### System Info
latest
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported ta…
-
I am getting nan outputs from the encoder of pruned transducer streaming model.
tensor([[[nan, nan, nan, ..., nan, nan, nan],
[nan, nan, nan, ..., nan, nan, nan],
[nan, nan, nan…
-
`python` is terminating immediately on startup with SIGILL:
```
$ python
Illegal instruction (core dumped)
```
I tried to debug with gdb but this also has the same problem!
```
$ gdb pyth…
-
# 在arm64 windows 电脑上没有识别出结果
脚本:
```bash
@echo off
setlocal
:: 指定模型路径
set MODEL_PATH=C:\\Users\\Admin123\\.cache\\modelscope\\hub\\lovemefan\\SenseVoiceGGUF\\gguf-fp16-sense-voice-small.bin
::…