-
### Describe the bug
Training a model with an LSTM module causes a segmentation fault after loss.backward() has been called a random number of times. The number of times the training loop can run …
-
# Quantified with the Yolov5 model, the MAP@0.5 is high(around 0.47), but the detection results are outrageous and unexpected
These days I have tried to do some quantification with yolov5_nano by …
-
## Proposed refactor
We can add `__all__` in `__init__.py` file in order to remove F401 error and avoids the module imports.
```python
{
...,
'accelerator': ,
'Accelerator': ,
…
-
### 🐛 Describe the bug
Since torch 2.2.0, the performance regression of `conv_transpose1d` has occurred on CPU (#120982).
torch 2.4.0 (w/ OneDNN 3.4.2) perfectly **fixed** the regression **only when…
-
**Is your feature request related to a problem? Please describe.**
For now the Tensorflow and ONNX backends in Triton support thread controls ([here](https://github.com/triton-inference-server/tens…
-
## Bug Description
In real-world scenarios, user features are constantly changing, so I must use a list as the input for the forward function.
but when I use list input, the torch_tensorrt.dynamo…
-
大佬,之前看到这个项目一直在测试模型,我这边目前使用的是llamacpp,因为有公司这边的服务器,所以是用cpu的,速度10t/s。公司内部用足够了。
知识库用到的模型:
Qwen2.5-14B:q4
bge-reranker-base
Dmeta-embedding-zh-small
大佬这是我这边使用的模型,不知道能不能改成使用cpu的,非常感谢。
# 后台启动 noh…
-
Platforms: linux
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_profiler_mark_wrapper_call_dynamic_shapes_cpu&suite=DynamicShape…
-
### System Info
```Shell
- `Accelerate` version: 0.33.0
- Platform: Linux-5.15.0-1067-azure-x86_64-with-glibc2.31
- `accelerate` bash location: /home/azureuser/miniconda3/envs/pytorch/bin/accelerat…
-
### Your current environment
```text
The output of `python collect_env.py`
```
Collecting environment information...
PyTorch version: 2.0.1+cu117
Is debug build: False
CUDA used to build PyTorc…