-
We want limited cache functionality for persistence = true and data should be evicted as per PageReplacement policy used . But currently data is not evicting and project throws outOfMemoryException.
…
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
/home/ubuntu/.local/lib/python3.8/site-packages/torch/cuda/__init__.py:118: UserWar…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
### Your current environment
python3.11 vllm4.1 torch2.21-cu118
### 🐛 Describe the bug
here is my log with vllm, when inference gemma7b ,it shows 6 logs for one request which spend 30s ,…
-
### Describe the bug
As part of learning the setup, executing ignite-cli new PizzaApp fails, at least on my environment. It appears to fail on the sharp execution, with an exit code of 1. I've tried …
-
### Your current environment
```text
binishb.ttl@vzneuronsr01:~/Vipul$ python3.10 collect_env_vllm.py
Collecting environment information...
WARNING 08-20 12:51:20 ray_utils.py:34] Failed to impo…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTor…
-
### 🐛 Describe the bug
Compiled torch with `export _GLIBCXX_USE_CXX11_ABI=1`
```python
import os
import torch
class DummyModel(torch.nn.Module):
def __init__(self):
super(Dumm…
-
### Your current environment information
```
Collecting environment information...
PyTorch version: 2.1.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch:…
-
## Bug Description
In real-world scenarios, user features are constantly changing, so I must use a list as the input for the forward function.
but when I use list input, the torch_tensorrt.dynamo…