-
### Your current environment
```text
Collecting environment information...
/home/daniel/.pyenv/versions/vllm/lib/python3.11/site-packages/transformers/utils/hub.py:124: FutureWarning: Using `TRAN…
-
### Your current environment
These is the 0.5.0 environments
### 🐛 Describe the bug
**1、These log files:**
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-package…
-
I want to use vllm and the model amazon/FalconLite2 which can be found https://huggingface.co/amazon/FalconLite2 for benchmarking throughput and latencies. However, the model is not supported by vllm.…
-
### OpenVINO Version
_No response_
### Operating System
Ubuntu 22.04 (LTS)
### Device used for inference
iGPU
### OpenVINO installation
Build from source
### Programming Language
C++
### Har…
-
### Your current environment
```
Collecting environment information...
PyTorch version: 2.3.0
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 2…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTor…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
/home/irteamsu/miniconda3/envs/jongho/lib/python3.10/site-packages/torch/dist…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N…
-
It seems rather counterintuitive to force boxing of video frames for the API. When attempting to do real-time interactive applications like web based remote desktop, low latency is key and MSE forces …