-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### Your current environment
The output of `python collect_env.py`
```text
Vllm version : 0.5.5
Nccl=2.20.5
Gpu : Telsa V100-sxm2-32GB
Cuda version : 12.6
Driver version : 560.28.03
`…
-
### Context
Historically, NNCF has maintained two sets of tensor statistics: the old tensor statistics and the new tensor statistics. The new tensor statistics, located in the `experimental/common/…
-
### Prerequisites
- [X] I have read the [ServerlessLLM documentation](https://serverlessllm.github.io/).
- [X] I have searched the [Issue Tracker](https://github.com/ServerlessLLM/ServerlessLLM/issue…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### **1. Quantum-Like Enhancements**
#### **a. Unitary Gate Operations**
- Implement additional quantum gates such as:
- **Pauli Gates (X, Y, Z)**: For flipping states or introducing phase sh…
-
Problem: CatBoostError: /src/catboost/catboost/private/libs/algo/tensor_search_helpers.cpp:99: This should be unreachable
catboost version: 1.26.4
Operating System: Ubuntu Linux
CPU: Intel x86
GPU…
8W9aG updated
3 months ago
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and [discussions](https://github.com/ultralytics/yolov5/discussions) and found no simi…
-
### Your current environment
vllm 0.5.2
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to b…
piood updated
2 weeks ago
-
### 🚀 The feature, motivation and pitch
I want to add 2D tensor parallelism and expert parallelism in vLLM. Which parts of the code should I modify?
### Alternatives
_No response_
### Additional c…