-
Hello
as you known, in the k8s scenario ， The application will occupy a GPU card exclusively ，So does our platform offer some implementation of virtualization? For example, CUDA API hijacking, etc.…
-
### Your current environment
```
# python collect_env.py
WARNING 11-08 16:53:16 cuda.py:23] You are using a deprecated `pynvml` package. Please install `nvidia-ml-py` instead, and make sure to un…
Bihan updated
2 weeks ago
-
GPU: RX 6700XT
host/VM: windows 11 24h2
driver: 24.9.1
I created a VM using [Hyper-V GPU Paravirtualization](https://github.com/jamesstringerparsec/Easy-GPU-PV). The GPU is visible in the VM, I can…
-
PC Details:
Base Board Information
Manufacturer: ASUSTeK COMPUTER INC.
Product Name: NUC14RVB
Version: 60AS0080-MB0A01
Serial Number: *******
Distributor ID: …
-
[model_input.txt](https://github.com/user-attachments/files/17492230/model_input.txt)
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment inform…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0
Is debug build: False
CUDA used to build PyTorch: 12.1…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
### 🐛 Describe the bug
getting inconsistent results on CPU and GPU when computing torch.nn.BatchNorm1d
```python #
#include
#include
int main() {
torch::Tensor input = torch::tenso…
-
### Your current environment
```text
WARNING 11-14 02:19:07 _custom_ops.py:20] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm._C'")
Collecting environment information…
-
### This issue respects the following points:
- [x] This is a **bug**, not a question or a configuration issue; Please visit our forum or chat rooms first to troubleshoot with volunteers, before crea…