-
### Description
I updated my nvidia driver
`nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Mon_Apr__3_17:16:06_PDT_2023
Cuda compilation tools, releas…
lyysl updated
7 months ago
-
Hi,I meet some questions when I verify that GDS installation was successfulI. I've already installed MLNX_OFED driver and had one NVMe SSD. But when I run **./gdscheck.py -p**, it's still showing that…
-
hello expert,
I am suffering this cmake error, could you please take a look at.
I can build bam and run benchmark well under my ubuntu20.04.3 and installed NV driver 560, CUDA 12.6
```
root@sal…
-
I tried running the BERT example found here https://github.com/chengchingwen/Transformers.jl/blob/master/example/BERT/_pretrain/pretrain.jl but I got the following error on the train!() line at the bo…
-
### Your current environment
- vLLM CPU : v0.6.0
- Hardware: Intel(R) Xeon(R) Platinum 8480+ CPU
- Model: google/gemma-2-2b
### 🐛 Describe the bug
vLLM v0.6.0 (cpu) is throwing below erro…
-
### 🐛 Describe the bug
I was trying to distribute some model using tensor parallelization, but I ran into a grad output type mismatch when I enabled compile. Note, I was not using loss parallel her…
-
Thanks for helping to solve this problem
-
**Update: see below for error on lastest 1.8-beta3**
During Installation
When trying to install Pytorch deps with GPU support, `pip` kept installing a different PyTorch version in the second com…
-
While I don't think this is a bug in apex code, I think **technically it's a deficiency in the documentation**.
Having counted the number of people in the Issues tab/stackoverflow/etc etc whose iss…
-
Hi @kaby76 Could you explaine a little bit about the difference betwee [ManagedCuda](https://github.com/kunzmi/managedCuda) and `Campy`? I'm just confusied to choose.