-
This is using [the unmerged PR](https://github.com/noahmartinwilliams/cuda/tree/release/0.12.2.0) version that addresses v0.12.2, but the error is actually the same on the `master` version.
Ubuntu …
-
Currently, inside qvisor, when actually calling cuda libraries, they are calling host cuda libraries, that is because quark is dynamiclly linking to different cuda libraries, e.g. libcudart.so https:/…
-
**Describe the bug**
In the following example, including the `#include "cutlass/gemm/device/gemm_universal_adapter.h"` line is causing CuPy to be unable to find the `qwert_entry0` function. Could inc…
-
### Contact Details
_No response_
### What happened?
I just downloaded [Meta-Llama-3.1-8B-Instruct.Q5_K_M.llamafile](https://huggingface.co/Mozilla/Meta-Llama-3.1-8B-Instruct-llamafile/blob/m…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### How you are installing vllm
I install vLLM using Souce code.
```python
pip install -e .
```
but encounter…
-
### Is this a duplicate?
- [x] I confirmed there appear to be no [duplicate issues](https://github.com/NVIDIA/cccl/issues) for this bug and that I agree to the [Code of Conduct](CODE_OF_CONDUCT.md)
…
-
I have added it to system varaible
\CUDA\v11.6\bin
\CUDA\v11.6\lib\x64
### System Info
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
C…
-
There's an issue with faster-whisper. Posting here for visibility and to see if there might be a better workaround.
```
Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.s…
-
### Description
This is probably more of an OpenXLA issue, feel free to close it if so.
The last version of XLA/Jaxlib is shipping without libdevice.so.10 and it looks for it elsewhere.
I am us…
-
### System Info
```
CentOS Linux release 7.8.2003 (Core)
NVIDIA A100-PCIE-40GB 1gpu
NVIDIA-SMI 535.104.05 Driver Version: 535.104.05 CUDA Version: 12.2
nvidia-cublas-cu12 …