-
单样本推理做image caption,f16+flash_atten,为了节省内存加的操作:
![bug](https://github.com/user-attachments/assets/65e4e8aa-6cc6-4564-bc12-4df7db1b4b7c)
CUDA error: device-side assert triggered
CUDA kernel errors…
-
Hello, I really appreciate the chai_lab you and your team developed. I have tried the server and compared it with AF3. Now I want to deploy it locally. I have successfully installed it, but there is a…
-
### Required prerequisites
- [X] Search the [issue tracker](https://github.com/NVIDIA/cuda-quantum/issues) to check if your feature has already been mentioned or rejected in other issues.
### Descri…
-
Dear author,
I am sure that all the versions of my packages are correct. I used CUDA version 10.1 to adapt to Torch version 1.4.
However, I meet an error when Evaluation as follows:
Traceback (most…
-
pip install git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch
Collecting git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch
Cloning https://github.com/NV…
-
### 🐛 Describe the bug
When running
python test/distributed/test_c10d_nccl.py -k test_nan_assert_float16 on a H100x2 platform,
the current nightly (and likely v2.5.0 RC) is producing the follo…
-
Main question: Do we want to the same project docs with `cuda.py` (#70) & `cuda.bindings` (#75) coexist say under separate tabs or pages, or do we want each namespace package to have their own doc pag…
-
I encountered some problems when I tried to install raytracing package:
The detected CUDA version (11.7) mismatches the version that was used to compile
PyTorch (10.2). Please make sure to us…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
I'm using gpu-2.0.0-ls31, and just doing a basic call to the whisper library like i did…
-
## List of Non-Deterministic Operations in PyTorch
The following operations in PyTorch exhibit non-deterministic behavior according to the ```torch.use_deterministic_algorithms``` [documentation](h…