-
### 🐛 Describe the bug
🐛 Describe the bug
I'm trying to run the sample end-to-end network in LibTorch to test my configurations (https://pytorch.org/cppdocs/frontend.html#end-to-end-example). Howe…
-
### Your current environment
The output of `python collect_env.py`
```text
python collect_env.py
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
C…
-
这是怎么回事？
-
### 🐛 Describe the bug
DTensor random numbers provide an offset based RNG state tracker OffsetBasedRNGTracker for CUDA. However, for CPU, this offset based RNG state tracker is not available, and it …
-
### 🐛 Describe the bug
As mentioned in this [blog](https://dev-discuss.pytorch.org/t/higher-order-operators-2023-10/1565), HigherOrderOperator does not support graph break inside the input/output fun…
-
### Describe the issue
MatMul is expected to produce a valid result when it is multiplying matrices with inner dimension equal to zero.
For example, operands of shapes {16,0} x {0, 16} should produc…
-
### Describe the issue
PR https://github.com/microsoft/onnxruntime/pull/14088 allows disabling EP synchronization at the end of session run. However, the cuda graph replay does not adhere to this fla…
-
Dear author,
I can log in to the web demo right now, but it still has a bug:
OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB. GPU 0 has a total capacity of 10.75 GiB of which 1…
-
### Describe the issue
Could not load library cudnn_cnn_infer64_8.dll. Error code 127 when using 1.16.3 CUDA
### To reproduce
SessionOptions.MakeSessionOptionWithCudaProvider())
### Urgency
_No r…
-
### Your current environment
Collecting environment information...
/opt/conda/lib/python3.12/site-packages/vllm/connections.py:8: RuntimeWarning: Failed to read commit hash:
No module named 'vllm._…