-
### System Info
- CPU: x86_64, Intel(R) Xeon(R) Platinum 8470
- CPU/Host memory size: 1TB
- GPU:
4xH100 96GB
- Libraries
TensorRT-LLM: main, 0.15.0 (commit: b7868dd1bd1186840e3755b97ea3d3a73dd…
-
### 🐛 Describe the bug
I can successfully export the vulkan pte. When I run the model with
```sh
./backends/vulkan/vulkan_executor_runner --model_path /scratch/models/vulkan_mobilenetv2.pte
```…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch…
-
### Bug description
The error happened when I tried to make the marian-dev.
### How to reproduce
I followed the steps and installed all the required library described on your website.
GNU vers…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
### 🐛 Describe the bug
There is no fake implementation or meta kernel for the Communication Operator. If I want to contribute to this feature, what can I do? Are there any examples that I can refer…
-
### Describe the issue
In the pytorch-onnx exporter, when an optional input is not provided, it is defaulted to None, which gets translates to "" in the onnx graph. Semantically, "" and nothing sho…
-
### Your current environment
Collecting environment information...
WARNING 11-12 05:39:35 _custom_ops.py:19] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm._C'")
Warn…
-
### 🐛 Describe the bug
Currently, building Intel GPU for Windows requires sourcing Intel GPU development bundle for Windows to setup development environment for PyTorch. But the bundle contains `li…
-
### Question
Hi, I'm setting up a robot bin picking simulation with top-down camera that captures semantic or instance segmentation after each grasp attempt. My simulation always get `CUDA error: a…