-
I see the following error when I run my trtexec command:
```
trtexec --onnx=/azureuser/end2end_ep19.onnx --saveEngine=/azureuser/end2end_ep19.plan \
--useCudaGraph \
--plugins=/opt/tritonserver/backe…
-
### Your current environment
```text
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu 24.04 LTS (x86_64)
GCC version: (Ubunt…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
### Describe the issue
Hey guys,
I can't seem to figure out an easy way to copy an OrtValue that's been allocated on the GPU, back to the CPU.
OrtValue has a really convenient `GetTensorDataA…
-
### Describe the issue
TArray used for broadcast was limited to be within range [0, 8] on onnxruntime 1.16.3, and I wonder if the tensor to be broadcasted can be higher than 8 dim, or if this limit i…
-
### Describe the issue
I have an onnx model (a t5 encoder that I exported from pytorch and then converted to FP16 using `onnxruntime.transformers.float16.convert_float_to_float16`). When I use this…
-
如题
rknn-toolkit2版本 2.0.0b17 （更高版本转换时会报`invalid tensor malloc size, tensor name: , target: CPU, size: 0`这个错误）
librknnrt.so版本2.2.0
导出onnx:
```python
import torch
from transformers import T…
-
We have this snippet in our Vulkan docs:
https://iree.dev/guides/deployment-configurations/gpu-vulkan/#get-the-iree-runtime
 not found; falling back to find_module()
:1047: ImportWarning: _SixMetaPathImporter.find_spec() not found; falling back to find_module()
:1047…