-
### System Info
```shell
Optimum version: 1.4.1.dev0
Python: 3.8.13
Platform: Ubuntu 18.04 LTS
```
### Who can help?
@JingyaHuang @echarlaix
### Information
- [X] The official example scripts…
-
**Describe the bug**
For OpenVINO-EP, the windows build nuget for RelWithDebInfo Mode is broken.
**Urgency**
High
**System information**
- OS Platform and Distribution : Windows 10
- ONNX Ru…
-
## Description
TensorRT engine build failed with error `Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[/cnn/cnn.0/Conv]}`.
## Environment
**T…
-
Thanks to @acai66 for the reference code. it has helped alot. There code has been modifed a bit
For the followings i had help from stackoverflow
### Step1: Install onnxruntime
mkdir /tmp/onnx…
-
### Describe the issue
I implement a custom OP with CUDA,
in kernel implement: OrtStatusPtr MyKernel::ComputeV2(OrtKernelContext *context)
It call a CUDA kernel class in this:
```
class MyCudaKe…
-
Hi there. I have a Windows computer with two graphic cards: one is an integrated intel graphic and the other is an nVidia graphic card. I know the way to set the running graphic card by nVidia driv…
-
**Describe the bug**
I am using C++ onnxruntime for my onnx model to do inference on GPU. I am creating a session and calling Inference run and during the run GPU memory usage peaks to 20GB for a sin…
-
### Describe the issue
I encountered this warning and I feel that this warning caused my onnx reasoning to work poorly on the GPU.
```
[W:onnxruntime:, inference_session.cc:1488 Initialize] Serial…
-
**Describe the bug**
when I run exported onnx model of transformers (BARTBeamSearchGenerator model) on GPU. I met this. Who knows how can resolve it?
`Traceback (most recent call last):
File "run…
-
Hi! I'm building an application for use with nvidia jetsons.
With nVidia Jetsons, we end up with statements like
```toml
onnxruntime-gpu-tensorrt = [
{version = "1.12.1+t234.r34.1.dev1", op…