-
### Describe the issue
Im using ML.net and The Onnx Runtime (3.0.1, 1.17.1 respectively) to load an Onnx model for inference from within a Unity(2021.3.23f1) application. The packages were installe…
-
### Describe the issue
I have trained using scikitlearn a classifier which receives in input a string and predicts the corresponding class and I have exported it to ONNX format. Now I want to perfo…
-
### Describe the issue
We have converted the translation LLM 7B model to ONNX format using Optimum Hugging Face and then quantized it to 8-bit quantization with Dynamic quantization technique. Ho…
-
### Describe the issue
Hi, I am using ONNX Runtime with TensorRT Execution Provider for a quantized model (YOLO-NAS). While TensorRT cli (trtexec.exe) successfully build the engine from onnx model, t…
-
### Describe the issue
If I have an old csproj file that targets v4.7.2 and add the `Microsoft.ML.OnnxRuntime` nuget it'll copy in the native libraries. However, if I pull in a nuget package that has…
-
### Describe the issue
The following error occurs when trying to run https://huggingface.co/HuggingFaceTB/SmolVLM-Instruct on WebGPU.
. For the scatter_add operation we are using the [scatter elements plugin](https://github.com/NVIDIA/TensorR…
-
### Describe the issue
onnxruntime-gpu(1.18.0) can be install on my linux.
Version:
ubuntu:22.04
cuda:12.4
cudnn:8.9.3.28
### To reproduce
cmd install and .whl install is both failed
###…
-
### 💡 Your Question
I have followed exactly same steps for model training followed by PTQ and QAT mentioned in the offcial super-gradient notebook :
https://github.com/Deci-AI/super-gradients/blob…