triton-inference-server onnxruntime_backend issues

triton-inference-server / onnxruntime_backend

The Triton backend for the ONNX Runtime.

BSD 3-Clause "New" or "Revised" License

134 stars 57 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Update `main` branch post 24.11

#286 mc-nv closed 7 hours ago
0
build: Support RHEL ORT TensorRT Execution Provider

#285 fpetrini15 closed 1 week ago
0
fix: Fix L0_onnx_execution_provider

#284 yinggeh closed 1 week ago
0
Enable support for Ubuntu 24.04

#283 mc-nv closed 2 weeks ago
0
Build Updates for Ubuntu24.04

#282 nv-anants closed 3 weeks ago
0
Reapply "Remove unsupported compute capabilities (#275)"

#281 mc-nv closed 3 weeks ago
0
Update onnxruntime_backend after 24.10

#280 pvijayakrish closed 3 weeks ago
0
Built-in support for (custom?) decryption of model weights

#279 vadimkantorov opened 4 weeks ago
1
24.10 Upgrade openvino version

#278 pvijayakrish closed 1 month ago
0
Revert "Remove unsupported compute capabilities (#275)"

#277 mc-nv closed 1 month ago
0
Use pre-built ONNX Runtime binaries.

#276 mc-nv closed 4 weeks ago
0
Remove unsupported compute capabilities

#275 mc-nv closed 1 month ago
0
Enable support for TensoRT 10.5

#274 mc-nv closed 1 month ago
2
Update ORT repo post release 24.09

#273 pvijayakrish closed 1 month ago
0
Deploy TTS model with Triton and onnx backend, failed:Protobuf parsing failed

#272 AnasAlmana opened 2 months ago
0
Increase Docker limits on Windows

#271 mc-nv closed 2 months ago
0
hardcoding sym link library reference for ONNX

#270 pvijayakrish closed 2 months ago
0
[Question] Multiple model inputs and GPU allocations

#269 msyulia opened 2 months ago
0
load_model fail cause gpu memory leak

#268 zjd1988 opened 3 months ago
0
How do I get all possible input and output names?

#267 zhmiao opened 3 months ago
0
build: RHEL8 PyTorch Backend

#266 fpetrini15 closed 3 months ago
2
Triton ONNX runtime backend slower than onnxruntime python client on CPU

#265 Mitix-EPI opened 3 months ago
7
Hardcoding libonnxruntime.so.1 library name reference value

#264 mc-nv closed 3 months ago
3
refactor: Refactor string input checks

#263 yinggeh closed 3 months ago
0
fix: Fix ORT backend memory leak (#261)

#262 krishung5 closed 4 months ago
0
fix: Fix ORT backend memory leak

#261 krishung5 closed 4 months ago
1
OpenVINO EP doesn't respect threading parameters

#260 mbahri opened 4 months ago
0
UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: X does not support 'onnxruntime' TRITONBACKEND API version X

#259 pultarmi opened 5 months ago
0
build: Add WAR for CUDA 12.5 build issue (#257)

#258 rmccorm4 opened 5 months ago
0
build: Add WAR for CUDA 12.5 build issue

#257 rmccorm4 closed 5 months ago
2
enhancement: Dynamically updating CUDA EP options

#256 krishung5 closed 5 months ago
3
Change default flag value for OpenVINO (#252)

#255 tanmayv25 closed 6 months ago
0
Remove openvino hard-coded versioning in onnxruntime backend build

#254 krishung5 closed 6 months ago
0
update to use logging macros for JSON values

#253 nnshah1 opened 6 months ago
0
Change default flag value for OpenVINO

#252 mc-nv closed 6 months ago
0
Is onnxruntime-genai supported?

#251 jackylu0124 opened 6 months ago
1
Suppress warnings

#250 mc-nv closed 7 months ago
0
Failed to allocated memory for requested buffer of size X

#249 aaditya-srivathsan opened 8 months ago
1
Add support for sharing an ORT session

#248 quic-suppugun opened 8 months ago
2
Facing errors when installing onnxruntime backend for triton

#247 Aniket-20 opened 8 months ago
0
Suppress warnings on `cutlass`

#246 mc-nv closed 8 months ago
0
Parameterize git repository

#244 nv-kmcgill53 closed 8 months ago
0
CPU Throttling when Deploying Triton with ONNX Backend on Kubernetes

#245 langong347 opened 9 months ago
6
ONNX Runtime 1.17.0 has dropped header dependency

#243 mc-nv closed 8 months ago
0
Dynamic CUDA and TRT options updating

#242 gedoensmax closed 5 months ago
3
Enable "trt_build_heuristics_enable" optimization for onnxruntime-TensorRT

#241 tobaiMS opened 9 months ago
2
Will onxxruntime backend support INT8 on cpu ?

#240 bharadwajymg opened 9 months ago
1
OpenVINO 2023.3.0 (#238)

#239 kthui closed 9 months ago
1
OpenVINO 2023.3.0

#238 kthui closed 9 months ago
0
[TensorRT EP] Enable more trt options

#237 yf711 closed 8 months ago
5