issues
search
triton-inference-server
/
onnxruntime_backend
The Triton backend for the ONNX Runtime.
BSD 3-Clause "New" or "Revised" License
125
stars
54
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update ORT repo post release 24.09
#273
pvijayakrish
closed
3 days ago
0
Deploy TTS model with Triton and onnx backend, failed:Protobuf parsing failed
#272
AnasAlmana
opened
1 week ago
0
Increase Docker limits on Windows
#271
mc-nv
closed
1 week ago
0
hardcoding sym link library reference for ONNX
#270
pvijayakrish
closed
3 weeks ago
0
[Question] Multiple model inputs and GPU allocations
#269
msyulia
opened
1 month ago
0
load_model fail cause gpu memory leak
#268
zjd1988
opened
1 month ago
0
How do I get all possible input and output names?
#267
zhmiao
opened
1 month ago
0
build: RHEL8 PyTorch Backend
#266
fpetrini15
closed
1 month ago
2
Triton ONNX runtime backend slower than onnxruntime python client on CPU
#265
Mitix-EPI
opened
1 month ago
3
Hardcoding libonnxruntime.so.1 library name reference value
#264
mc-nv
closed
1 month ago
3
refactor: Refactor string input checks
#263
yinggeh
closed
2 months ago
0
fix: Fix ORT backend memory leak (#261)
#262
krishung5
closed
2 months ago
0
fix: Fix ORT backend memory leak
#261
krishung5
closed
2 months ago
1
OpenVINO EP doesn't respect threading parameters
#260
mbahri
opened
3 months ago
0
UNAVAILABLE: Unsupported: Triton TRITONBACKEND API version: X does not support 'onnxruntime' TRITONBACKEND API version X
#259
pultarmi
opened
3 months ago
0
build: Add WAR for CUDA 12.5 build issue (#257)
#258
rmccorm4
opened
3 months ago
0
build: Add WAR for CUDA 12.5 build issue
#257
rmccorm4
closed
3 months ago
2
enhancement: Dynamically updating CUDA EP options
#256
krishung5
closed
4 months ago
3
Change default flag value for OpenVINO (#252)
#255
tanmayv25
closed
4 months ago
0
Remove openvino hard-coded versioning in onnxruntime backend build
#254
krishung5
closed
4 months ago
0
update to use logging macros for JSON values
#253
nnshah1
opened
4 months ago
0
Change default flag value for OpenVINO
#252
mc-nv
closed
4 months ago
0
Is onnxruntime-genai supported?
#251
jackylu0124
opened
5 months ago
1
Suppress warnings
#250
mc-nv
closed
6 months ago
0
Failed to allocated memory for requested buffer of size X
#249
aaditya-srivathsan
opened
6 months ago
0
Add support for sharing an ORT session
#248
quic-suppugun
opened
6 months ago
2
Facing errors when installing onnxruntime backend for triton
#247
Aniket-20
opened
6 months ago
0
Suppress warnings on `cutlass`
#246
mc-nv
closed
6 months ago
0
Parameterize git repository
#244
nv-kmcgill53
closed
7 months ago
0
CPU Throttling when Deploying Triton with ONNX Backend on Kubernetes
#245
langong347
opened
7 months ago
6
ONNX Runtime 1.17.0 has dropped header dependency
#243
mc-nv
closed
7 months ago
0
Dynamic CUDA and TRT options updating
#242
gedoensmax
closed
3 months ago
3
Enable "trt_build_heuristics_enable" optimization for onnxruntime-TensorRT
#241
tobaiMS
opened
7 months ago
2
Will onxxruntime backend support INT8 on cpu ?
#240
bharadwajymg
opened
7 months ago
1
OpenVINO 2023.3.0 (#238)
#239
kthui
closed
7 months ago
1
OpenVINO 2023.3.0
#238
kthui
closed
7 months ago
0
[TensorRT EP] Enable more trt options
#237
yf711
closed
6 months ago
5
Add support for sharing an ORT session (Edited)
#236
Jackiexiao
closed
8 months ago
0
ORT 1.17.0 has dropped header dependency
#235
mc-nv
closed
8 months ago
0
Update OpenVINO to 2023.3
#234
atobiszei
closed
7 months ago
3
[TensorRT EP] Update trt option to v2
#233
yf711
closed
8 months ago
0
Request for Supporting minShapes/optShapes/maxShapes for TensorRT
#232
teith
opened
8 months ago
1
Add MIGraphX + ROCm Onnxruntime Execution Provider support to Onnxruntime Backend
#231
TedThemistokleous
closed
7 months ago
2
Bumping min required cxx standard to 17
#230
oandreeva-nv
closed
8 months ago
1
Update `main` branch post-23.12 release
#229
mc-nv
closed
9 months ago
0
Question: Does ONNX-RT silently fallbacks to CPU?
#228
Thytu
opened
9 months ago
1
Pre-commit fix (#226)
#227
kthui
closed
9 months ago
0
Fix iGPU pre-commit issue
#226
kthui
closed
9 months ago
0
iGPU build refactor (#224)
#225
kthui
closed
9 months ago
0
iGPU build refactor
#224
kthui
closed
9 months ago
0
Next