search

triton-inference-server / onnxruntime_backend

The Triton backend for the ONNX Runtime.
BSD 3-Clause "New" or "Revised" License
134 stars 57 forks source link

Hardcoding libonnxruntime.so.1 library name reference value #264

Closed mc-nv closed 3 months ago

mc-nv commented 3 months ago

This is a quick fix to tritonserver container backend. which fix non-found libonnxruntime.so.1

$ docker run --rm -it  tritonserver:24.08-py3-base bash -c "ldd backends/onnxruntime/libtriton_onnxruntime.so" | grep found
        libtritonserver.so => not found
        libonnxruntime.so.1 => not found

Related issue: https://github.com/microsoft/onnxruntime/issues/21763

pvijayakrish commented 3 months ago

Do we have a RCA? Is this a temporary fix to unblock QA for 24.08 testing?

mc-nv commented 3 months ago

Do we have a RCA? Is this a temporary fix to unblock QA for 24.08 testing?

We have to accept change and rebuild the image to provide image to QA

pvijayakrish commented 3 months ago

Approving the temporary fix to unblock QA for 24.08 testing. Please create a follow up ticket, if required, to investigate and adopt a permanent solution.