search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
520 stars 225 forks source link

Fix response preprocessing bug #646

Closed nv-hwoo closed 1 month ago

nv-hwoo commented 2 months ago

When preprocessing responses, if all responses are either empty or null, then the res_outputs and res_timestamps will eventually be empty and will raise index out of range error. Instead of indexing 0-th and last element, check if the list is empty or not.

nv-hwoo commented 1 month ago

@dyastremsky @matthewkotila @IzzyPutterman

Talked with Ganesh and @debermudez As this PR does not change behavior of the original code as it's just fixing the potential index error, I will create another follow up ticket to discuss about this.