issues
search
triton-inference-server
/
client
Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
517
stars
224
forks
source link
Update ITL calculation
#694
Closed
nv-hwoo
closed
4 weeks ago
nv-hwoo
commented
4 weeks ago
Updated ITL calculation: ITL = (req latency - TTFT) / (OSL - 1)
Updated unit tests
Small refactor
CI Pipeline #:
15604638
15629347 (new)
CI Pipeline #:
1560463815629347 (new)