search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
551 stars 227 forks source link

Remove ITL from console when non-streaming #706

Closed nv-hwoo closed 3 months ago

nv-hwoo commented 3 months ago

Before:

image

After:

image
nv-hwoo commented 3 months ago

CI ref: 15844661