triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
551 stars 227 forks source link

Fix HTTP client REQUEST_END timestamp #691

Closed dyastremsky closed 3 months ago

dyastremsky commented 3 months ago

This adds the HTTP client timestamp back for the request end. In the previous change, it was removed. Now the HTTP times are correct.

Before changes (notice avg HTTP time is 0): image

After changes: image