triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.
https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
BSD 3-Clause "New" or "Revised" License
8.31k stars 1.48k forks source link

Increase the metrics's verbose logs level to 2? #6731

Open so2bin opened 10 months ago

so2bin commented 10 months ago

Is your feature request related to a problem? Please describe.

Describe the solution you'd like

Tabrizian commented 10 months ago

I think this is a reasonable ask. @GuanLuo / @rmccorm4 any thoughts? My only concern is that this might be a breaking change if the user relies on these logs to be printed with LOG_VERBOSE(1).

dyastremsky commented 8 months ago

CC: @GuanLuo @rmccorm4 @nnshah1

Our logs have gotten more verbose over time. It may be worth discussing what Triton wants in the short- and long-term, so that we do not introduce breaking changes (especially multiple times).