Closed yinggeh closed 3 months ago
Please trigger a pipeline encapsulating all the latest changes so can feel confident in the CI impact when looking at the cherry-picks
Merged https://github.com/triton-inference-server/server/pull/7525 to the wrong branch. Need re-approval to merge to main.
What does the PR do?
Tests histogram metric in custom_metrics.
Checklist
<commit_type>: <Title>
Commit Type:
Check the conventional commit type box here and add the label to the github PR.
Related PRs:
https://github.com/triton-inference-server/vllm_backend/pull/56 https://github.com/triton-inference-server/python_backend/pull/374 https://github.com/triton-inference-server/core/pull/386
Where should the reviewer start?
n/a
Test plan:
n/a
Caveats:
n/a
Background
Customer requested histogram metrics from vLLM.
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)
n/a