triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend
Apache License 2.0
581 stars 81 forks source link

Grafana Dashboard (Feature Request) #485

Open hestabit-dev opened 4 weeks ago

hestabit-dev commented 4 weeks ago

System Info

Any Hardware

Who can help?

@ncomly-nvidia

Information

Tasks

Reproduction

I have found Grafana Dashboard for triton server. But it would be beneficial for everyone for proper deployment dashboard and it helps in benchmarking as well

Expected behavior

-

actual behavior

-

additional notes

-