Azure / azure-openai-benchmark

Azure OpenAI benchmarking tool
MIT License
130 stars 54 forks source link

Utilization Statistics - avg, P95 #25

Open edjez opened 9 months ago

edjez commented 9 months ago
image

Customers saying they have to write code to extract the average and P95 utilization metrics to use in their stress tests; to get a statistical sense of the distribution.