search

microsoft / azure-load-testing

MIT License
22 stars 3 forks source link

[BUG] Azure Load Testing Portal displaying incorrect Response time for 90, 95 and 99 percentile. #38

Open agrawalamit31 opened 2 years ago

agrawalamit31 commented 2 years ago

Describe the bug Azure Load Testing Portal displaying incorrect Response time for 90, 95 and 99 percentile as compare to JMeter dashboard.

To Reproduce image

Expected behavior Client side metric in Azure Load testing portal should display P99 for post call as 11 instead of 10.44 Client side metric in Azure Load testing portal should display P99 for get call as 10 instead of 12.48

Screenshots image

AB#1465388

kaumishra commented 2 years ago

Thanks for sharing this Amit. We will investigate this discrepancy and update here.

krishna1s commented 2 years ago

Hi @agrawalamit31 JMeter report shows values over 1 min aggregation, can you change group by interval to 1m and see if it matches?

agrawalamit31 commented 2 years ago

@krishna1s - I will verify and update you

agrawalamit31 commented 2 years ago

@krishna1s - It is not working as expected. I did aggregation for 1 minute but data is not matching. image

In above snapshot, Response time metric for 99 percentile for PeopleCount is 15.38s while in JMeter dashboard it is 19833.16ms.

Attached result artifact from JMeter dashboard results.zip

junpark12 commented 2 years ago

Same Here. I tested on azure app service. When i see the average response time metrics on app service, there's delay like 2-3 seconds. But testrun's response time metrics in load test is only 150 millisecond.