apache / jmeter

Apache JMeter open-source load testing tool for analyzing and measuring the performance of a variety of services
https://jmeter.apache.org/
Apache License 2.0
8.42k stars 2.1k forks source link

The 90th percentile response time of the Transaction Controller is varying across individual API calls. #6361

Open Chandhiramouli opened 1 month ago

Chandhiramouli commented 1 month ago

Expected behavior

I'm executed a JMeter script with 3 threads and 10 iterations on the Application Launch Page. During the test, we observed that the response times for individual API calls were in milliseconds, while the response times for the Transaction Controller were around 15 seconds.

This behavior was consistent across multiple executions.

I've attached a file for your reference. The Launch Page includes 4 API calls.

Number of iterations is 30 Number of API calls: 4 In total, 120 request responses are provided in the attached file for your review and Transaction controller response time also provided.

Please advise on how the 90th percentile response times for the Transaction Controller are being calculated.

90Percentile.xlsx

Actual behavior

No response

Steps to reproduce the problem

Add multiple API calls within one Transaction Controller and ensure that "Generate Parent Sample" is unchecked. Afterward, execute the script 25 or 30 times and verify if the 90th percentile response time for the Transaction Controller matches the 90th percentile response times of the individual API calls.

JMeter Version

5.6.3

Java Version

1.8.0_181

OS Version

Microsoft Windows 10

milamberspace commented 1 month ago

Check https://jmeter.apache.org/usermanual/component_reference.html#Aggregate_Report

FSchumacher commented 4 weeks ago

Can you attach a minimal test plan, that exhibits your issue? The attached xslx file is not that helpful (at least to me). You can probably replace your api calls with simple JSR223 Sampler calls, that have "OK" as script content, or a Test Sampler.

And why do you think this is regression?