search

apache / jmeter

Apache JMeter open-source load testing tool for analyzing and measuring the performance of a variety of services
https://jmeter.apache.org/
Apache License 2.0
8.44k stars 2.11k forks source link

Mail reader sampler: When Number of messages to retrieve is superior to 1, Number of samples should only show 1 not the number of messages retrieved #3377

Open asfimport opened 10 years ago

asfimport commented 10 years ago

sergio (Bug 56539): Suppose to use IMAP and to set two messages to downloads.

When you run the test, Results tree shows you a sample holding two leaves (one for each message). It looks like it were an HTML page holding 2 different component, which is very reasonable.

BUT, if you go to the "Aggregate Report" and "Summary Report" you will see 2 different operations, each with its own time.

Again, if you save the results to a .jtl file, only one results is saved, that holds the total time (which is the expected behaviour).

THis happens only when downloading more than 1 message in a single sample. Java: Java(TM) SE Runtime Environment (build 1.7.0_55-b13).

Created attachment IMAP_error.jmx: JMX script showing the behaviour

Severity: normal OS: All

asfimport commented 10 years ago

@pmouawad (migrated from Bugzilla): Hello, This is because you checked save sub results.

The only issue I find is that #Samples shows 2 while it should show only one. So I will fix this.

Waiting for your feedback.

asfimport commented 10 years ago

@pmouawad (migrated from Bugzilla): Date: Sun Jul 6 14:26:03 2014 New Revision: 1608206

URL: http://svn.apache.org/r1608206 Log: https://github.com/apache/jmeter/issues/3377 - Mail reader sampler: When Number of messages to retrieve is superior to 1, Number of samples should only show 1 not the number of messages retrieved https://github.com/apache/jmeter/issues/3377

Modified: jmeter/trunk/src/protocol/mail/org/apache/jmeter/protocol/mail/sampler/MailReaderSampler.java jmeter/trunk/xdocs/changes.xml

asfimport commented 10 years ago

sergio (migrated from Bugzilla): (In reply to Philippe Mouawad from comment 2)

Date: Sun Jul 6 14:26:03 2014 New Revision: 1608206

URL: http://svn.apache.org/r1608206 Log: https://github.com/apache/jmeter/issues/3377 - Mail reader sampler: When Number of messages to retrieve is superior to 1, Number of samples should only show 1 not the number of messages retrieved https://github.com/apache/jmeter/issues/3377

Modified:

jmeter/trunk/src/protocol/mail/org/apache/jmeter/protocol/mail/sampler/ MailReaderSampler.java jmeter/trunk/xdocs/changes.xml

HI Philippe, IMHO the issue is a little bit more complex. It seems to me that "Aggregate Report" uses the data from each subsample to calculate the statistical result. E.g. if you have 2 subsample, and each subsample takes 100ms to run, one should see 200 ms as average response time, for 10 samples. In Jmeter 2.11, you will find 20 samples with 100 ms response time.

HTH