tzurp / performance-total

This WebdriverIO service is used to analyze performance of any test flow.
16 stars 2 forks source link

Add info about browser #18

Closed 1MaJKeL1 closed 2 years ago

1MaJKeL1 commented 3 years ago

Hi,

I have a small suggestion/request about adding to performance test result information about the browser or any custom text

I realized that using these services on different configuration such execute test on the grid, local browsers the result can be a bit different and for the aggregate result, I had to create different configuration per each browser which is fine as well but It would be nicer to have the possibility to pass extra info under Performance-Total results such browser version

the easy solution is just to add a possibility to pass one custom text line to the final result 0-0] Performance-Total results: [0-0] >>>>>>>CUSTOM_TEXT<<<<<<<< [0-0] ┌─────────┬──────────────────────────────────

Best regards

MaJKeL

tzurp commented 3 years ago

@1MaJKeL1 Pleas see if setting 'performanceResultsDirectory' will help you here. The output of the results is depending on disableAppendToExistingFile so 'custom_text' may be out of context. I think I can expose the last test file 'capabilities'. What do you say?

tzurp commented 3 years ago

@1MaJKeL1 I added an option to dissect performance by browser type. You need to set the service options like:

services: [
      ['performancetotal',
        {
            analyzeByBrowser: true
        }]
      ]

Then you get something like this (also the *csv file is updated):

Performance-Total results:
[0-0]
[0-0] ┌─────────┬──────────────┬─────────────┬─────────────┬─────┬─────────┬──────────┬──────────┐
[0-0] │ (index) │     name     │ browserName │ averageTime │ sem │ repeats │ minValue │ maxValue │
[0-0] ├─────────┼──────────────┼─────────────┼─────────────┼─────┼─────────┼──────────┼──────────┤
[0-0] │    0    │ 'SF-Startup' │  'chrome'   │    5390     │ 401 │   10    │   3458   │  11730   │
[0-0] │    1    │ 'GH-Startup' │  'chrome'   │    1918     │ 161 │   10    │   1422   │   6005   │
[0-0] │    2    │ 'GH-Startup' │  'firefox'  │    2582     │ 559 │   10    │   1943   │   5372   │
[0-0] │    3    │ 'SF-Startup' │  'firefox'  │    7841     │ 909 │   10    │   6813   │  12384   │
[0-0] └─────────┴──────────────┴─────────────┴─────────────┴─────┴─────────┴──────────┴──────────┘

Please install the beta version 2.0.3-2 to test the new feature (for wdio v7.x.x):

npm install wdio-performancetotal-service@2.0.3-2 --save-dev

Don't forget to leave a feedback (:

tzurp commented 3 years ago

@1MaJKeL1 can we close this issue?