lcabaceira / crystal

Alfresco predictions, analisys, benchmarks
3 stars 1 forks source link

Analysis of the reports/dashboards/analytics #10

Closed fcorti closed 8 years ago

fcorti commented 8 years ago

Which dashboards can/should be defined? Which reports can/should be defined? Which analytics can/should be defined? About reports/analytics: how to release them in the crystal installation?

fcorti commented 8 years ago

The very first dashboard is an high view of the tests available. Below an image of the committed version (few minutes ago).

schermata 2016-01-02 alle 19 42 13

Now it's time to think about other dashboards, more detailed and dedicated to specific business questions.

fcorti commented 8 years ago

Added a dashboard that details the raw logs with filter on test and period (date only) and CSV/XLS export feature.

schermata 2016-01-04 alle 08 17 11
lcabaceira commented 8 years ago

Nice one, i'm going to give it a try later and provide feedback.

lcabaceira commented 8 years ago

I've updated both test cases (share automation and cmis tests) to generate reports on the correct folder and with the recommended pentaho friendly format.

lcabaceira commented 8 years ago

We should change the pentaho port to 9090 or other than 8080. People that are testing Crystal tend to have a local installation of Alfresco in 8080 and that conflicts with pentaho port. Is it just a matter of changing the tomat server.xml to listen on 9090 instead or we need to change it somewhere else ?

fcorti commented 8 years ago

No problem. This week has been crazy in the office. During the weekend I'll change the port and check the issues.

fcorti commented 8 years ago

Ok, Pentaho ports changed to 8080, 9009, 9443. To answer to your question: yes, it is a matter to change the server.xml config file.

lcabaceira commented 8 years ago

You mean 9090,9009,9443 :) ?

fcorti commented 8 years ago

Ops... yes, 9090, 9009, 9443. Updated also the documentation: https://github.com/lcabaceira/crystal/wiki

lcabaceira commented 8 years ago

The reports we need for now, that we already have inside jmeter and their data is already being exported are as follow :

I can attach the diagrams created by jmeter if those help.

fcorti commented 8 years ago

I'm going on this path...

Active threads over time is quite ready. Response times over time is quite ready.

The others will come... stay tuned.

fcorti commented 8 years ago

Added the first draft of the reports below:

Before going ahead with the other reports, need to refine the ETL to recognize of the data regard the results or the JMXs. Then filter and refine the results in the charts.

fcorti commented 8 years ago

ETL refined! Now a TYPE field ha been added to the Data Mart and reports filter on this field. Let's work on the other reports...

fcorti commented 8 years ago

All the available reports in JMeter are developed. Of course need to be deeply tested.

dashboard