Generate .html analysis file for avocado runs and update usage

misanjumn commented 6 months ago

In addition to Analysis.xlsx, this patch generates Analysis.html file as output. This can be generated for new analysis (--new-analysis) as well as comparison analysis (--compare-two-results)
The Analysis.xlsx file is converted to Analysis.html file and both the outputs are generated. This .html file can be used to display the summary of the avocado based results in a web page for a dashboard based view.
This .html output has filter table drop downs as an enhancement to the .xlsx output. This filter can be used for further breaking down of the results.
The summary data-structure is added to pass it as input to analysis_to_html(summary) function for displaying the number of regressions, differences and solved test-cases

There are many issues with this flag when it comes to both Analysis.xlsx as well as Analysis.html files generation. Much work is needed.
Hence, updating the readme marking it as future enhancement and removing it from the .py file.

Signed-off-by: Misbah Anjum N misanjum@linux.vnet.ibm.com

spoorthys1303 commented 2 months ago

@misanjumn please provide the run logs for the changes

misanjumn commented 2 months ago

@spoorthys1303

I am attaching the image output of the above patch since it is a .html file

Example:

python3 analysis.py --compare-two-results results1.json results2.json

lop-devops / tests