canonical / test_observer

Flutter based dashboard for visualising SRU regression test results
2 stars 3 forks source link

Add testresult report #127

Closed omar-selo closed 7 months ago

omar-selo commented 7 months ago

Resolves RTW-228.

Changes:

Note:

Example CSV report file: testresults.csv

andrejvelichkovski commented 7 months ago

I think the reasoning for that is because we were intending to have this file easily importable in something like jupyter notebook where we can do different statistical analysis, and I think a common format in those is csv.

Not sure whether this is true, but another reason I can see is that csv might be slightly more compact representation of the data, as we don't need to duplicate the keys for each entry in the table, and we might save some space and time as I'm expecting this file becomes significantly large.

omar-selo commented 7 months ago

The main question I have, is "why csv and not json?"

Adding to @andrejvelichkovski's point, it's also much easier to play around with this data via some spreadsheet software. We can filter, sort, create charts, etc. With json we'd have to do these operations through code (unless there is a tool out there that makes this easier to work with through GUI).

omar-selo commented 7 months ago

Had to push some frontend changes as these backend changes caused the following issue: Screenshot from 2024-02-21 11-00-02