iVis-at-Bilkent / software-artifact-analyzer

SAA: A tool to visually analyze varying software artifacts including source code files, pull requests, issues, and commits, as well as their links and their relationships with developers in a software project to improve the software development process
0 stars 0 forks source link

Release SAA as version 1.0.0 #154

Closed ugurdogrusoz closed 2 months ago

ugurdogrusoz commented 2 months ago

as planned with the same numbered milestone and described here Prior to this, let's:

LaraMerdol commented 2 months ago

Test topics:

LaraMerdol commented 2 months ago

@ugurdogrusoz subtask 1,2,3,4,5,6 @LaraMerdol subtask 7,8,9,10,11,12

LaraMerdol commented 2 months ago

7. Custom queries

Screen Recording 2024-07-30 at 15 02 12

!!ISSUE: Sometimes the first click on the execute does not produce a graph result. A second click is required. New issue open #156 Screen Recording 2024-07-30 at 14 50 27

LaraMerdol commented 2 months ago

8. Settings

I have checked those settings;

Anomaly settings work fine: Ignored bug time-frame (month) 30 Assignee change count 1 Reopen count Screen Recording 2024-07-31 at 10 35 42

Highlight style Screen Recording 2024-07-31 at 10 35 42

LaraMerdol commented 2 months ago

9. Expert Recommendations

Test Flow: Select a File and Execute Object Queries

  1. Select a file from the drawing canvas.
  2. Open object queries and request expert recommendation.
  3. Execute work graph result and cluster.
  4. Add badges.
  5. Remove clustering and badges.
  6. Add clustering and badges again.
  7. Close graph result.
  8. Request 4 recommendations.
  9. Add the last recommendation as a merge. Screen Recording 2024-07-31 at 10 54 34

    Test Flow: Execute Custom Queries and Select a File

  10. Open custom queries.
  11. Select a file from the file list.
  12. Execute query for max number of developers (5). Screen Recording 2024-07-31 at 11 01 31

!!!One problem is with small scores, as we let two decimals be seen as 0. However, we have discussed this issue and decided to leave it as it is.

LaraMerdol commented 2 months ago

10. Reviewer Recommendations

Same test flows as expert recommendation also repeated. I have also checked the output result filtering. Screen Recording 2024-07-31 at 11 11 52 And for reviewer recommendations in the demo version, it should not allow the assignment of a reviewer.

Screen Shot 2024-07-31 at 11 13 35
LaraMerdol commented 2 months ago

11. Anomaly Detection

Anomaly settings have been tested in test case 8 and were included in the settings testing. Minor issue fixed related to missing issue priority. Now it also shows another badge

Screen Shot 2024-07-31 at 11 54 32

All issues, anomalies, and fields were checked. I could not find any problems.

12. Anomaly Statistics

Anomaly statistics have been checked, and no visible problems have been found. In addition, badges have been issued at each step. Anomalies have been counted from 1 to 6. No issue has more than 6 anomalies.