search

cheeseong2001 / pe

0 stars 0 forks source link

Test report not accurate #3

Open cheeseong2001 opened 4 months ago

cheeseong2001 commented 4 months ago

image.png

As shown in picture, there are 2 wrongs. As per output, it says the The following 2 answers you gave are wrong: but only 1 wrong question/answer is shown.

You can create be more accurate in reporting, perhaps just showing the entire list of wrong answers first.

soc-se-bot commented 4 months ago

Team's Response

same with 2429,

The 'Original' Bug

[The team marked this bug as a duplicate of the following bug]

Wrong answers if exit during test

image.png

I exited during a test with 1 auto generated problem and did not attempt the question. Text shows All the test not finished will be marked as wrong! but shows You have 0 wrong answers. after. I am unsure if unattempted questions are marked as wrong since I expected the unfinished question to be 1.

[original: nus-cs2113-AY2324S2/pe-interim#1071] [original labels: type.FeatureFlaw severity.Medium]

Their Response to the 'Original' Bug

[This is the team's response to the above 'original' bug]

It is indeed a little confusing . I believe that "All the test not finished will be marked as wrong!" belongs to the checker part which means that you will lose accuracy for the questions you haven't answered ,but the "You have 0 wrong answers." belongs to the explanation part , which is responsible for giving explanations for your wrongly answered problems. since it can not give explanations for the problems not answered . maybe change "You have 0 wrong answers." to "you have 0 wrongly answered problems " will make it less confusing

Items for the Tester to Verify

:question: Issue duplicate status

Team chose to mark this issue as a duplicate of another issue (as explained in the Team's response above)

Reason for disagreement: My bug talks about how there is only 1 wrong answer shown when it explicitly mentioned The following 2 answers you gave are wrong. I understand that I have to enter commands to go to the next wrong question, but it is misleading. There should be a note to notify that the wrong questions will be shown when you type a command to go next question.

Additionally, because there is no guide to tell users to type next to go to the next question, users can think that they only have 1 question wrong.

Severity should increase to severity.Medium since this happens quite often whenever users have more than 1 wrong.

## :question: Issue type Team chose [`type.FeatureFlaw`] Originally [`type.FunctionalityBug`] - [ ] I disagree **Reason for disagreement:** [replace this with your explanation]