fsgmhoward / CS2113T-pe

0 stars 0 forks source link

Incomplete/Missing "Instructions for Manual Testing" section for DG #11

Open fsgmhoward opened 3 years ago

fsgmhoward commented 3 years ago

image.png

According to the text book, this section should contain some input and output for the tester to test the program, which should cover all user-testable functionalities. This is also what I should use for this PE.

However, for your team's DG, this section contains merely one instruction for testing the parser, using the test cases provided in the source file.

image.png

Given the instructions in for this PE, I have no access to the code on Github so there is no way for me to follow this instruction to test the parser. I also think this deviates from the original meaning from the textbook as using code (JUnit test cases) to test should be considered as automated testing.

nus-pe-bot commented 3 years ago

Team's Response

Fair, the team should have checked the proper definition for this section better and given more examples. Testers were still able to test it though thus the severity is not High.

Items for the Tester to Verify

:question: Issue severity

Team chose [severity.Low] Originally [severity.High]

Reason for disagreement: Yes, I would say a tester will still be able to test your product, but in blind. I am not aware of some boundary values of your program so it also makes it much harder to find a bug.

An essential section of DG is completely missing and I would disagree that this is only worth Low severity.