search

LWS49 / pe

0 stars 0 forks source link

Insufficient test cases for manual testing #12

Open LWS49 opened 5 months ago

LWS49 commented 5 months ago

There are only 3 sections under Instructions for manual testing: Launch and shutdown, deleting a client and saving data. All other functions of Fitbook are absent in this section.

As functions add, clear, edit, exit,help, list are very similar to AB3, it can be understandable if these are not covered. Notably, new functions previously non-existent in AB3 like note, weight, fitadd and fitdelete are missing from manual testing.

nus-se-script commented 5 months ago

Team's Response

The instructions for manual testing each command would be very similar to the "Deleting a client" section. (Just executing a command and observing the results)

Including manual testing instructions for each separate command would be needlessly repetitive.

Additionally, the examples listed is only meant to be a starting point for testers, as stated in the DG.

image.png

Thus, we have decided to reject this bug.

Items for the Tester to Verify

:question: Issue response

Team chose [response.Rejected]

Reason for disagreement: image.png

It is clearly stated that Instructions for Manual Testing needs to cover all user-testable features. Although existing AB3 features that are untouched may be excluded, in this DG all new features like commands note, weight, fitadd and fitdelete are all not present. In addition, instruction for manual testing for existing AB3 features that are modified, such as add, are also not present in this appendix. Thus, this is a valid bug.

## :question: Issue severity Team chose [`severity.Low`] Originally [`severity.Medium`] - [x] I disagree **Reason for disagreement:** This is a medium instead of a low because that is more severe than the criteria of Low, which is "unlikely to affect normal operations of the product." In this case, should developers want to test this product manually, they would definitely test more than just launching, deleting and saving data. Developers would be interested in innovative features specific to this product like note, weight, fitadd and fitweight, or basic features (that are modified from AB3) such as add, in order to test the functionality of this product. Thus, lacking instructions to do so manually would make it highly inconvenient to them. As such, this should be a medium bug since it "causes occasional inconvenience to some readers" - for the occasional developer who would like to test this product manually, this would almost always result in inconvenience for them.