search

ivan24004 / pe

0 stars 0 forks source link

Inconsistent error messaging for index query #3

Open ivan24004 opened 3 months ago

ivan24004 commented 3 months ago

image.png

image.png

The error message is inconsistent even though both should be similar (index out of bounds)

soc-pe-bot commented 3 months ago

Team's Response

Severity should be very low as it does not affect usage, both error message prompts the user to enter the valid command.

Items for the Tester to Verify

:question: Issue severity

Team chose [severity.VeryLow] Originally [severity.Low]

Reason for disagreement: Quoting from the textbook:

Specificity of error message: Error messages can be correct but not specific enough (e.g., it says the input is 'invalid' without giving the reason, or gives too many possible reasons without pointing out the specific reason). These cases can be considered type.FeatureFlaw. Calling an invalid value a 'format error' and vice versa is a severity.Low bug e.g., if a date input is required to be in YYYY-MM-DD format, 2021-13-28 is a format error (reason: MM should be in 1..12) but 2021-02-30 is an invalid input (reason: February doesn't have 30 days).

In the second case, there is an invalid input, but the message states invalid command format. Thus, following the textbook's example this should be a severity.Low bug, albeit a type.FeatureFlaw instead of a type.DocumentationBug