search

orzymandias / pe

0 stars 0 forks source link

Impossible to test the view -q and view -uq #8

Open orzymandias opened 3 years ago

orzymandias commented 3 years ago

Application does not give any way to add quest from to the application, so it is impossible to tests the commands view -q and view -uq

image.png

nus-pe-bot commented 3 years ago

Team's Response

We provided sample data for users who are not CS1101S TAs so that they can test those commands. For users who are already logged in to their TA accounts, since it has already reach the end of the semester, there will no longer be any quests. Thus, Jarvis will also not display any quests.

Items for the Tester to Verify

:question: Issue response

Team chose [response.Rejected]

Reason for disagreement: Thank you for your response. When testing there was no data why I reported the bug, however, going back and redownloading the app again it is present and I know what is the issue. Allow me to present 2 scenerios:

1) For testers who do not have an account, "logging in" and restarting the app will wipe the sample data which is irreversible and does not allow the tester to test this feature anymore as they cannot add to any quest nor missions.

2) For testers with TA account, since there are no quests, it is indeed hard for them to verify if this feature actually works. All it does at the moment, is just switch to the quest or mission tab. From the the perspective of the tester, cannot verify that it is able to list mission and quests fetched from the server but only switch tabs

This is a limitation of testablity as it is constrainted by what is available on the source academy and also implementation as sample data does not persist after logging in which is why my serverity should be lowered as was not aware of what was going on in the background and it was based on what I was seeing.

:question: Issue severity

Team chose [severity.VeryLow] Originally [severity.High]

Reason for disagreement: I think the severity of this bug should be lowered from high to low as it is not impossible but inconvenient for user test this feature since firstly its data is dependent on the source academy so if there are no items on the server at the time, even with a TA account, nothing will be present to verify that listing works. Furthermore, the sample data provided does not persist after logging in, so if you were to log in and then start the app again the list will always be empty and you cannot test this feature anymore. Lastly, cannot verify actual data fetched will successfully show up in the list or it can only list hard coded data.