Every semester, for several particular lessons, there are a handful of students who did all the questions but the platform doesn't indicate 100%, and it keeps saying there are uncompleted questions. I haven't seen it happen in real time so I don't know what the combination of actions are that cause the problem, but I'm suspecting it might be something involving a number question with multiple hints, so I'm logging the report here for future investigation.
So for attempting to reproduce the bug, I recommend trying some combination of actions on those particular questions on those particular lessons (like, maybe some combination of sequences of pressing 'get hint' and trying various answers, maybe trying answers before the hint timer has released, etc).
edited to add: As another data point, TAs report that refreshing the browser "fixes" the issue, so maybe something internally is getting "stuck", for questions that involve multiple hints.
Description
Every semester, for several particular lessons, there are a handful of students who did all the questions but the platform doesn't indicate 100%, and it keeps saying there are uncompleted questions. I haven't seen it happen in real time so I don't know what the combination of actions are that cause the problem, but I'm suspecting it might be something involving a number question with multiple hints, so I'm logging the report here for future investigation.
The lessons are, for instance: https://isle.stat.cmu.edu/36-200-spring24/lab6/ and https://isle.stat.cmu.edu/36-200-spring24/lab8/
Note that on https://isle.stat.cmu.edu/36-200-spring24/lab6/, question 2b is a number question with multiple hints; and note that on https://isle.stat.cmu.edu/36-200-spring24/lab8/, question 7b is a number question with multiple hints; and the bug happens on both of these lessons; and in at least one case, a student on https://isle.stat.cmu.edu/36-200-spring24/lab6/ indicated that they had completed question 2b but the platform claimed they didn't.
So for attempting to reproduce the bug, I recommend trying some combination of actions on those particular questions on those particular lessons (like, maybe some combination of sequences of pressing 'get hint' and trying various answers, maybe trying answers before the hint timer has released, etc).
edited to add: As another data point, TAs report that refreshing the browser "fixes" the issue, so maybe something internally is getting "stuck", for questions that involve multiple hints.
Expected behavior
No response
To Reproduce
see above
Version
0.76.23
Link to ISLE lesson
see above
ISLE Code
No response
What browsers are you seeing the problem on?
No response
What browser version?
No response
Additional context
No response