search

numbas / Numbas

A completely browser-based e-assessment/e-learning system, with an emphasis on mathematics
http://www.numbas.org.uk
Apache License 2.0
200 stars 118 forks source link

Lockouts on revealing answers #638

Closed gordonsmithwkuedu closed 4 years ago

gordonsmithwkuedu commented 4 years ago

Gave a test today, and had a quirk reveal itself...

A student tried Part 1 of the problem (Determining radius of curvature from g-forces (translational kinematics question)), and decided to go for the steps (sacrificing half their points). They successfully completed all the steps, and unthinkingly hit "reveal answer" before hitting "submit" with the result that all the correct steps got invalidated (even though they'd been marked correct on an individual basis) and they received no credit for the work. Is there a "are you sure" validation or some other doublecheck to see if there are entries that haven't been recorded warning? I didn't see the warnings he did get, there may already be something in place, and he just breezed by them...

christianp commented 4 years ago

I can't reproduce that - when you click "reveal answers", any credit you've earned is saved.

When you click "reveal answers", a confirmation box pops up with the following message: "Would you like to reveal the answer to this question? Any marks you have received so far will be locked and you will not be able to answer this question later."

If this was one of my students, I'd say it was likely that their account wasn't entirely accurate.

gordonsmithwkuedu commented 4 years ago

I can reproduce it on the deployed SCORM zip file.

The problem loads, I ask to see the steps. I enter all the (correct) answers, but never hit "submit" on any of them. If I ask to see the answers at this point, the entries in the individual steps are cleared, and no credit is issued even though the answers match what was in the box (because the system, presumably, never saw what was in the box).

christianp commented 4 years ago

Could you email the zip file to numbas@ncl.ac.uk, please?

christianp commented 4 years ago

Oh, if you never hit submit, that's the intended behaviour. You said that the steps had been marked correct, which only happens when the corresponding "submit" buttons are pressed.

We have an open issue (#545) about a "submit automatically" feature. There are some complications I can foresee, if we ever have a situation where submitting a wrong answer is worse for the student than submitting nothing at all. For now though, maybe it makes sense to automatically submit before reveal or at the end of the exam.