openedx / edx-ora2

Open Response Assessment Suite
GNU Affero General Public License v3.0
61 stars 194 forks source link

Allows learners to reset their own submissions #1994

Open e0d opened 1 year ago

e0d commented 1 year ago

Allows a learner to iterate on a submission, resubmitting it, within a defined time threshold to improve learner experience and reduce support/admin intervention needs.

Colin-Fredericks commented 1 year ago

Copying my own comment from the "resubmission" item in triage: To avoid the "someone's already grading it" problem, there could be a 30-minute (or whatever) grace period where you're allowed to revise before it gets added to the grading pool.

e0d commented 1 year ago

@Daniel-hershel I added this item this morning from your shared list. Colin proposed a requirement for consideration that I wanted to flag for you.

Daniel-hershel commented 1 year ago

@Colin-Fredericks great suggestion, thank you. And thanks @e0d for flagging. We are exploring doing something like this. We pulled some interesting data to look at what the time band should be for allowing revision before an assignment is added to the grading pool.

The median wait for a peer review to start is 5 hours

The median wait for a peer review to be submitted is 3 days.

So I think a 30 minute window would work fine, and we could potentially even stretch to 60 minutes if you think there is some benefit to a longer window?

Colin-Fredericks commented 1 year ago

Glad you like the idea. :) No strong opinion about the timing - I don't have a gut feel for it and haven't seen any research on it.

juancamilom commented 1 year ago

The edunext / Unidigital team is currently working on an implementation of this feature.

Our initial approach is to allow a learner to reset their submission when the following conditions are met:

We could optionally also implement the time for the grace period As a setting of the specific ORA problem, but the implications regarding how and when submissions are added to the grading pool are still being explored by the team.

@mattcarter , @Daniel-hershel , @e0d and @Colin-Fredericks your review and input are greatly appreciated ;)