apluslms / a-plus

A+ frontend portal - A+ LMS documentation:
https://apluslms.github.io/
Other
63 stars 72 forks source link

Submission feedback at the deadline time, if points > 0 #1369

Open teemulehtinen opened 1 month ago

teemulehtinen commented 1 month ago

Reuse the e-exam feature "reveal-submission-feedback = deadline" for use in course content. Motivation: Shift the responsibility of properly testing the submitted code to the student. Prevent generating, testing, and fixing code using LLMs and automated feedback. Required changes:

etanttila commented 1 month ago

There already are several options in A+ for revealing feedback after the deadline image

image

So would this suggested option be an additional alternative in addition to the existing ones, or would you suggest that some of the existing ones would be changed to behave in the manner you indicate?

Or would it be better to have another option (e.g. a checkbox), that if it is selected, feedback is displayed immediately if the points are 0?

etanttila commented 1 month ago

(It seems like teachers see feedback immediately even if the settings are set to have it as delayed feedback, so if you want to test how it appears to the student, you actually need to test it with a student.)

Before submitting, there indeed is no information at all that feedback will not be provided immediately, which certainly is problematic. (At least I as a student would be really annoyed to not know that beforehand.) image

After submitting, there is a notification that the feedback will be published later image

If only the last submission is graded, there is a notification that only the last submission is graded before submitting (this remains also after submitting) image

After submitting: image However, if the page is reloaded, the green box disappears, so there is no info (other than the question mark in the points) to indicate feedback will be provided later.

Indeed, it should be more transparent (and apparent to students!) if feedback is delayed (e.g. to deadline).

teemulehtinen commented 1 month ago

I would add a separate checkbox "Always reveal feedback worth 0 points immediately" next to the delay minutes (there are different fields that only appear for certain reveal modes already).

When the visibility/notes for when to expect feedback are designed, we must also consider the exam case. The UI should not become annoying or confusing when completing an exam.