ls1intum / Artemis

Artemis - Interactive Learning with Automated Feedback
https://docs.artemis.cit.tum.de
MIT License
514 stars 294 forks source link

`Assessment`: Less error-prone method for adding elements of the “Structured Evaluation Criteria” to the “Feedback” section in assessment mode #9514

Open laxerhd opened 1 month ago

laxerhd commented 1 month ago

Is your feature request related to a problem?

The drag & drop function of the Structured Assessment Criteria in the exam/exercise assessment mode does not always work. When dragging elements from the Structured Assessment Criteria tab to the Feedback area, it may happen that you hit an element that has already been placed in the Feedback area. There is no indication that adding the feedback has failed. Some do not check whether the element has been added to the feedback list, especially if the list is already very long. This can lead to incomplete ratings being published. Furthermore, there is no indication that any element of the Structured Assessment Criteria was used up to its maximum amount.

Describe the solution you'd like

Add plus and minus signs (add / remove) to each element in the “Structured Evaluation Criteria” so that drag & drop is no longer necessary. In addition, elements that have been used for the maximum number should be grayed out, so you can't add them anymore.

Describe alternatives you've considered

Instead of adding plus and minus boxes to the items in the Structured Evaluation Criteria, you could make them double-clickable to move them to the Feedback section.

Additional context

When working as a tutor, it sometimes happend, that draging the elements to the "Feedback" section did not succeed. If there are many criteria for the exam/exercise, it becomes increasingly unmanageable to track whether each individual element has been added correctly. For this reason, the chance of missing or incomplete feedback elements is high. Even if the points of this element are only counted once, you can still add several of them, which can be confusing for the corrector.

image image

laxerhd commented 1 month ago

If something like this is approved, I would like to work on the new feature.

b-fein commented 1 month ago

Possible problem with just adding a + icon to each: Text, Modelling, and Programming exercises all support inline feedback that is placed directly put next to a line of text/code or an item in the model. Then the + would be unintuitive to me. Would it add the structured criterion to the inline feedback I edited last or create a new feedback item at the bottom?

With #4840 a feature was added to the text exercises to make the drag-and-drop no longer necessary for inline feedback. It might be feasible to re-use/adapt a similar drop-down menu for those?

5140 proposes to add this for the other exercise types as well. Since the general feedback area at the bottom is shared for all exercise types, it would automatically work for all exercise types at least for this kind of feedback.

laxerhd commented 1 month ago

Yeah, I see why this could get a little bit confusing. Your proposel in #5140 looks great. I'll take a look at how this could be implemented. Thanks for your feedback!

laxerhd commented 4 weeks ago

Feel free to work on this!