UBC-DSCI / rudaux

LMS + External Tool Workflow Orchestration
https://ubc-dsci.github.io/rudaux
MIT License
7 stars 5 forks source link

Feedback HTML file has 0's and no comments for manually graded questions #179

Open briank-git opened 1 year ago

briank-git commented 1 year ago

When feedback is returned to student directories e.g. tutorial_wrangling_feedback.html, all manually graded questions are shown with 0's for marks and have no comments from TAs.

Looking at the grading logs, # lines saying feedback released was significantly more than # of lines saying feedback generated.

Saw feedback being generated in two grading accounts on a date and time when rudaux was not running the grading flow or generating feedback.

Explanation:

There is a button under Formgrader -> Manage Assignments that allow a TA to manually generate and release feedback, when clicked nbgrader will generate feedback regardless of manual grading status. As a result, if there were tutorials that were not manually graded yet, the feedback will show 0's and no comments for manually graded questions. This button can be accidentally pressed by TAs.

Solution:

Tell TAs to never click Generate/Release Feedback under manage assignments, especially if there are students that still haven't been manually graded by the TA, rudaux will do it for them once it sees that all submissions have been manually graded. If a TA accidentally clicks these, tell them to let admin know and they can delete the generated feedback in their folder.