Currently, if an assessment does not contain problems with names matching the autograder output, those results from the autograder will not be displayed, and no feedback is given as to why no results are displayed. It would be good if there was a check to see if all problems defined within "scores" for the autograder results exist within the gradebook, and some sort of flash displayed notifying the instructor if not.
This is based on the issue 213 faced where they didn't have problems defined and were confused as to why autograding feedback was not being parsed.
Currently, if an assessment does not contain problems with names matching the autograder output, those results from the autograder will not be displayed, and no feedback is given as to why no results are displayed. It would be good if there was a check to see if all problems defined within "scores" for the autograder results exist within the gradebook, and some sort of flash displayed notifying the instructor if not.
This is based on the issue 213 faced where they didn't have problems defined and were confused as to why autograding feedback was not being parsed.