search

ucrcsedept / galah

An automated grading system geared towards processing computer programming assignments.
Apache License 2.0
42 stars 8 forks source link

assignment_progress or get_csv numbers are incorrect #421

Open atkoehler opened 10 years ago

atkoehler commented 10 years ago

The distributions produced by these items should be equivalent, they are not. Either "assignment_progress 1" is not correctly calculating the distribution or "get_csv" is silently converting some "None" grades to 0 while missing others.

From the below, it is presumed that all submissions without a grade are "None" scores, meaning there are 14 "None" scores.

> assignment_progress cs010_14spr/Lab3 1
INFO: Executing assignment_progress command on Galah as user ucrcs10v@cs.ucr.edu.
231 out of 288 students have submitted

-- Grade Distribution (Points: # of students) --
0: 1
1: 216

However, based on the CSV from get_csv the distribution is:

231 students submitted
0: 13
1: 216
None: 2
atkoehler commented 10 years ago

As an aside, I was actually looking for a way to determine the "None" submissions to try and grab code that crashed the test harness, so that the harness can be fixed to handle whatever happened more gracefully.