Request for Support for Partial Grading based on Passed Test Cases

[KayvanShah1]

Issue Description:

Background:

GitHub Classroom's auto-grading feature is a valuable tool for instructors to assess student assignments automatically. However, one area we currently need to improve is the inability to perform partial grading based on individual test cases within the auto-grading suite. This functionality would significantly enhance the grading flexibility and provide more accurate feedback to students.

Feature Request:

I propose implementing a feature that allows instructors to perform partial grading based on the specific test cases that a student's code passes. The auto-grading workflow currently provides an all-or-nothing assessment, which may not reflect a student's true proficiency in different aspects of the assignment.

Requested Functionality:

1. Selective Test Execution: Introduce the ability to selectively execute specific test cases within the auto-grading suite based on their weight or importance. For instance, if an assignment has multiple requirements, the instructor should be able to assign weights to these requirements and execute tests accordingly.

2. Gradual Accumulation of Scores: When a test case is passed, the corresponding weight should contribute to the student's overall score. This way, a student's grade accurately reflects their proficiency in different aspects of the assignment.

3. Customizable Feedback: Instructors should be able to provide customized feedback for each test case. Feedback could include explanations for passed and failed test cases guiding students on areas they need to improve.

4. Integration with GitHub Classroom Workflow: Ensure that this feature integrates seamlessly with GitHub Classroom's existing workflow. Setting up, configuring, and managing directly within the Classroom interface should be easy.

Benefits:

• Enhanced Grading Accuracy: Partial grading allows for a more nuanced assessment of student submissions, accurately reflecting their skills and understanding.
• Focused Feedback: Students can receive specific feedback on the aspects of the assignment they need to improve, fostering a more targeted learning process.
• Flexibility: Instructors can tailor grading criteria to the assignment's requirements, making grading fair and relevant.

Community Interest:

This feature enhancement would be valuable to many educators using GitHub Classroom for grading. Many instructors would benefit from the ability to perform granular, partial grading based on passed test cases.

Implementation Considerations:

I understand that implementing this feature involves a lot of technical considerations. I'm open to discussing potential implementation approaches and collaborating on the development process.

Conclusion:

I am excited about the possibilities this feature could bring to GitHub Classroom's auto-grading capabilities. The ability to perform partial grading based on passed test cases would significantly improve the grading experience for both instructors and students.

Thank you for considering this feature request. I look forward to the community's thoughts and discussions on this topic.

[GittyBitch]

Sounds related to: https://github.com/education/autograding/issues/111