Closed pandasa123 closed 7 months ago
Something to consider...independent learners should be able to submit + receive a grade without needing a syllabus link. @JRussellHuffman + @gracelindsell might have elegant ideas for this
...or just retain the client side grading for MCQs et al and make it an optional "Submit to Professor"
Added a few thoughts here
After talking to @lerongil, we have two problems that we need to figure out:
This "submission" experience should be only available to a user if they're logged in
Meeting with @vabarbosa + @gracelindsell
Start of Problem Set
localStorage
Submission
How does it get to a professor
This is the trickiest part
Next Steps
Based on prior user interviews, we need a summarised "score", and being able to see what a student submitted.
Summarised Scores
Currently, our FRQ are scored as correct or incorrect. Over time, we can approach fractional scoring but let's assume that it's not going to be the case for now. Let's present the summary with two simple, summary measures:
Number of MCQ correct
/ Total MCQ
Number of FRQ correct
/ Total FRQ
Multiple Choice Question
For each problem, Professors should see the following:
Question
Student Score
: Correct | Incorrect
Student Answer
Actual Answer
FRQ Question
For each problem, Professors should see the following:
Question
Student Score
: Correct | Incorrect
Student Code
Suggested Code
(not needed today)Holding off development on this issue until @vabarbosa comes up with alternatives
As per @vabarbosa, we can create an email service endpoint in Saiba. Then call it from Platypus. We need to ensure this solution is as lightweight as possible client-side to make migration easy down the line
Currently user-testing the aforementioned payload, but this should be ready for development shortly
On a side note: we need some way of logging the validation response for coding questions.
@vabarbosa: We'll need to update from within the code grading widget because grading goes out to binder env where grading/validation happens & response returned to widget
What do we send on submission (draft):
Email Subject
A student just submitted their {PROBLEM_SET_NAME} Problem Set
Email Body
Hello Professor,
{STUDENT_EMAIL} just submitted their {PROBLEM_SET_NAME} Problem Set. We've attached their answers and auto-graded score.
Best, Qiskit Education
{STUDENTEMAIL}\{PROBLEM_SETNAME}\{DATE}.json
Notes:
This repository is no longer maintained. It has been superseded by IBM Quantum Learning.
Background
In a classroom, students need to submit their assignments to their professors for collection + grading. We need a way to:
Goal
Acceptance criteria
Out of scope
No response
Future of feature
After this, we all the basic pieces needed for Professors to assess a course. We need to explore deeper integrations and flexibility, such as custom professor problems, LMS integration, reporting, etc later down the line
Resources
Related to server-side MCQ
Tasks
No response