mitodl / micromasters

Portal for learners and course teams to access MITx Micromasters® programs
https://mm.mit.edu
BSD 3-Clause "New" or "Revised" License
29 stars 17 forks source link

move exams to edx.org #4627

Open odlbot opened 4 years ago

odlbot commented 4 years ago

Instead of offering proctored exams through Pearson Vue, we will offer virtual proctored exams on edx.org.

The course team will create 6 exam "courses" on edX for each exam run, one for each course.

After the course ends, the course team will collect a list of all learners who have passed (now or in the past) and manually enroll them in the appropriate exam course(s).

Learners will need to "pay" and verify their identification for the exam course.

We will provide learners with an coupon code for each exam course they plan to take. The specifics of how we will distribute edx coupon codes are TBD.

Epic issues:

annagav commented 4 years ago

@pdpinch it seems to me that exams can be created on edx for a course, I didn't find any equivalent for exam authorization or the ability to add students to an exam. We could continue authorizing users for exams on our end based on the a passing score for a course run.

As for the coupon codes we could add that information to the exam card when the user has paid for the exam.

ProctoredExamStudentAttempt is the object that describes users attempt to take an exam. We can query the existing exams for a course by the edx_course_key through /edx_proctoring/v1/proctored_exam/exam/course_id/{course_id}, or learn about the status of a particular exam attempt /edx_proctoring/v1/proctored_exam/attempt/course_id/{course_id}. This contains information about the status of exam attempt and the review status (as 'completed', 'started', etc). There is no indication of a numerical grade for the exam.

This is what I have found so far, let me know if you have any more insights on how the course team is managing the exams. Have they done any test examinations?

annagav commented 4 years ago

@pdpinch The number of authorizations for 1T2020 exams is 6321. The number of exams taken is 785. And number of exam grades: 676.

annagav commented 4 years ago

The email subject and body for notifying about a FinancialAid status update. Accepted statuses APPROVED and REJECTED have the same email is sent for both statuses:

"Dear {first_name}, After reviewing your income documentation, the {program_name} MicroMasters team has determined that your personalized course price is {price}. You can pay for MicroMasters courses through the MIT MicroMasters portal (https://micromasters.mit.edu/dashboard). All coursework will be conducted on edx.org. Thank you, The {program_name} MicroMasters team"

For status PENDING_MANUAL_APPROVAL (documents have been received) the email body is as follows:

"We have received your documents verifying your income. We will review them as soon as possible, after which we will send an e-mail confirming your personalized course price. We encourage you to enroll now and pay later, when a decision has been reached."

annagav commented 4 years ago

The are only two states for the exam card. One where there is an existing exam run and one where there are no schedulable exam runs:

Screen Shot 2020-08-17 at 9 44 48 AM Screen Shot 2020-08-17 at 9 47 36 AM

Most other states and messages about exam runs are communicates in the course row:

Screen Shot 2020-08-17 at 9 50 02 AM Screen Shot 2020-08-17 at 9 50 31 AM Screen Shot 2020-08-17 at 9 51 02 AM Screen Shot 2020-08-17 at 9 51 14 AM Screen Shot 2020-08-17 at 9 51 36 AM Screen Shot 2020-08-17 at 9 51 49 AM Screen Shot 2020-08-17 at 9 55 37 AM Screen Shot 2020-08-17 at 9 57 54 AM Screen Shot 2020-08-17 at 10 00 16 AM
pdpinch commented 4 years ago

For the exam card, there's also this state:

image

Which reminds me that we should remove the code that sends profiles to Pearson.

pdpinch commented 4 years ago

@annagav I added a bunch of issues for this epic. Can you take a look and let me know if they make sense, and if anything is missing (as far as you know now)?

pdpinch commented 3 years ago

Added a new issue to this epic: #4646 Purchase only buys one exam attempt

pdpinch commented 3 years ago

I added a checkbox for stopping the exam authorizations being sent to Pearson. And I crossed off a checkbox about creating a BI report of authorizations because it's no longer necessary for getting learners into the exam courses.