mitodl / ol-data-platform

Pipeline definitions for managing data flows to power analytics at MIT Open Learning
BSD 3-Clause "New" or "Revised" License
36 stars 6 forks source link

Update MITx Online verified enrollment mode to count for change_status #1178

Closed rachellougee closed 2 months ago

rachellougee commented 2 months ago

What are the relevant tickets?

NA

Description (What does it do?)

Fixing the 'verified' enrollment mode in intmitxonlinecourserunenrollments to exclude the enrollment change status is modified, e.g., deferred or refunded status. These should not count as verified.

I noted this issue when looking at the deferred status at https://bi.ol.mit.edu/superset/dashboard/p/Pkj5M8GqADe/. In this example, this learner has deferred the verified enrollment from course-v1:MITxT+14.73x+1T2024 to course-v1:MITxT+14.73x+3T2024, but in the dashboard, it showed both enrollments are verified. It should have been verified for course-v1:MITxT+14.73x+3T2024.

How can this be tested?

dbt build --select intmitxonlinecourserunenrollments

The new count for MITx Online verified enrollments is 13218, 341 less than production

select count(*) from  "ol_data_lake_production"."ol_warehouse_production_rlougee_intermediate"."int__mitxonline__courserunenrollments"
 where courserunenrollment_enrollment_mode='verified'
  and courserunenrollment_platform='MITx Online'