mitodl / micromasters

Portal for learners and course teams to access MITx Micromasters® programs
https://mm.mit.edu
BSD 3-Clause "New" or "Revised" License
29 stars 17 forks source link

User count consistency issue in MM Postgres #3971

Open maxliu opened 6 years ago

maxliu commented 6 years ago

The table below is a summary of user count at different combinations of categories.

Count of user_id           order_status 0 1 1 1 1
            program_certificate 0 0 0 0 1
            proctoredexam 0 0 1 1 1
            course_certificate 0 0 0 1 1
in_auth_user is_active in_program in_profiles_profile profile_filled_out in_enrollment            
1 0 0 1 0 0   2        
1 0 0 1 0 1   1        
1 0 0 1 1 0   5        
1 0 0 1 1 1   10   1 (a)    
1 0 1 1 1 1   1        
1 1 0 0 0 0   3 (e )        
1 1 0 1 0 0   4475        
1 1 0 1 0 1   3712        
1 1 0 1 1 0   7 (g)        
1 1 0 1 1 1   10 (f)        
1 1 1 1 0 0   820        
1 1 1 1 0 1   769     1 (c )  
1 1 1 1 1 0   7070 42 6 (b) 2 (d)  
1 1 1 1 1 1   17364 820 93 515 42

Possible issues.

Note: The summary table above is generated from https://bi.odl.mit.edu/queries/343 .

related issue: https://github.com/mitodl/micromasters/issues/3964

maxliu commented 6 years ago

detailed queries.

case - a. reason for case-a (one user paid and attended Pearson exam but is not in "ProgramEnrollment" table). This user was kicked out because of wrong behaviour. Detailed query: https://bi.odl.mit.edu/queries/344/

case - b. 6 users attended Pearson exam but not in "cachedEnrollment" table. -- https://bi.odl.mit.edu/queries/347/

case - c. one user got course certificate but didn't fill out the profile. -- https://bi.odl.mit.edu/queries/350#561

case - d. user got certificate but not in cached enrollment -- https://bi.odl.mit.edu/queries/345/

case - e. 3 users only in "auth_user" table

-- https://bi.odl.mit.edu/queries/351/

case - f. 10 users in "cachedEnrollment" table and filled out the profile but are not in "ProgramEnrollment" table.

-- https://bi.odl.mit.edu/queries/353/

case - g. 7 users filled out profile but not in "ProgramEnrollment" table or"cachedEnrollment" table.

-- https://bi.odl.mit.edu/queries/354/

maxliu commented 6 years ago

One way to get user list is from the queries listed above, another way is to double click in cell of pivot table from the Excel file of "MM_- user count_2018_05_04.xlsx".

pdpinch commented 6 years ago

@maxliu what's the status of this issue?

pdpinch commented 6 years ago

Ok. I think I want to look at cases c and d.