Closed zqian closed 1 year ago
We had a production issue today with duplicated records in UDW tables (course_dim, assignment_dim, etc).
The root cause is in the Canvas data feed, but it would be good to add a check for that data issue.
FYI, this is a query for reference:
select count(canvas_id), canvas_id from assignment_dim where assignment_dim.workflow_state <> 'deleted' group by canvas_id having count(*) > 1
We had a production issue today with duplicated records in UDW tables (course_dim, assignment_dim, etc).
The root cause is in the Canvas data feed, but it would be good to add a check for that data issue.
FYI, this is a query for reference:
select count(canvas_id), canvas_id from assignment_dim where assignment_dim.workflow_state <> 'deleted' group by canvas_id having count(*) > 1