overhangio / tutor-cairn

Scalable, real-time analytics for Open edX
8 stars 13 forks source link

Feat: Upgrade clickhouse server docker image #38

Closed FahadKhalid210 closed 6 months ago

FahadKhalid210 commented 7 months ago

fix #30 Upgrade clickhouse docker image and fix query issues due to deprecation of Live views.

We currently have 2 live views course_enrollments & course_block_completion. After upgrading clickhouse version, we encountered errors due to deprecation of live views.

image

After transitioning from live views to normal views to resolve the issue, we encountered a new challenge: course_enrollment & course_block_completion tables are only accessible in main db(openedx) and we get error on staff specified db’s. It's because staff user's don't have access to the tables that view statement is utilizing(_openedx_course_enrollments, _openedx_user_profiles & _openedx_users etc).

To resolve this, we've extended access to these tables for staff users and updated the corresponding row policy. This decision is backed by the fact that the live view already displays data from these tables through join operations.