WikiEducationFoundation / WikiEduDashboard

Wiki Education Foundation's Wikipedia course dashboard system
https://dashboard.wikiedu.org
MIT License
392 stars 631 forks source link

[Data rearchitecture] Try to speed up pre-update process #6039

Closed gabina closed 6 days ago

gabina commented 1 week ago

What this PR does

This PR adds a new index to article_course_timeslices table to try to speed up the pre-update process.

I noticed that for some heavy courses like Pharmacology at Bar Ilan University or Denkmal-Cup the pre-update process takes 4 minutes even though no course data changed (no new dates, no new wikis, no new users, no new untracked articles). The heaviest queries are those that involve article_course_timeslices table, so I added a new index to speed up this task.

Open questions and concerns

< anything you learned that you want to share, or questions you're wondering about related to this PR >