Performance of rankings

liam-mitchell / inne

The N++ discord server chatbot

MIT License

3 stars 6 forks source link

Performance of rankings #32

Open liam-mitchell opened 7 years ago

liam-mitchell commented 7 years ago

Everything is slow as all hell when a download/update ranking cycle is running on my laptop, and the cycle itself is like an hour long. This could be much, much better.

Particularly:

Locking - can we switch to a properly-multithreaded sqlite? Or just a real RDBMS? Locking is killing us
DB Profiling - figure out database queries that could be easily optimized - some ranking queries are almost certainly very poorly planned

edelkas commented 2 years ago

Late update for anyone following progress in this fork: Addressed between https://github.com/edelkas/inne/commit/507d90538594636b1d4d7072e3977beab4177024 and https://github.com/edelkas/inne/commit/03a0e8a7affbce071562eb32e05473704262a65d, between 24 Nov 2020 and 29 Nov 2020, optimized rankings 100x, the other functions by similar ratios.