search

DaFluffyPotato / hitbloq

a competitive beat saber service
MIT License
20 stars 4 forks source link

optimize the all-user refresh #31

Closed DaFluffyPotato closed 2 years ago

DaFluffyPotato commented 2 years ago

Optimize the all-user refresh to scale for 1,000,000+ users. It should use the batch CR total recalc instead of individual recalcs. Maybe multithread SS requests. Also maybe split the "all-user refresh" as smaller sections across multiple days (10,000 users per day for example).

DaFluffyPotato commented 2 years ago

Could still use more optimization (specifically multithreaded SS requests), but it has been improved.