Query performance improvements

jimmydorry commented 8 years ago

[x] CMG - Find lower matchID bound and copy all matches up into new table before working on them... instead of doing the filter straight. code
[x] CMF - Update to use new method above
[x] CMGV - Update to use new method above
[x] CMPV - Update to use new method above
[ ] Recent Games - Have separate match table with required data. Cron job that runs every five minutes. Cron job drops games older than a week from the table, and adds all of the games recorded with a matchID greater than the highest currently in the table.
[ ] CMPV - Grab number of fields from schema. Process a max of 20k games (example). If it's more than max number of games, only process the first (20k * 10 [assume avg 10 custom fields] / 24 [actual number of fields]) = 8333 games.
[ ] CMPV - Find substitute for PHP data processing. Having it all in mysql operations will be a lot faster.

jimmydorry commented 8 years ago

CMF updated to new CMG method.

jimmydorry commented 8 years ago

CMGV and CMPV updated to new method.

tianrenli92 commented 8 years ago

Would you please implement the winrate calculation asap? It's quite critical for me to balance my mod. Thanks so much! :smile:

jimmydorry commented 8 years ago

https://github.com/GetDotaStats/site/issues/280 <---- details finalised, and progress has been made... a whole new process queuing framework.

GetDotaStats / site