search

drandreaskrueger / epic-ratings

lookup (e.g. metacritic-) ratings for my epicgames licenses
MIT License
0 stars 1 forks source link

feature request: for missing data, also download ratings pages for other platforms #2

Open drandreaskrueger opened 1 year ago

drandreaskrueger commented 1 year ago

feature request:

for missing data, also download ratings pages for other platforms

Problem

If my main platform ( /pc/ ) has not enough reviews (or is missing data completely), then the meta/user-score on another platform is better than having no data - right?

Random example "prison-architect":

wish

I would prefer to have userscore=6.8 with 44 ratings in my results CSV table, perhaps additional to (or perhaps even instead of) the userscore=None

solutions

There are different routes to solve this:

  1. BruteForce: Always download everything for all platforms, parse later. Disadvantages: Too much data is not always helpful. Plus, much more traffic load for metacritic. And more waiting time.
  2. create a combined downloadAndParse.py which parses the downloaded page already, and immediately goes to the next platform if it detects good reasons to do so. The basic code for that is there already, but at the moment it tries the next platform (see platformsOrdered in settings.py, and where it is used in downloader.py) only if not page.status_code==200.
  3. create a downloadPatcher.py which takes the CSV file that filesparser.py has output, identifies the missing data, and then downloads only the needed files on other platforms.

open questions

What is with "the other score", i.e. in this example case the "metascore=83" on /pc/ ?
Do I also drop that, i.e. drop all /pc/ data, and instead everywhere use the /playstation-4/ results, i.e. "metascore=80" ?

Opinions please. Thanks.

drandreaskrueger commented 1 year ago

In some cases the USERSCORE might be missing (see above), in other cases the the METASCORE, like here:

An example where the METASCORE is still missing for /pc/: