search

facundoolano / google-play-scraper

Node.js scraper to get data from Google Play
MIT License
2.28k stars 625 forks source link

Genres/categories incorrect or missing #554

Closed archon810 closed 11 months ago

archon810 commented 2 years ago

Description:

Let's take https://play.google.com/store/apps/details?id=mytown.home as an example. Both in json and html, we see multiple categories for this game: https://play.google.com/store/apps/category/GAME_SIMULATION https://play.google.com/store/apps/category/GAME_CASUAL

However, google-play-scraper returns only "genre":"Educational","genreId":"GAME_EDUCATIONAL" which isn't even visible on the page. Both GAME_SIMULATION and GAME_CASUAL are missing from the returned data.

image

  1. Can support be added for more than one genre/category per app?
  2. The correct categories should be returned. I suppose, in this case, it should be both of the above plus GAME_EDUCATIONAL?

Another example: https://play.google.com/store/apps/details?id=com.mojang.minecraftpe. This should have https://play.google.com/store/apps/category/GAME_SIMULATION, but we get back "genre":"Arcade","genreId":"GAME_ARCADE". image

And another: https://play.google.com/store/apps/details?id=com.nianticlabs.pokemongo. This should have https://play.google.com/store/apps/category/GAME_ACTION and https://play.google.com/store/apps/category/GAME_CASUAL, but we get "genre":"Adventure","genreId":"GAME_ADVENTURE". image

I don't understand why the data mismatches so much. Is the wrong data being looked at?

archon810 commented 2 years ago

https://play.google.com/store/apps/details?id=com.google.android.googlequicksearchbox doesn't even show a category in HTML? I can't find it. Yet the scraper returns "genre":"Tools","genreId":"TOOLS". Google, why are you like this?

baguse commented 2 years ago

@archon810 the scrapper get the return from javascript data i think

archon810 commented 2 years ago

@archon810 the scrapper get the return from javascript data i think

This needs looking at, because the data is there in the JSON too, I think.

borgmonitoringzoo commented 2 years ago

PSA. Google released a new version of the Google play UI. Genres are among some of the fields that have changed.

The change started rolling out May 12th per this article: https://chromeunboxed.com/google-play-store-web-app-redesign-begins-rollout-us

You may not have seen the change because Google was doing AB testing.

As of this week, it looks like they are 100% on the new UI.

archon810 commented 2 years ago

@facundoolano Is this one on your radar as well?

archon810 commented 2 years ago

I would not help @archon810, as they use open source software like this one, but refuse any information on their own software.

I'm blocking you because you seem to have some weird vendetta and complete lack of understanding of licenses, like MIT.

facundoolano commented 2 years ago

can you check if this still happens with the latest version?

maciejmackowiak commented 2 years ago

@facundoolano the issue still persist when using git+https://github.com/facundoolano/google-play-scraper#v9.0.0

maciejmackowiak commented 2 years ago

@facundoolano any updates here? where you able to look into this?

srikanthlogic commented 1 year ago

This issue still persists. "APPLICATION" is the only category that is being returned.