search

digitalmethodsinitiative / google-play-scraper

Simple Google Play Store scraper
MIT License
12 stars 8 forks source link

Fix get_app_ids_for_query() from Google interface update #8

Closed dale-wahl closed 2 years ago

dale-wahl commented 2 years ago

Using BeautifulSoup to grab app ids. The current mappings change depending on the country code. I think this will be a more robust way of capturing the ids and hopefully won't require as many updates.

Right now it relies on looking for "role": "listitem" to grab all the listed apps and then 'store/apps/details?id=' in "href" elements to target links with the app ids.

Need to check that beautiful soup package is installed with the package before merging and releasing. Also want to run some additional tests to see if any other elements are missing elsewhere.

dale-wahl commented 2 years ago

Cool cool cool. Install Beautiful Soup good, but, as I feared, she dies here: https://github.com/digitalmethodsinitiative/google-play-scraper/blob/30718223f2ba33e24dd394798aa15ee95ff74b0d/google_play_scraper/scraper.py#L325

dale-wahl commented 2 years ago

Lots of new mappings. Fixes app details and query.

Still need to work on developer ids.