n0madic / google-play-scraper

Golang scraper to get data from Google Play Store
GNU Lesser General Public License v3.0
78 stars 20 forks source link

Search by developer does not return app names (Title) for each app #21

Closed StefMa closed 1 year ago

StefMa commented 1 year ago

You can make use of this test to check this behviour.

Use here:

for _, app := range q.Results {
  fmt.Println(app.Title)
}

It will only print out 10 app names. The other app names (Title) are empty. What is weird, is that app.URL are available for each app.

StefMa commented 1 year ago

I debugged it a bit an the output from the "11" result is totally different. E.g. "Google Sheets":

``` [["com.google.android.apps.docs.editors.sheets",7],[null,2,[512,512],[null,null,"https://play-lh.googleusercontent.com/keE2gN0Hqh8-Tsf_RYZ_-yS2uo6ToqYVyRBv_UZaLXsgeeHBd2YPcEUWEF4DEtfGyb1h"],null,[0,0,0,255],null,null,null,2],[[null,2,[1920,1080],[null,null,"https://play-lh.googleusercontent.com/IDjPSgnayyh3M8QsEC8QCAO8qKuCPMOiDASw7g8Kntpew5WU-uMJXIrVzWOYcG6baw"]],[null,2,[1920,1080],[null,null,"https://play-lh.googleusercontent.com/7XYlK-uSNNR3dPWIcAY6VpK2HShX2Zd8ADdU1oqcV2ko3FDVDeaXQ-cFCwjhodmgkvw"]],[null,2,[1920,1080],[null,null,"https://play-lh.googleusercontent.com/3NQfiAQTHVyiPlvzebz1T69pxoAfKWnRdtd__a-GKurIW-Tblbt3blBh8Dzzba6dWDcI"]],[null,2,[1920,1080],[null,null,"https://play-lh.googleusercontent.com/mtqj_0cck6ghlSM20as9FsSOs1xp4Y18V-fWuueHYEfPHVrbEq9uAhsJfspNSSnCFw"]],[null,2,[1920,1080],[null,null,"https://play-lh.googleusercontent.com/_OquGNJr7HQ-cuSV7pgqIlI1i24wxfhwewgxhozP7GOr4LVld6yZFyZrYCKrzIBECQ"]],[null,2,[1920,1200],[null,null,"https://play-lh.googleusercontent.com/nXi5p8Y4hYmAAMtX1CfW-UIuM VGt304cnJEefKU87J-tk5SHc9nYsUR6yFrb4IUnMk4"]],[null,2,[1920,1200],[null,null,"https://play-lh.googleusercontent.com/991kCPgbTtlyntel1C3DXps12NG8jMyWlXr8LJgiXaTJBtnlLsGc0VffK7HyP-JaCemK"]],[null,2,[1920,1200],[null,null,"https://play-lh.googleusercontent.com/OotcKhmGuV6EDWk6gfFv00gnNU0pOGosMLXUHDsPH1qEun7meF-qL7qmPsDs8gC1eEY"]],[null,2,[1920,1200],[null,null,"https://play-lh.googleusercontent.com/uBUuZ4q-I42WvFU7x-CA6Oum3vxRgiLEOZwz-_j44S2bqXAK-r2yYTTw-P0WExN9ng"]],[null,2,[1920,1200],[null,null,"https://play-lh.googleusercontent.com/Z9fKAYwH90z4UaC-M09WUtGPoaB6CMVXixuGdNSomIuvdj_r_BvAKC1yhY5Q-icv6Veu"]]],"Google Sheets",["3.9",3.921205],"Productivity",null,null,[null,[[0,"EUR",""]],null,[null,"Buy"],null,1,[null,null,null,null,null,[null,null,"https://play.google.com/store/apps/details?id\u003dcom.google.android.apps.docs.editors.sheets\u0026rdid\u003dcom.google.android.apps.docs.editors.sheets\u0026feature\u003dmd\u0026offerId"]],null,["CAE\u003d"],null,null,null,null,null,null,null,[]],[null,null,[]],[null, null,null,null,[null,null,"/store/apps/details?id\u003dcom.google.android.apps.docs.editors.sheets"]],["CAIaXAozEjEKK2NvbS5nb29nbGUuYW5kcm9pZC5hcHBzLmRvY3MuZWRpdG9ycy5zaGVldHMQARgDEAkyEwiPhsD9rbr+AhUOQF0KHU+vACCKAQ0IABIJCgVlbi1VUxAAqgJgGl4ICRIzCjEKK2NvbS5nb29nbGUuYW5kcm9pZC5hcHBzLmRvY3MuZWRpdG9ycy5zaGVldHMQARgDShMIj4bA/a26/gIVDkBdCh1PrwAg+gEPCg0IABIJCgVlbi1VUxAA"],[[[null,null,"v20iyzwjDLc",[null,null,"https://www.youtube.com/embed/v20iyzwjDLc?ps\u003dplay\u0026vq\u003dlarge\u0026rel\u003d0\u0026autohide\u003d1\u0026showinfo\u003d0"],"yt:movie:v20iyzwjDLc"],null,1,[null,null,null,[null,null,"https://i.ytimg.com/vi/v20iyzwjDLc/hqdefault.jpg"]]]],[null,"Create, edit, and collaborate on spreadsheets from your Android phone or tablet with the Google Sheets app. With Sheets, you can:\u003cbr\u003e\u003cbr\u003e- Create new spreadsheets or edit existing files\u003cbr\u003e- Share spreadsheets and collaborate in the same spreadsheet at the same time.\u003cbr\u003e- Work anywhere, anytime - even offline\u003cbr\u003e - Add and respond to comments\u003cbr\u003e- Format cells, enter or sort data, view charts, insert formulas, use find/replace, and more\u003cbr\u003e- Never worry about losing your work – everything is saved automatically as you type\u003cbr\u003e- Quickly get insights, insert charts, and apply formatting with smart suggestions\u003cbr\u003e- Open, edit, and save Excel files.\u003cbr\u003e\u003cbr\u003eGoogle Sheets is part of Google Workspace: where teams of any size can chat, create, and collaborate.\u003cbr\u003e\u003cbr\u003eGoogle Workspace subscribers have access to additional Google Sheets features, including:\u003cbr\u003e- Easily add collaborators to projects, see changes as they occur, receive notifications for edits that happen while you’re away, and chat with colleagues in the same spreadsheet. All changes are automatically saved as you make them. And with offline access, you can create, view, and edit files wherever and whenever\u003cbr\u003e- Get insights fast, powered by Google AI\u003cbr\u 003e- Work seamlessly across Sheets and Excel\u003cbr\u003e- Maintain control with enterprise-grade security\u003cbr\u003e- Analyze data from other business-critical tools\u003cbr\u003e- Build custom solutions\u003cbr\u003e\u003cbr\u003eLearn more about Google Workspace: https://workspace.google.com/products/sheets/\u003cbr\u003e\u003cbr\u003eFollow us for more:\u003cbr\u003eTwitter: https://twitter.com/googleworkspace\u003cbr\u003eLinkedin: https://www.linkedin.com/showcase/googleworkspace\u003cbr\u003eFacebook: https://www.facebook.com/googleworkspace/"],"Google LLC","1,000,000,000+",null,null,null,null,null,null,[null,2,null,[null,null,"https://play-lh.googleusercontent.com/4l7xCS_HlIru6w8PmIiJtkkQJW9WIBozQMWJqGO5Aq_JrYpOCFNGl5-EbyJbs5uC_V4"],null,[17,124,67,255]],null,["USK: All ages",[null,2,[512,512],[null,null,"https://play-lh.googleusercontent.com/xjpDpgtSIWZBQ9hBSIaSjrPK90cBDBxcMX5brLAV5SwB0KuVmD_4ajQAzO-v8FhmCZUpOu3j4kWvVXJS9A"]],null,[null,"Users Interact"],[null,"\u003ca href\u003d\"https://suppor t.google.com/googleplay?p\u003dappgame_ratings\"\u003eLearn more\u003c/a\u003e"],false,null,[null,2,[272,272],[null,null,"https://play-lh.googleusercontent.com/Yt3niOQLbS76NeWcUhat0tDY3c5NLfIqlNdmyTGShJcZ8db6H9K-tTcmS2RjVR0WedVabzba7W1bOlkbhg"]],[null,null,null,null,null,[null,null,"https://support.google.com/googleplay?p\u003dappgame_ratings"]]],[[[[[null,[[0,"EUR",""]],null,[null,"Buy"],null,1,[null,null,null,null,null,[null,null,"https://play.google.com/store/apps/details?id\u003dcom.google.android.apps.docs.editors.sheets\u0026rdid\u003dcom.google.android.apps.docs.editors.sheets\u0026feature\u003dmd\u0026offerId"]],null,["CAE\u003d"],null,null,null,null,null,null,null,[]]],["Install"],null,["CgYKBENBRT0\u003d"]]]],[2],null,[1,true,false]] ```

vs "the next app" (which is Google Calendar):

``` [null,[null,[[null,2,[512,512],[null,null,"https://play-lh.googleusercontent.com/Jsbb0EeesKUbDTl3UyDKO6sNz45RCMh7gnoI6giQcQz1f5Mj0J4TRh7Psyu53vShh-qm"],null,[254,255,255,255],null,null,null,2],[null,2,[512,512],[null,null,"https://play-lh.googleusercontent.com/Jsbb0EeesKUbDTl3UyDKO6sNz45RCMh7gnoI6giQcQz1f5Mj0J4TRh7Psyu53vShh-qm"],null,[254,255,255,255],null,null,null,2],[null,2,[512,512],[null,null,"https://play-lh.googleusercontent.com/Jsbb0EeesKUbDTl3UyDKO6sNz45RCMh7gnoI6giQcQz1f5Mj0J4TRh7Psyu53vShh-qm"],null,[254,255,255,255],null,null,null,2]],2,2],"Google Calendar",null,[[["Google LLC",[null,null,null,null,[null,null,"/store/apps/dev?id\u003d5700313618786177705"]],true]],[null,[null,[null,"Always know what’s next with Google Calendar, part of Google Workspace."]]]],null,[[null,null,[null,["3.9",3.8882947]]]],null,[5,5,5],[null,null,null,null,[null,null,"/store/apps/details?id\u003dcom.google.android.calendar"]],null,["CAIaTAojEiEKG2NvbS5nb29nbGUuYW5kcm9pZC5jYWxlbmRhchABGAMQCjITCMP8yf2tuv4CFYzc3wodF+EIR IoBDQgAEgkKBWVuLVVTEACqAlAaTggKEiMKIQobY29tLmdvb2dsZS5hbmRyb2lkLmNhbGVuZGFyEAEYA0oTCMP8yf2tuv4CFYzc3wodF+EIRPoBDwoNCAASCQoFZW4tVVMQAA\u003d\u003d"],["com.google.android.calendar",7]] ```

There are a lot of nulls involved 🤔

n0madic commented 1 year ago

Fixed in this commit