I have different continuation_token Objects for getting the reviews recursively from the Adnroid playstore, but the entries seem to repeat after 6333 records. I also did the same for other Android apps to see if the patter was consistent, and the same review repeating after 6333 remains the common pattern.
continuation_token.token
CoMBCoABKm8KOffsZIO6_9gB_Jielp7Fz8_Pz8_Px53NnsrMzs_MzcXOxYmSxcnLycfGzMfNyMnMyc7KycbMzMn__hCI0wIh2eyTvIBtj24xYgxFNcw2K3U5A_4nAEV8mxNQAFoLCcFo4g6gp4HXEANgpPaiygEyDQoLCgAo1qrF-vTc4wI
continuation_token after CoMBCoABKm8KOffsWhxx__5kTpielp7Fz8_Pz8_PnsvMyprOzpnLxsXOxYmSxcnLycfGzMfNyMnMyc7KycbMzMn__hDQ1AIh2eyTvIBtj24xqDED9JdGVMI5sZsBAI7jpRNQAFoLCcFo4g6gp4HXEANgpPaiygEyDQoLCgAooKmrhonJ4wI
Here's what I mean by a review object
{
"reviewId": "gp:AOqpTOHKCC_Wt1r0Py35QbMcfHvVlYDl6HK4OujKjqPdFywxh8OvJURLgFpgwI2SZP_6or5oTxQshiSATt2wmQ",
"userName": "devi hoei sunarya",
"userImage": "https://play-lh.googleusercontent.com/a-/AOh14Gh4f73MCqTu27eLX4Iml7Zv5njnU845icYF98NPDA",
"content": "Apps ini membantu saya mendaftar pengeluaran. Tapi mungkin bisa lebih diperbagus lagi di fitur dimana pengeluaran dalam laporan dikelompokkan berdasarkan kategori yg diberikan, ex: food&drink, clothes, entertainment, hobies etc. Tidak hanya dari nama barangnya atau jenis pembeliannya. Jadi dari situ membantu kita melihat dalam kategori apa pengeluaran terbesarnya.",
"score": 5,
"thumbsUpCount": 0,
"reviewCreatedVersion": "0.34.0",
"at": "2021-05-11T02:13:07",
"replyContent": null,
"repliedAt": null,
"content_translated": ""
},
This was my bad. The reviews on top of Android playstore over count the "thumbs app" Closing the issue., hence the continuation token recycles as there things to not scrape anymore.
issue
I have different continuation_token Objects for getting the reviews recursively from the Adnroid playstore, but the entries seem to repeat after 6333 records. I also did the same for other Android apps to see if the patter was consistent, and the same review repeating after 6333 remains the common pattern.
Here's what I mean
You can take any app and check this, so long as the total number of records > 10K , since the duplicates only show up at intervals of
6333
I have two records and I used after getting the continuation_token from the 1st call
first call
subsequent call
continuation_token before
I verified that I was getting the tokens right.
Here's what I mean by a review object