facundoolano / app-store-scraper

scrape data from the itunes app store
MIT License
1.03k stars 244 forks source link

search result is different than app store on iPhone #117

Open gaurangubhatt opened 4 years ago

gaurangubhatt commented 4 years ago

I use latest version of this repo with latest nodejs. Till last month, I was getting search result same as app store on iPhone But now suddenly search result changed when search by term.

const BASE_URL = 'https://itunes.apple.com/WebObjects/MZStore.woa/wa/search?clientApplication=Software&media=software&term=';

I see that lib uses above url to fetch search result. Do you know any changes in it? or anything changed by the apple?

gaurangubhatt commented 4 years ago

For example, My app shows on 5th rank for one keyword on app store in iPhone but when I use this lib/repo, then It shows rank on 80th for same keyword.

So I am confuse that what has been changed?

yurganov commented 4 years ago

Can you please provide more details - what query, what app you having problem with.

Also, may be your forgot to provide country parameter to method?

gaurangubhatt commented 4 years ago

Hi,

Below is the my url with search term.

https://search.itunes.apple.com/WebObjects/MZStore.woa/wa/search?clientApplication=Software&media=software&term=route+planner

Also, I am passing correct store front id into request header.

X-Apple-Store-Front: 143441-1,32

Also, Passing User Agent

iTunes/12.5.4 (Windows; Microsoft Windows 10.0 x64 Home Premium Edition (Build 10586); x64) AppleWebKit/7602.3012.0.11

So In US Store, It shows rank 4 in search result for "route planner" keyword but actually, In iPhone, It shows rank 11th for same keyword.

So this different search result is the problem.

GoMino commented 4 years ago

@gaurangubhatt where does the 32 in X-Apple-Store-Front: 143441-1,32 come from? This value is harcoded to 24 in the codebase 🤔