serp-spider / search-engine-google

:spider: Google client for SERPS
https://serp-spider.github.io
Other
165 stars 61 forks source link

I can not get google mobile search results from errors yesterday. #106

Closed lifestyle-design closed 5 years ago

lifestyle-design commented 5 years ago

Hi

I always use the library. I could not get google mobile search results from errors yesterday. Have you made any changes to google's specifications? Please fix it help me

LunarDevelopment commented 5 years ago

Hello,

Can you post the error that you're seeing please ?

lifestyle-design commented 5 years ago

This is the error log of laravel [2018-08-17 19:45:36] production.DEBUG: SpiderCurlClient->sendRequest {"effectiveUrl":""} [2018-08-17 19:45:36] production.DEBUG: SpiderCurlClient->sendRequest {"initialUrl":"https://google.co.jp/search?q=%E5%A9%A6%E4%BA%BA%E7%A7%91%E6%A4%9C%E8%A8%BA&oq=%E5%A9%A6%E4%BA%BA%E7%A7%91%E6%A4%9C%E8%A8%BA&uule=w+CAIQICIiWW9rb2hhbWEsS2FuYWdhd2EgUHJlZmVjdHVyZSxKYXBhbg&filter=1&ie=UTF-8"} [2018-08-17 19:45:36] production.DEBUG: GoogleSerpService->getSerpsFromAPI 既存JSON とマージ {"jobType":"GetSerpBatch","useCache":false,"doSave":true,"doCache":false,"deviceType":"mobile","keyword":"美容皮膚科 京都","searchConditionId":4109,"crawlDate":"2018-08-17","jobDateTime":"2018-08-17 19:40:02","httpClientType":1,"proxyId(parameter)":null,"resultUnit":10,"pageNo":1,"maxPage":"5","completeStatus":62,"sourceFilePath":null,"counts":"0 to 0"} [2018-08-17 19:45:36] production.ERROR: GoogleSerpService->getSerpsFromAPI [{"jobType":"GetSerpBatch","useCache":false,"doSave":true,"doCache":false,"deviceType":"mobile","keyword":"美容皮膚科 京都","searchConditionId":4109,"crawlDate":"2018-08-17","jobDateTime":"2018-08-17 19:40:02","httpClientType":1,"proxyId(parameter)":null,"resultUnit":10,"pageNo":1,"maxPage":"5","completeStatus":62,"sourceFilePath":null,"予期しないThrowable":"順位取得に失敗しました"}]

LunarDevelopment commented 5 years ago

That doesn't look like an exception thrown by this library - could you do an \Exception $e and $e->getMessage() ?

lifestyle-design commented 5 years ago

Please tell me the verification method.

lifestyle-design commented 5 years ago

Originally when I got the ranking of the below URL with keyword "美容皮膚科 京都" ,then I could not get rank with mobile version. this url : https://www.google.co.jp/search?q=%E5%A9%A6%E4%BA%BA%E7%A7%91%E6%A4%9C%E8%A8%BA&oq=%E5%A9%A6%E4%BA%BA%E7%A7%91%E6%A4%9C%E8%A8%BA&uule=w+CAIQICIiWW9rb2hhbWEsS2FuYWdhd2EgUHJlZmVjdHVyZSxKYXBhbg&filter=1&ie=UTF-8%22%7D

Would you please re-try it for me? I apologize for any inconvenience.

gsouf commented 5 years ago

Hi @lifestyle-design

There is indeed an issue with mobile searches that probably updated. I'll look into it.

lifestyle-design commented 5 years ago

hi @gsouf

Thank you for replying, I'm very happy for waiting the latest version

gsouf commented 5 years ago

Hi @lifestyle-design

The issue should be fixed by version 0.4.2. You can update to this version as of now.

If the issue still occurs after updating, feel free to reopen

lifestyle-design commented 5 years ago

Hi @gsouf Thank you very much for fixing it. That was a really big help.