search

platonai / exotic-amazon

A complete solution to crawl amazon at scale completely and accurately.
143 stars 46 forks source link

How to handle robot_check? #42

Open zhenx opened 6 months ago

zhenx commented 6 months ago

Hi There, Thanks for opening source this great project. I tried the code with prod mode and kept meeting the following issues:

WARN a.p.p.p.b.e.i.BrowserEmulatorImplBase - 36431. Page is ROBOT_CHECK(11.54 KiB) | file:///tmp/ln/e075a6cc88115740737a49a1c987d362.htm | https://www.amazon.com/dp/B07FLMNQRG

I wonder how exotic-amzon handles this case after three retries. Is there any built-in way to solve the captcha? If not, how to handle it with a third party captcha solver like https://github.com/a-maliarov/amazoncaptcha? Thanks.

galaxyeye commented 6 months ago
  1. run bin/tools/chrome/prototype/start.sh to visit amazon.com manually, random visit some pages, if captcha appears, clear all cookies and do it again.
  2. activate proxies.
galaxyeye commented 6 months ago

see also https://github.com/platonai/exotic-amazon/issues/28