search

sudheer-ranga / aliexpress-product-scraper

Get Aliexpress product details as a json response including feedbacks, variants, shipping info, description, images, etc.,
MIT License
231 stars 88 forks source link

Review limiter #12

Closed akshaycj closed 9 months ago

akshaycj commented 3 years ago

Why is there a limit for review fetching? like 10 pages or 100 reviews?

sudheer-ranga commented 3 years ago

Technically Aliexpress product info and reviews are two separate pages. We will not be able to get reviews when we fetch product. So by default we only fetch 10 reviews for each product.

akshaycj commented 3 years ago

is that number kept fixed so that aliexpress doesn't block the requests? or can I go ahead and increase that? @sudheer-ranga

sudheer-ranga commented 9 months ago

You can increase the limit by modifying the source. I have released a new release v2.0.2. When you are using scrapers and doing some heavy work, make sure you use proxies so that aliexpress won't block the scripts.