VaclavRut / actor-amazon-crawler

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.
https://apify.com
68 stars 32 forks source link

Searching for ISBN Books works on site, returns nothing on crawler #16

Open pocesar opened 3 years ago

pocesar commented 3 years ago

Example: https://www.amazon.co.uk/s?k=9780312944926&ref=nb_sb_noss

INPUT:

{
  "scraper": true,
  "country": "UK",
  "category": "stripbooks-intl-ship",
  "searchType": "keywords",
  "search": "9780312944926",
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  },
  "maxReviews": 0,
  "delivery": ""
}

Leads to log entry and 1 dataset item with "No items for this keyword":

2020-08-25T16:03:45.241Z INFO: Found 0 on a site, going to crawl them. URL: https://www.amazon.co.uk/s?k=9780312944926&i=&ref=nb_sb_noss
2020-08-25T16:03:45.447Z INFO: BasicCrawler: All the requests from request list and/or request queue have been processed, the crawler will shut down.
devdce commented 3 years ago

I think this is related to the same issue due to amazon special presentation for items like books, videogames and some times even DVD/Blu-ray : https://github.com/VaclavRut/actor-amazon-crawler/issues/23