Issues with Crawling Video Game items, Books - Githubissues

VaclavRut / actor-amazon-crawler

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.

https://apify.com

68 stars 32 forks source link

Issues with Crawling Video Game items, Books #23

Open devdce opened 3 years ago

devdce commented 3 years ago

There are issues for specific items (Im guessing due to particular presentations) for video games and books. Examples on amazon.fr :

https://www.amazon.fr/s?i=videogames&bbn=2785614031&rh=n%3A530490%2Cn%3A2785614031%2Cn%3A2785617031%2Cp_76%3A183942031&s=date-desc-rank&dc&fst=as%3Aoff&qid=1607778736&rnid=2785614031&ref=sr_nr_n_4 ----> for this url, the crawler will only pick up items that are not video games due to special presentations (items presented with subcategories by console type)
Same think happens here : https://www.amazon.fr/s?bbn=7351213031&rh=n%3A301061%2Cn%3A%21425526031%2Cn%3A%21425528031%2Cn%3A7351213031%2Cp_76%3A183937031&dc&fst=as%3Aoff&qid=1607780025&rnid=183925031&ref=lp_7351213031_nr_p_76_0 ----> Im guessing the issue here is the special presentations due to different format (kindle etc..).

devdce commented 3 years ago

any news on this bug ?