search

drawrowfly / amazon-product-api

Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
624 stars 177 forks source link

Feature Request - Support for scraping the products by search URL #52

Open shashankmistry31 opened 3 years ago

shashankmistry31 commented 3 years ago

Hello there,

This is a feature request (if possible) for adding support for scraping products directly by proving the search URL link to accommodate additional filters provided by Amazon.

Something like 

amazon-buddy seachurl -k 'https://www.amazon.de/s?k=Maybelline&i=beauty&rh=n%3A84230031%2Cp_6%3AA3JWKAKR8XB7XF%2Cp_72%3A184779031&dc&language=en&qid=1620276591&rnid=184735031&ref=sr_nr_p_72_2'

Really appreciate your work.

drawrowfly commented 2 years ago

Sounds good. Will see what i can do

seaprogrammer commented 1 year ago

Yeah, that'd be great. I ran some tests and they seem to block less if you are using search URLs. (-buddy doesn't work for me now -- amazon almost always gives me their result "To discuss automated access to Amazon data please contact api-services-support@amazon.com". (I even emailed them, but... "The recipient's mailbox is full")

(I've used my browser user-agent, randomized the user-agent, etc. And this was just a few product searches for personal use too -- not even one gets through now.)

Anyway, thanks for the useful project otherwise! :) Keep up the good work.

(Y'know, if Amazon would let you search properly, some of the need for this would be reduced, not that web-search is a replacement for getting a db of info.) Aliexpress at least lets you search by number of orders (with the exception of their more-recent inclusion of some "smart" algorithm which can make things more irritating.)