Hi, first wanted to say that I love this project. I am relearning javascript and have been playing around with your project. I want to help maintain it however I can.
This project has worked perfectly for me in the past, but today I am receiving captcha responses whenever I try running the scraper. These responses include the phrase "Sorry, we just need to make sure you're not a robot. For best results, please make sure your browser is accepting cookies."
To reproduce on version 2.2.27 you can run: node bin/cli.js products -k 'test' --filetype '' --random-ua
which will return 0 products.
I modified the request headers to include DNT: 1 (based on requests that did work in my browser). And I am no longer getting the captcha response. I will submit a pull request to add this header. If the captcha responses are unique to me, feel free to close and ignore this issue.
Hi, first wanted to say that I love this project. I am relearning javascript and have been playing around with your project. I want to help maintain it however I can.
This project has worked perfectly for me in the past, but today I am receiving captcha responses whenever I try running the scraper. These responses include the phrase "Sorry, we just need to make sure you're not a robot. For best results, please make sure your browser is accepting cookies."
To reproduce on version 2.2.27 you can run: node bin/cli.js products -k 'test' --filetype '' --random-ua which will return 0 products.
I modified the request headers to include DNT: 1 (based on requests that did work in my browser). And I am no longer getting the captcha response. I will submit a pull request to add this header. If the captcha responses are unique to me, feel free to close and ignore this issue.