Getting 403 error when using scraper script

docyx / pc-part-dataset

A dataset of PC parts scraped from PCPartPicker

MIT License

167 stars 41 forks source link

Getting 403 error when using scraper script #6

Open chrisowen2015 opened 8 months ago

chrisowen2015 commented 8 months ago

I tried running the script and was getting a 403 error. I ran it with headless: false and saw that the program was getting caught up on the Cloudflare captcha check, do you have any possible solutions for this? Is it still working on your end?

docyx commented 8 months ago

It looks like PCPP have increased their anti-VPN security measures. I tried modifying the script to give me time to solve the captcha, but when I do that it either closes the tab or the check fails. It works after disabling my VPN though. I can try to look into this a bit more but it looks like you're just going to have to wing it on your home WiFi for now.

guipace commented 7 months ago

It's working using PIA vpn for me.