Closed yoannmoinet closed 2 years ago
This pull request is being automatically deployed with Vercel (learn more).
To see the status of your deployment, click below or on the icon next to each commit.
🔍 Inspect: https://vercel.com/yoannmoinet/isitbig-org/6ZfhwwLSZuG12NPtQegUA41K9TU6
✅ Preview: https://isitbig-org-git-yoann-bayer-yoannmoinet.vercel.app
Bayer
Website: https://www.bayer.com/en/products/products-from-A-to-Z Wikipedia page: https://en.wikipedia.org/wiki/Bayer
The website is hosted behind akamai, and there is an automatic bot detection that is blocking us from scraping the content.
Using
puppeteer-extra
andpuppeteer-extra-plugin-stealth
in particular fixed that issue.