Closed lynxionxs closed 5 years ago
Puppeteer is used for more than just scraping websites, its a tool, and its up to you how you use it. Also from the quoted text:
identify itself via a unique User Agent string describing the purpose of the web client; and obey the robots exclusion standard (also known as the robots.txt standard), including the crawl-delay directive;
So if that is how you want to use it, thats what you need to do to follow Heroku's rules.
Also this repo is just the buildpack for getting puppeteer running on Heroku and nothing more, so questions about Heroku's acceptable use might be better directed towards them.
I've got this running on heroku. But in Acceptable Use Policy line 21 of
Prohibited Actions
, they say we are not allowed to use such tools on heroku for scraping websites. Am i missing something?