search

akiessling / urlscanner

0 stars 0 forks source link

Set add user-agent for recognition and potential bot filtering #7

Closed regniets closed 5 years ago

regniets commented 5 years ago

Can be done now using yaml and standard puppeteer options