Closed staabm closed 2 years ago
would be great if this lib would detect https://github.com/stevenvachon/broken-link-checker as a crawler
the user agent is broken-link-checker/0.8.0 Node.js/14.16.0 (OS X; x64) see https://github.com/stevenvachon/broken-link-checker#useragent
broken-link-checker/0.8.0 Node.js/14.16.0 (OS X; x64)
We do! See here
Peferct thx. Couldnt find the ua in the repo :-)
would be great if this lib would detect https://github.com/stevenvachon/broken-link-checker as a crawler
the user agent is
broken-link-checker/0.8.0 Node.js/14.16.0 (OS X; x64)
see https://github.com/stevenvachon/broken-link-checker#useragent