Open nottrobin opened 6 years ago
Potentially one which can optionally ignore rel="nofollow" and Disallow instructions, maybe even allowing you to ignore them only for specific sites.
rel="nofollow"
Disallow
Relevant: https://webmasters.stackexchange.com/questions/115514/do-any-search-engines-exist-which-ignore-rel-nofollow-or-disallow
Potentially one which can optionally ignore
rel="nofollow"andDisallowinstructions, maybe even allowing you to ignore them only for specific sites.Relevant: https://webmasters.stackexchange.com/questions/115514/do-any-search-engines-exist-which-ignore-rel-nofollow-or-disallow