search

redbrick / static-site

Statically generated site for Redbrick
https://redbrick.dcu.ie
GNU General Public License v3.0
15 stars 21 forks source link

update bot list #250

Closed butlerx closed 6 years ago

butlerx commented 6 years ago

update list of authorized bots. add who runs them also?

GoldenBadger commented 6 years ago

Where can this be done? As in, what file(s)?

jonopens commented 6 years ago

Are you looking for a robots.txt?

butlerx commented 6 years ago

https://github.com/redbrick/static-site/blob/master/source/about/regulations/index.md#authorized-bots-in-lobby