search

ansible-community / stats-collections

RShiny app to display statistics for the Ansible Collections
GNU General Public License v3.0
1 stars 2 forks source link

robots.txt #26

Open gundalow opened 2 years ago

gundalow commented 2 years ago

Seems like googlebot is crawling stats.eng and getting 500s, maybe we should just block it?