[Replays/SEO] Block /download endpoint from search engines

Arcana / dotabank-web

dotabank.com

8 stars 6 forks source link

Closed rjackson closed 10 years ago

rjackson commented 10 years ago

cuz 14,794 "Access denied" in webmaster tools.

rjackson commented 10 years ago

user-agent: *
disallow: /replays/*/download/

robots.txt hard