search

abhiabhi94 / blog

A django based blog.
https://www.hackadda.com
MIT License
1 stars 1 forks source link

Add robots.txt #90

Closed abhiabhi94 closed 4 years ago

abhiabhi94 commented 4 years ago

robots.txt is used for crawlers. It defines the paths that are not be accessed by the crawlers.

abhiabhi94 commented 4 years ago

part of #45