Open NikRimington opened 4 years ago
Hi @NikRimington, it should already offer default contents, if the robots.txt file doesn't already exist.
or are you meaning something else?
I was thinking more along the lines of giving people the choice, so you might have a drop down of "Umbraco default denys", ".Net Default Denys" etc and people can choose to add them to their robots.txt file. It's possible people don't know what they need to add and so a few choices might be helpful :-)
Provide a default template option which could auto populate the robots.txt file with some pre-defined rules, such as deny bin, deny umbraco, etc.