Add a dynamic robots.txt generating option

TimGeyssens / Umbraco-v8-Community-Website-StarterKit

The goal of this repo is to have a community managed starter project/kit for #umbraco v8 following the best practices and showcasing nice tips and tricks

https://dev.to/timgeyssens/how-to-join-the-fun-and-get-started-with-contributing-to-the-umbraco-community-starter-project-kit-36gn

MIT License

18 stars 12 forks source link

Add a dynamic robots.txt generating option #61

Open TimGeyssens opened 4 years ago

TimGeyssens commented 4 years ago

Should be possible to set a Disallow all... and probably exlude dirs and seperate pages...

TimGeyssens commented 4 years ago

of course bonus points of it works in multi site setup