gadicc / meteor-robots.txt

Serves a robot.txt which can be modified programatically
MIT License
10 stars 3 forks source link

robots.txt smart package

Copyright (c) 2013 Gadi Cohen dragon@wastelands.net, released under the MIT license (see LICENSE.txt).

Currently, all this package does is implement a robots.addLine('line') which other packages can use to add lines to what is served at /robots.txt.

If there is any demand for other functions, they can be added too. Let me know if you need to modify an existing robots.txt or want other functionality.

Existing public/robots.txt