search

DARIAEngineering / dcaf_case_management

Rails-based case management system for abortion funds
MIT License
87 stars 243 forks source link

Turn off robots.txt #329

Closed colinxfleming closed 8 years ago

colinxfleming commented 8 years ago

No scrapin' for this please!

stvnrlly commented 8 years ago

Some good info on best practices in https://en.wikipedia.org/wiki/Robots_exclusion_standard and http://michaeljaylissner.com/posts/2012/01/16/respecting-privacy-while-providing-hundreds-of-thousands-of-public-documents/.

colinxfleming commented 8 years ago

Heads up -- this is all set and taken care of! Merging the PR after hacknight tonight.