We've typically hosted the origin wordpress on a *.wpengine.com subdomain. This then gets the default robots.txt file they apply to keep content out of the index:
User-agent: *
Disallow: /
However the downside is that your images have no-index, which keeps twitter from using. We then use the META.proxyWordPressImages option to get around this.
A couple improvements:
1) document this.
2) Rather than assume the server will inject no-index, let's specify with a version controlled robots.txt for WP.
We've typically hosted the origin wordpress on a
*.wpengine.comsubdomain. This then gets the default robots.txt file they apply to keep content out of the index:However the downside is that your images have no-index, which keeps twitter from using. We then use the
META.proxyWordPressImagesoption to get around this.A couple improvements:
1) document this. 2) Rather than assume the server will inject no-index, let's specify with a version controlled robots.txt for WP.