I recently searched Ghosler on Google & I noticed that several results included subdomains where Ghosler is deployed.
As Ghosler serves as a private newsletter management dashboard for Ghost, its content should remain unindexed by search engines to maintain relevance. Indexing these pages provides no value to public search results.
Proposed solution -
Add a default robots.txt endpoint, also add X-Robots-Tag header to all requests.
I recently searched Ghosler on Google & I noticed that several results included subdomains where Ghosler is deployed. As Ghosler serves as a private newsletter management dashboard for Ghost, its content should remain unindexed by search engines to maintain relevance. Indexing these pages provides no value to public search results.
Proposed solution - Add a default
robots.txtendpoint, also addX-Robots-Tagheader to all requests.