Disallow indexing - Githubissues

cdnjs / api-server

📡 API server for api.cdnjs.com - The #1 free and open source CDN built to make life easier for developers.

https://api.cdnjs.com

MIT License

89 stars 38 forks source link

Disallow indexing #39

Closed MattIPv4 closed 4 years ago

MattIPv4 commented 4 years ago

Type of Change

Routes: Added /robots.txt, moved / to own file
Utilities: Responses now include no-index
Tests: Test all human responses for no-index

What issue does this relate to?

N/A

What should this PR do?

Ensure that we are doing everything we can to stop Google etc. randomly indexing some responses from the API and showing them in search results.

What are the acceptance criteria?

All specs pass, no-index makes sense.