Limit-webcrawler-access

NEU-DSG / dailp-encoding

Digital Archive of American Indian Languages Preservation and Perseverance

https://dailp.northeastern.edu

MIT License

20 stars 2 forks source link

Closed GracefulLemming closed 3 months ago

GracefulLemming commented 3 months ago

Prevents search engines from finding dev and uat pages. Also blocks some known AI scrapers.

netlify[bot] commented 3 months ago

Name	Link
Latest commit	0600b459f1aadc5bd4fec184376c211865fae81b
Latest deploy log	https://app.netlify.com/sites/dailp/deploys/66a183237f45fa00085e5b56
Deploy Preview	https://deploy-preview-424--dailp.netlify.app
Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.