search

wellcomecollection / wellcomecollection.org

🪟 Wellcome Collection's website and services that support it
https://wellcomecollection.org
MIT License
39 stars 5 forks source link

Allow Moz to crawl wellcomecollection.org #10799

Open LaurenFBaily opened 5 months ago

LaurenFBaily commented 5 months ago

Alert from Moz:

Moz was unable to crawl your site on Apr 12, 2024. Our crawler was banned by a page on your site, either through your robots.txt, the X-Robots-Tag HTTP header, or the meta robots tag. Update these tags to allow your page and the rest of your site to be crawled. If this error is found on any page on your site, it prevents our crawler (and some search engines) from crawling the rest of your site. Typically errors like this should be investigated and fixed by the site webmaster. Read our troubleshooting guide.

See Slack.

LaurenFBaily commented 5 months ago

I have login credentials for the Moz account when needed.