Open dbietila opened 6 years ago
I setup a robots.txt here: http://ecuip.lib.uchicago.edu/robots.txt
But we should talk more about this tomorrow. We need to better understand what the desired result is.
It looks like we can ask google to remove it but we'll need to verify the site and add it to Search Console. @johnjung could you do this?
Added and verified.
@johnjung Was this issue/bug resolved and be closed?
Elisabeth asks that we block Google/commercial search engine indexing of eCUIP pages in http://ecuip.lib.uchicago.edu/diglib/language/blackboy/* .
Please evaluate whether a robots.txt directive, a noindex tag, or other approach would be appropriate.