Use wildcards in Asset Manager robots.txt file

alphagov / govuk-helm-charts

Helm charts for the GOV.UK website and publishing platform (content management system). Cluster turnup automation is in https://github.com/alphagov/govuk-infrastructure.

https://www.gov.uk/

MIT License

12 stars 4 forks source link

Use wildcards in Asset Manager robots.txt file #2464

Closed brucebolt closed 1 week ago

brucebolt commented 1 week ago

Slack request

brucebolt commented 1 week ago

Thanks @theseanything. I just realised the URL was the same as the first in the list, so just added wildcards to that (and the other one, in case that gets found too).