search

DemocracyLab / CivicTechExchange

https://www.democracylab.org
MIT License
97 stars 64 forks source link

Configure S3 buckets to not be indexable by search engine crawlers #972

Open marlonkeating opened 1 year ago

marlonkeating commented 1 year ago

Currently the publicly viewable files we store in S3 for users is being indexed by at least google, and continues to be indexed if the files are removed from S3. We would like to prevent this indexing somehow, as we only want the files accessed via the DemocracyLab platform.

ashwin-sp commented 3 months ago

https://dev.to/abhishek_biswal/how-to-prevent-your-files-from-being-indexed-while-your-application-uses-s3-for-storage-and-cloudfront-as-distribution-2pfd

Has this solution been tried out?