CorrelAid / correlaid_website

Source code for the CorrelAid website
https://correlaid.org
3 stars 0 forks source link

Add robots.txt #766

Closed jstet closed 1 month ago

jstet commented 1 month ago

Add scraping policy etc.