search

MLTSHP / mltshp

Source for the application that runs mltshp.com
https://mltshp.com/
Mozilla Public License 2.0
50 stars 21 forks source link

Block AI Scrapers #743

Closed macmanx2 closed 8 months ago

macmanx2 commented 8 months ago

Added a list from https://darkvisitors.com/robots-txt-builder to hopefully block AI scrapers.