Closed macmanx2 closed 6 months ago
Added a list from https://darkvisitors.com/robots-txt-builder to hopefully block AI scrapers.
Added a list from https://darkvisitors.com/robots-txt-builder to hopefully block AI scrapers.