search

joshbeckman / notes

My personal site-as-a-tool
https://www.joshbeckman.org
0 stars 0 forks source link

Consider customizing robots.txt #21

Open joshbeckman opened 6 months ago

joshbeckman commented 6 months ago

Ref: https://en.wikipedia.org/wiki/Robots.txt#Alternatives

Maybe disallow GPT?

joshbeckman commented 6 months ago

ref: https://chriscoyier.net/robots.txt

joshbeckman commented 3 months ago

Ref: https://help.micro.blog/t/blocking-ai-bots/2905