Add Diffbot to robots.txt

MLTSHP / mltshp

Source for the application that runs mltshp.com

https://mltshp.com/

Mozilla Public License 2.0

50 stars 21 forks source link

Closed macmanx2 closed 5 months ago

macmanx2 commented 5 months ago

Fresh from Dark Visitors, let's add Diffbot: https://darkvisitors.com/agents/diffbot