search

Lissy93 / web-check

🕵️‍♂️ All-in-one OSINT tool for analysing any website
https://web-check.xyz
MIT License
22.54k stars 1.73k forks source link

feature request check if humans.txt exists #8

Closed Pierre-Gronau-ndaal closed 1 year ago

Pierre-Gronau-ndaal commented 1 year ago

https://humanstxt.org/

Lissy93 commented 1 year ago

Do you know if there is an RFC, formally defined API specification or schema for this?

It wouldn't be hard to add it in, but I've not seen many websites use it, and in order to parse it properly I'd need more of a formal spec than the humanstxt.org provides.

Pierre-Gronau-ndaal commented 1 year ago

I‘m not aware of a RFC …

Where is it located? In the site root. Just next to the robots.txt file. If possible, you can also add an author tag to the of the site:

alternative you can check https://stackoverflow.com/questions/7067963/where-to-place-the-humans-txt-file-if-i-cannot-put-it-on-the-site-root

the same place like security.txt

Lissy93 commented 1 year ago

Closing as not a formal standard - less than 0.5% of top 1,000,000 sites implement this, and with no specification the format varies greatly and is subject to change. Will re-open if an RFC for it pops up sometime in the future.