juffalow / pentest-tool-lite

Test your page against basic security, html, wordpress, ... check lists
https://pentest-tool-lite.com/
MIT License
27 stars 10 forks source link

robotstxt test #58

Closed Kubik2000 closed 3 years ago

Kubik2000 commented 3 years ago

I've added a new robotstxt test that checks if a url/robots.txt file exists

codecov-io commented 3 years ago

Codecov Report

Merging #58 (f082a8f) into master (2e7295b) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master      #58   +/-   ##
=======================================
  Coverage   69.56%   69.56%           
=======================================
  Files          12       12           
  Lines         161      161           
  Branches       21       21           
=======================================
  Hits          112      112           
  Misses         49       49           

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 2e7295b...f082a8f. Read the comment docs.

juffalow commented 3 years ago

Is robots.txt really mandatory? I am just asking if it is not better to show just warning.