pull request to resolve issue #72 Invalid responses are not handled properly
When it checks the security.txt it's possible that the domain has a redirect configured for that url. This is allowed by the RFC. But the path should remain unchanged, if the redirects points to a different path with a valid security.txt it should still log the error that the security.txt was not found at the correct location. We add a check to see if a redirect has occured and if that is the case that the path remains the same.
pull request to resolve issue #72 Invalid responses are not handled properly
When it checks the security.txt it's possible that the domain has a redirect configured for that url. This is allowed by the RFC. But the path should remain unchanged, if the redirects points to a different path with a valid security.txt it should still log the error that the security.txt was not found at the correct location. We add a check to see if a redirect has occured and if that is the case that the path remains the same.