[Feature] CERT PL phishing truncated hash HTML structure

[Rafiot]

Is your feature request related to a problem? Please describe.

Some kind of fuzzy hash on the HTML content of a rendered page.

Describe the solution you'd like

Hash generation used by CERT PL:

from bs4 import BeautifulSoup  # type: ignore

def sha256_128(data: bytes) -> str:
    return sha256(data).hexdigest()[:32]

def extract_tags(html: str) -> str:
    soup = BeautifulSoup(html, "html.parser")
    tags = soup.findAll()
    return "|".join(t.name for t in tags)

def html_hash(content: Union[str, bytes]) -> Optional[str]:
    try:
        if isinstance(content, bytes):
            html_content = content.decode()
        else:
            html_content = cast(str, content)

        tag_string = extract_tags(html_content)
        return sha256_128(tag_string.encode())

    except Exception as e:
        log.warning("Error while calculating html hash: %s", e)
        return None

Describe alternatives you've considered

No response

Additional context

No response