Lookyloo / lookyloo

Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
https://www.lookyloo.eu
Other
664 stars 83 forks source link

[Feature] Deduplication of captures for takedown requests #901

Open Rafiot opened 3 months ago

Rafiot commented 3 months ago

Is your feature request related to a problem? Please describe.

A duplicate captures on lookyloo doesn't match what we need for the takedown process:

Describe the solution you'd like

MISP. When a takedown request has been validated by an analyst, it is added to MISP. When we trigger a report for suspicious URL from lookyloo, we need to add a lookup against MISP. If we have a hit, we will also know when it was added (timestamp). With that information, we can warn the analyst before they trigger the takedown that this URL was (probably) already processed recently.

Describe alternatives you've considered

Pushing back to Lookyloo a note saying that we already triggered a takedown request for a specific URL is not really an option as a URL can be somewhere in the chain of redirect an that's going to be really hard to keep track of.

Additional context

No response