Improve source data

[fabriziosalmi]

• aggregate most updated only

[fabriziosalmi]

change detection monitor added.

it will check for most updated blacklists (24h max freshness) and save urls to most-updated.blacklists.urls

in a reasonable time range a migration from blacklists.fqdn.urls to this file is expected with the result to have less but a more updated blacklisting.

[fabriziosalmi]

Current status:

• 60 blacklists used (longest update, ~1m)
• 40 blacklists found by changedetection service (longest update, 1d)

In a close future less updated blacklists will be removed from integration. Extraction of important domains from removed blacklists to include in the blacklist.txt if needed. Review against removed blacklists will be done after 3m max.

More entries will be integrated because fresh data is better than everything (security first)

• upcoming entries from ip2fqdn
• upcoming entries from honeypots