Tenter une collecte à partir des certificate transparency logs

[JulienPalard]

crt.sh expose un postgresql public des Certificate Transparency logs (psql -h crt.sh certwatch guest), en partant de là on peut tenter deux choses :

• Importer d'un coup les domaines connus dans les CT logs.
• Ajouter périodiquement les nouveaux domaines apparaissant dans ces logs.

[JulienPalard]

I worked in #18 with:

SELECT id, x509_notBefore(certificate), x509_altnames(certificate) FROM certificate WHERE plainto_tsquery('gouv.fr') @@ identities(certificate) AND id > 5500000000;

It yields 7k+ domains, up to id 5908982198, but only 1224 were accessible over HTTP.

[JulienPalard]

Did another one, it works well, so I'm closing this issue. I "documented" the procedure in the commit message.

[bzg]

Thanks!