jeffsw / rpkilog

rpkilog.com web site and tools
MIT License
6 stars 0 forks source link

Consolidate vrpdiff records that only extend expiration time below a certain amount #21

Open jeffsw opened 10 months ago

jeffsw commented 10 months ago

RIRs and RPKI software is commonly issuing ROAs which expire after only a couple of days. They extend the expiration within hours. This keeps CRLs small. However, it also creates a lot of diff noise. Diffs resulting from these would only be helpful if the renewals were delayed or if there was actually a gap in validity.

We should consolidate nearly all diffs of this type. Exceptions are if there was a validity gap or renewal is closer to the expiration time than some TBD threshold.

This will involve updating ElasticSearch records. That's fine, except we might also want to force merge the indices to optimize away the junk left behind by updates. However, things won't be any worse without doing that, since the noise is in our current system.