search

NLnetLabs / routinator

An RPKI Validator and RTR server written in Rust
https://nlnetlabs.nl/projects/routing/routinator/
BSD 3-Clause "New" or "Revised" License
467 stars 71 forks source link

RRDP cache disk usage increases since updating to 0.14.0 #978

Open urscale opened 2 weeks ago

urscale commented 2 weeks ago

While pretty constant before, since updating from 0.13.0 to 0.14.0, the disk usage of /var/lib/routinator/rpki-cache/rrdp has been continuously increasing, with only some space getting freed occasionally:

0 14 0_disk_usage

Routinator has been installed from package on a Debian Bullseye host.

Let me know if there's anything I can do to help debug the issue.

partim commented 2 weeks ago

Thank you for your report!

Looking at our own installation, the rrdp directory (which contains the raw RRDP data) has nearly 5 GB while the stored directory (which contains the data actually used) has only 1.3 GB, which seems indeed a bit much. Does this roughly correspond with the values you see?

urscale commented 2 weeks ago

Yeah, we have about 1.3 GB in stored as well, with the rrdp directory between 2.7 GB and 3.3 GB in size.

One thing I noticed is that out of the three installations of Routinator we're running, one has an exceptionally large binary file /var/lib/routinator/rpki-cache/rrdp/rrdp.ripe.net/21d6592469dbe79feb2922562764fd193170f173229298b9a4443ffb5c282000.bin, which is using about 1.3 GB on that instance, while that same file only takes up around 530 MB on our other two instances.

Since all three Routinator instances are configured the same way, synching from the same sources, shouldn't one expect whatever is held in that RRDP cache to be of somewhat similar sizes?

pr4gmat1q commented 6 days ago

the same problem after updating to 14.0 image