siderolabs / omni

SaaS-simple deployment of Kubernetes - on your own hardware.
Other
529 stars 31 forks source link

feat: compress machine logs before writing to disk #168

Closed utkuozdemir closed 5 months ago

utkuozdemir commented 5 months ago

Compress the logs before writing to disk. Implement the feature in a manner that if the compression setting is enabled or disabled, it be able to do the switch as expected.

Additionally, skip flushing the log to the disk if there was no log activity since the last flush.

Addresses 2,5 of the 3 ideas in this comment:

Closes #118.

utkuozdemir commented 5 months ago

can we add some jitter to the timer which fires to flush the logs?

Added a configurable jitter with the default being 2 minutes - it'd flush 10(+-2) mins.

utkuozdemir commented 5 months ago

Closed for now - doing a different rework after the discussion with @smira