Currently, I discuss the storage requirements of logs. This is a little unfair, as generally people stream logs compressed (or at least periodically compress them). Instead, I should describe the different data structures and what people can do to make these tradeoffs (at least, in part).
This is especially interesting as low entropy logs (e.g. repeated logs) should compress exceptionally well.
Section
Pillar 1: Logs
Lecture
When to Use
How can we make it better?
Currently, I discuss the storage requirements of logs. This is a little unfair, as generally people stream logs compressed (or at least periodically compress them). Instead, I should describe the different data structures and what people can do to make these tradeoffs (at least, in part).
This is especially interesting as low entropy logs (e.g. repeated logs) should compress exceptionally well.
H/T to @alexpovel