humio / issues

Issue Tracker for Humio
4 stars 2 forks source link

Feature Request - allow Humio to support a hot/warm/cold architecture #13

Closed henrikjohansen closed 5 years ago

henrikjohansen commented 6 years ago

Currently Humio has no concept of data or storage tiering - this can quickly become an economic headache for large clusters. It should be possible to introduce tiers or classes of storage and have Humio move data based on a retention policy. An example could be :

This scheme should be flexible enough to support storage tiers either as locally attached storage or dedicated nodes and provide some mechanisms to control the impact of data movement (like limiting CPU usage, IO, etc).

mortengrouleff commented 5 years ago

Version 1.2.4 supports this for "Primary" and "Secondary" based on space available on the primary file system. See https://docs.humio.com/configuration/secondary-storage/